-- Logs begin at Wed 2021-12-15 11:53:00 UTC, end at Wed 2021-12-15 13:27:49 UTC. -- Dec 15 12:31:08.158616 dv-cinder-813224-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 15 12:31:08.167469 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 15 12:31:08.169446 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 12:31:08 2021] *** Dec 15 12:31:08.169446 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 12:31:08.169446 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 12:31:08.169446 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: nodename: dv-cinder-813224-4-iscsi Dec 15 12:31:08.169446 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: machine: x86_64 Dec 15 12:31:08.169446 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: clock source: unix Dec 15 12:31:08.169446 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: pcre jit disabled Dec 15 12:31:08.169446 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: detected number of CPU cores: 4 Dec 15 12:31:08.169446 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: current working directory: / Dec 15 12:31:08.169446 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: detected binary path: /usr/bin/uwsgi-core Dec 15 12:31:08.170273 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: your processes number limit is 47680 Dec 15 12:31:08.170273 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: your memory page size is 4096 bytes Dec 15 12:31:08.170273 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: detected max file descriptor number: 2048 Dec 15 12:31:08.170273 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: lock engine: pthread robust mutexes Dec 15 12:31:08.170273 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: thunder lock: enabled Dec 15 12:31:08.170273 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 15 12:31:08.170273 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 12:31:08.214861 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: Python main interpreter initialized at 0x55be377669c0 Dec 15 12:31:08.214861 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: python threads support enabled Dec 15 12:31:08.214861 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: your server socket listen backlog is limited to 100 connections Dec 15 12:31:08.214861 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: your mercy for graceful operations on workers is 90 seconds Dec 15 12:31:08.215275 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 12:31:08.215275 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: *** Operational MODE: preforking *** Dec 15 12:31:08.215561 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: *** uWSGI is running in multiple interpreter mode *** Dec 15 12:31:08.215561 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: spawned uWSGI master process (pid: 108407) Dec 15 12:31:08.215777 dv-cinder-813224-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 15 12:31:08.216442 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: spawned uWSGI worker 1 (pid: 108408, cores: 1) Dec 15 12:31:08.218687 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: spawned uWSGI worker 2 (pid: 108409, cores: 1) Dec 15 12:31:08.218687 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 12:31:09.961290 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 12:31:09.961290 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: from cryptography.utils import int_from_bytes Dec 15 12:31:09.962004 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 12:31:09.962004 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: from cryptography.utils import int_from_bytes Dec 15 12:31:09.976186 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 12:31:09.976186 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: from cryptography.utils import int_from_bytes Dec 15 12:31:09.976804 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 12:31:09.976804 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: from cryptography.utils import int_from_bytes Dec 15 12:31:12.618612 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 12:31:12.619163 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 12:31:12.619267 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 12:31:12.619620 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 12:31:12.619875 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 12:31:12.620265 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.620586 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.620690 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 12:31:12.621101 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.621182 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 12:31:12.621251 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.621539 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.621726 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 12:31:12.621831 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.622158 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.622247 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 12:31:12.622562 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.622664 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 12:31:12.622801 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.623060 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.623147 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.623373 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.623945 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813224-4-iscsi {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.624046 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.624272 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.624576 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.624661 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.624885 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.625089 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.625185 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.625493 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.625632 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.625836 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.626110 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.626202 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.626614 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.626701 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.627924 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.628071 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.628179 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.628294 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.628388 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.628468 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.628592 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.628674 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.628750 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.629281 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813224-4-iscsi {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.629370 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.629444 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.629444 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.629627 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.629764 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.629855 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.630034 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.630297 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.630421 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.630735 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813224-4-iscsi {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.630928 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.631058 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.631227 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.631360 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.631581 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.631753 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.632050 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.632266 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.632416 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.632588 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.632810 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.632956 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.633085 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.633222 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.633353 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.633567 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.633674 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.633892 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.633986 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.634207 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.634295 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.634521 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.634611 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.634831 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.634930 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.635127 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.635214 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.635433 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.635518 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.635742 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.635848 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813224-4-iscsi {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.636057 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.636170 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.636360 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.636487 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.636664 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.636805 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.636911 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.637215 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.637298 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.637550 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.637651 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.637870 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.637958 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.638187 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.638275 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.638445 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.638533 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.638696 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.638810 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.639013 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.639143 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.639331 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.639468 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.639720 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.639833 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.639941 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.640102 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.640249 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.640415 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.640550 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.640729 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.640859 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.641043 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.641160 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.641368 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.641460 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.641713 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.641807 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.642018 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.642117 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.642272 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.642385 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.643193 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.643297 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.643514 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.643608 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.643871 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.643957 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.644201 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.644298 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.644458 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.644559 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.644714 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.644811 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.645038 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.645139 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.645364 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.645459 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.645703 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.645839 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.646018 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.646113 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.646329 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.646421 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.646637 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.646729 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.646946 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.647034 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.647249 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.647333 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.647558 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.647648 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.647866 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.647953 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.648172 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.648264 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.648422 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.648508 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.648725 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.648812 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.649029 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.649114 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.649344 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.649437 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.649670 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.649819 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.649974 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.650060 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.650277 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.650388 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.650574 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.650704 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.650970 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.651068 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.651281 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.651377 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.651584 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.651673 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.651886 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.651971 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.652190 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.652289 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.652494 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.652579 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.652796 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.652888 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.653097 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.653192 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.653398 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.653491 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.653740 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.653828 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.654029 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.654116 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.654334 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.654420 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.654639 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.654723 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.654942 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.655035 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.655243 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.655344 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.655551 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.655646 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.655851 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.655938 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.656152 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.656236 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.656461 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.656546 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.656760 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.656847 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.657061 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.657153 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.657367 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.657452 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.657701 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.657796 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.658004 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.658097 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.658876 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.659039 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.659204 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.659392 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.659478 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.659701 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.659787 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.660019 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.660106 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.660325 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.660411 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.660633 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.660746 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.660936 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.661032 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.661236 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.661335 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.661560 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.661706 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.661864 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.661952 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.662163 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.662294 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.662467 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.662554 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.662766 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.662854 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.663080 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.663165 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.663397 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.663491 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.663705 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.663792 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.664006 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.664090 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.664307 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.664392 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.664614 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.664701 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.664926 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.665013 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.665248 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.665346 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.665580 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.665670 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.665892 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.665990 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.666199 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.666294 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.666507 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.666593 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.666817 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.666903 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.667130 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.667227 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.667437 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.667527 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.667746 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.667839 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.668051 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.668138 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.668356 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.668440 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.668664 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.668749 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.668976 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.669069 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.669289 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.669374 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.669620 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.669731 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.669951 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:31:12.670057 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.670304 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.670380 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.670641 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.670742 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.670978 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.671084 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.671292 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.671385 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.671616 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.671700 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.671937 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.672011 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.672246 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.672321 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.672558 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.672646 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.672874 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.672957 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.673208 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.673282 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.673542 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.673636 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.673897 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.674030 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.674222 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.674394 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.674641 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.674755 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.674832 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.675029 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.675135 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.675365 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.675474 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.675686 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.675785 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.676006 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.676091 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.676500 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.676590 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.676672 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.676746 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.676948 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.677023 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.677278 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.677355 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.677630 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.677711 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.677933 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.678007 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.678240 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.678327 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.678543 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.678625 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.678923 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.679023 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.679246 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.679343 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.679550 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.679637 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.679884 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.679970 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.680188 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.680286 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.680495 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.680582 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.680802 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.680897 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.681108 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.681351 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.681440 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.681546 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.681736 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.681826 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.682039 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.682135 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.682358 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.682444 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.682664 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.682749 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.682966 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.683054 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.683282 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.683368 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.683584 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.683669 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.683883 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.683971 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.684192 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.684282 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.684497 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.684589 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.684800 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.684895 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.685104 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.685191 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.685420 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.685611 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.685752 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.685848 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.686058 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.686144 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.686369 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.686461 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.686679 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.686784 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.686992 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.687078 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.687304 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.687399 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.687611 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.687698 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.687922 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.688008 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.688226 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.688320 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.688528 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.688613 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.688834 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.688926 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.689136 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.689230 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.689544 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.689665 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.689868 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.689958 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.690182 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.690310 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.690493 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.690620 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.690804 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.690927 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.691145 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.691281 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.691445 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.691563 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.691759 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.691860 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.692096 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.692189 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.692410 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.692499 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.692710 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.692811 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.693010 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.693131 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.693363 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.693630 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.693720 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.693940 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.694029 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.694283 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.694377 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.694607 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.694692 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.694915 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.695011 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.695224 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.695312 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.695532 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.695617 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.695838 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.695926 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.696144 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.696229 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.696450 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.696544 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.696758 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.696899 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.697061 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.697146 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.697379 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.697473 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.697714 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.697831 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.698019 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.698106 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.698327 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.698428 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.698633 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.698719 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.698946 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.699038 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.699265 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.699359 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.699570 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.699663 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.699884 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.699979 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.700221 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.700309 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.700554 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.700650 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.700866 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.700959 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.701182 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.701269 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.701487 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.701641 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.701825 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.701957 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.702133 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.702222 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.702439 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.702526 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.702745 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.702840 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.703051 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.703139 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.703364 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.703449 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.703670 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.703763 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.703985 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.704080 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.704291 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.704377 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.704612 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.704710 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.704917 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.705542 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.705808 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.705946 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.706157 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.706437 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.706552 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.706749 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.706899 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.707081 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.707170 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.707417 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.707504 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.707726 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.707814 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.708037 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.708129 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.708349 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.708437 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.708658 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.708751 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.708969 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.709062 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.709275 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.709362 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.709608 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.709698 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.709914 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.710013 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.710226 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.710317 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.710537 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.710622 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.710846 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.711009 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.711156 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.711249 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.711459 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.711545 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.711774 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.711868 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.712083 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.712170 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.712386 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.712473 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.712691 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.712786 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.713003 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.713089 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.713326 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.713420 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.713668 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.713758 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.713982 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.714067 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.714299 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.714385 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.714601 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.714689 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.714904 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.714990 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.715217 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.715303 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.715521 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.715608 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.715823 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.715916 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.716127 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.716223 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.716431 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.716525 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.716748 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.716841 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.717063 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.717160 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.717364 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.717449 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.717698 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.717786 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.718015 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.718114 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.718320 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.718407 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.718630 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.718717 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.718940 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.719034 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.719246 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.719333 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.719564 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.719648 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.719874 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.719969 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.720180 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.720265 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.720487 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.720573 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.721338 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.721436 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.721751 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.721881 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.722081 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.722183 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.722434 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.722522 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.722746 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.722839 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.723054 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.723141 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.723362 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.723449 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.723666 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.723753 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.723975 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.724062 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.724294 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.724390 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.724606 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.724878 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.724965 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.725212 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.725307 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.725543 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.725645 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.725866 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.725954 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.726180 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.726269 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.726496 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.726583 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.726810 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.726912 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.727122 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.727251 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.727433 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.727521 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.727738 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.727833 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.728048 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.728135 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.728354 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.728439 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.728658 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.728751 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.728971 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.729141 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.729294 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.729454 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.729796 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.729902 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.730103 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.730242 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.730412 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.730561 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.730716 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.730883 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.731018 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.731209 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.731351 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.731530 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.731654 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.731865 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.732006 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.732197 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.732284 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.732514 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.732600 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.732823 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.732918 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.733142 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.733229 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.733446 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.733629 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.733775 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.733873 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.734075 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.734161 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.734377 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.734462 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.734756 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.734858 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.734994 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.735081 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.735304 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.735391 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.735612 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.735700 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.735916 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.736004 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.736292 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.736443 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.736639 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.736730 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.736899 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.737020 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.737313 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.737415 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.737618 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.737722 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.737923 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.738010 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.738234 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.738319 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.738540 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.738635 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.738842 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.738928 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.739145 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.739231 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.739449 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.739537 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.739763 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.739849 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.740069 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.740154 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.740369 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.740457 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.740674 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.740759 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.741059 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.741161 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.741282 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.741371 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.741619 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.741842 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.741912 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.741997 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.742211 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.742300 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.742517 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.742604 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.742821 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.742917 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.743122 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.743210 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.743428 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.743515 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.743729 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.743847 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.744043 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.744128 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.744341 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.744427 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.744641 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.744739 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.744940 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.745034 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.745243 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.745328 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.745565 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.745656 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.745867 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.745965 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.746181 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.746267 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.746487 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.746576 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.746788 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.746873 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.747087 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.747172 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.747479 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.747581 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.747690 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.747777 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.747989 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.748082 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.748294 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.748382 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.748596 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.748931 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.749162 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.749257 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.749462 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.749568 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.749790 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.749875 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.750086 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.750183 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.750386 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.750472 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.750686 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.750772 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.750990 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.751088 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.751286 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.751371 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.751583 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.751676 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.751934 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.752035 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.752400 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.752732 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.752876 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.752965 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.753055 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.753257 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.753355 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.753436 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.753584 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.753796 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.753905 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.753988 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.754067 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.754144 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.754367 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.754453 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.754677 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.754908 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.755005 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.755094 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.755276 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.755362 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.755582 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.755677 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.755891 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.755984 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.756196 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.756293 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.756502 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.756593 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.756810 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.756896 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.757108 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.757203 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.757412 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.757528 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.757742 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.757830 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.758054 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.758151 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.758355 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.758442 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.758656 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.758742 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.758959 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.759057 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.759271 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.759357 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.759578 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.759665 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.759900 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.759995 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.760220 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.760307 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.760540 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.760633 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.760842 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.760931 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.761147 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.761240 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.761453 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.761594 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.761784 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.761872 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.762088 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.762180 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.762390 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.762475 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.762698 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.762786 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.763005 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.763091 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.763311 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.763396 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.763614 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.763701 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.763921 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.764014 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.764221 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.764387 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.764527 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.764614 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.764830 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.764916 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.765130 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.765225 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.765452 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.765608 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.765784 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.765873 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.766085 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.766182 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.766391 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.766484 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.766692 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.766786 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.766995 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.767090 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.767295 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.767381 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.768150 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.768333 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.768466 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.768647 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.768856 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.768962 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.769175 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.769261 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.769491 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.769602 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.769829 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.769915 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.770144 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.770230 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.770457 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.770545 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.770767 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.770855 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.771097 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.771183 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.771410 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.771498 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.771720 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.771807 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.772032 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.772132 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.772340 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.772436 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.772642 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.772729 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.772947 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.773042 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.773337 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.773422 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.773682 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.773764 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.773995 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.774093 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.774302 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.774378 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.774616 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.774710 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.774918 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.775029 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.775236 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.775317 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.775556 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.775640 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.775868 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.775945 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.776240 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.776322 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.776599 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.776674 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.776915 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.776992 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.777230 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.777313 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.777564 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.777644 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.777878 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.777956 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.778193 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.778544 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.778544 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.778691 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.778798 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.778877 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.779105 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.779180 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.779412 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.779497 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.779732 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.779808 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.780042 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.780116 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.780758 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.781230 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.781230 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.781354 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.781419 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.781489 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.781489 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.781652 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.781721 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.781837 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.782040 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.782155 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.782463 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.782556 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.782783 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.782858 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.783121 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.783767 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.784002 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.784087 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.784328 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.784404 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.784639 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.784727 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.784938 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.785029 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.785247 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.785336 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.785573 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.785689 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.785880 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.785990 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.786200 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.786314 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.786504 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.786625 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.786813 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.786954 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.787121 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.787281 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.787426 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.787599 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.787727 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.787928 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.788023 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.788336 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.788422 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.788637 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.788723 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.788956 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.789044 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.789266 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.789361 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.789607 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.789709 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.789922 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.790016 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.790229 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.790314 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.790542 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.790628 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.790847 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.790933 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.791149 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.791236 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.791449 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.791544 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.791754 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.791841 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.792068 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.792159 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.792381 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.792480 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.792695 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.792785 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.793004 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.793099 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.793313 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.793409 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.793655 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.793760 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.793967 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.794053 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.794297 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.794397 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.794608 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.794694 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.794924 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.795012 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.795247 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.795343 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.795548 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.795633 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.795850 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.795944 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.796225 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.796690 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.796779 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.796858 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.796936 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.797017 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.797106 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.797187 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.797328 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.797416 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.797653 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.797752 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.797957 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.798045 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.798257 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.798343 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.798627 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.798770 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.799002 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.799149 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.799325 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.799413 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.799636 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.799732 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.799945 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.800032 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.800248 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.800334 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.800550 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.800646 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.800938 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.801047 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.801182 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.801309 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.801492 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.801648 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.801857 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.801942 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.802118 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.802213 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.802474 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.802586 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.802878 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.802977 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.803057 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.803124 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.803326 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.803416 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.803631 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.803718 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.803962 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.804047 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.804270 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.804358 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.804577 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.804662 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.804889 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.804984 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.805195 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.805290 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.805625 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.805724 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.805829 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.805914 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.806138 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.806225 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.806452 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.806547 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.806797 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.807006 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.807123 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.807334 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.807452 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.807645 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.807784 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.807957 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.808097 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.808265 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.808425 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.808575 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.808746 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.808883 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.809064 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.809190 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.809382 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.809497 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.809726 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.809829 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.810044 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.810131 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.810361 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.810455 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.810678 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.810766 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.810988 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.811074 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.811305 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.811432 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.811622 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.811711 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.811941 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.812027 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.812256 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.812498 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.812625 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.812831 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.812925 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.813148 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.813279 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.813463 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.813571 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.813807 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.813893 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.814119 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.814206 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.814457 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.814548 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.814767 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.814854 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.815075 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.815170 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.815384 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.815470 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.815798 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.815901 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.816003 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.816106 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.816310 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.816398 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.816618 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.816705 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.816928 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.817024 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.817248 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.817339 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.817606 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.817698 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.817924 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.818014 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.818233 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.818320 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.818540 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.818627 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.818853 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.818941 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.819221 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.819361 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.819541 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.819676 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.819862 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.820003 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.820181 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.820325 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.820497 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.820645 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.820811 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.820956 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.821127 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.821268 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.821443 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.821636 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.821789 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.821939 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.822103 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.822237 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.822420 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.822545 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.822737 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.822849 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.823063 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.823161 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.823397 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.823487 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.823722 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.823817 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.824030 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.824115 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.824342 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.824428 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.824644 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.824737 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.825166 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.825252 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.825482 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.825603 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.825842 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.825929 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.826171 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.826272 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.826497 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.826585 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.826813 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.826898 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.827117 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.827211 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.827440 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.827534 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.827744 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.827830 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.828046 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.828141 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.828358 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.828445 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.828666 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.828752 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.828968 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.829089 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.829269 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.829403 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.829607 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.829698 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.829917 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.830575 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.830768 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.830923 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.831076 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.831247 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.831489 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.831828 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.831929 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.832135 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.832222 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.832440 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.832539 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.832745 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.832833 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.833054 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.833140 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.833357 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.833806 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.833921 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.834003 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.834082 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.834161 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.834272 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.834413 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.834584 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.834725 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.834886 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.835046 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.835194 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.835365 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.835496 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.835676 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.835805 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.835984 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.836109 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.836301 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.836398 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.836612 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.836751 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.836919 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.837021 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.837231 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.837325 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.837562 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.837653 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.837895 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.837995 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.838204 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.838319 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.838495 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.838584 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.838807 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.838902 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.839111 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.839198 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.839418 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.839504 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.839725 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.839813 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.840032 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.840320 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.840407 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.840643 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.840802 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.840951 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.841050 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.841262 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.841349 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.841594 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.841700 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.841912 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.841999 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.842219 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.842316 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.842533 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.842621 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.842839 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.842926 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.843164 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.843251 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.843472 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.843599 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.843776 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.843862 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.844084 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.844173 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.844393 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.844481 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.844701 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.844795 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.845009 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.845097 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.845316 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.845405 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.846243 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.846345 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.846573 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.846673 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.846915 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.847122 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.847232 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.847512 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.847613 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.847840 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.847929 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.848151 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.848238 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.848457 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.848556 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.848765 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.848855 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.849070 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.849156 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.849376 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.849471 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.849719 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.849809 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.850049 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.850151 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.850358 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.850454 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.850656 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.850742 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.850972 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.851081 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.851286 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.851384 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.851600 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.851688 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.851914 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.852047 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.852227 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.852316 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.852538 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.852625 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.852856 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.853018 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.853203 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.853336 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.853549 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.853688 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.853881 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.854005 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.854201 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.854296 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.854520 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.854615 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.854834 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.854929 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.855148 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.855235 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.855459 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.855545 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.855771 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.855871 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.856077 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.856171 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.856384 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.856479 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.856712 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.856808 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.857018 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.857106 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.857337 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.857455 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.857763 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.857853 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.858074 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.858163 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.858393 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.858480 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.858706 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.858810 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.859027 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.859129 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.859351 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.859454 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.859663 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.859765 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.859970 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.860070 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.860288 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.860390 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.860591 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.860682 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.860897 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.860985 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.861217 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.861326 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.861694 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.861811 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.861895 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.861985 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.862152 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.862251 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.862474 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.862580 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.862819 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.862928 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.863097 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.863195 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.863417 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.863518 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.863746 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.863892 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.864041 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.864131 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.864351 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.864445 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.864657 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.864744 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.864980 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.865081 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.865285 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.865372 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.865618 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.865721 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.865925 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.866030 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.866232 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.866320 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.866543 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.866630 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.866852 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.866941 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.867173 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.867262 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.867485 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.867579 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.867799 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.867887 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.868112 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.868202 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.868427 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.868527 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.868795 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.868889 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.869074 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.869167 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.869384 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.869481 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.869733 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.869820 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.870041 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.870140 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.870343 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.870437 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.870583 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 12:31:12.870673 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.870958 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.871292 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.871605 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.871923 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.872236 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.872547 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.872867 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.873185 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.873547 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.874123 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.874453 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.874784 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.875136 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.875453 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.875805 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.876136 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.876455 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.876771 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.877289 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:31:12.877596 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 12:31:12.894574 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG oslo_db.sqlalchemy.engines [None req-4582b095-48ec-4175-b774-cad5c03d48e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 12:31:12.902075 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG oslo_db.sqlalchemy.engines [None req-c3eab5fe-4408-460b-bb0b-1d99f38a3c25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 12:31:12.961842 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.context [None req-4582b095-48ec-4175-b774-cad5c03d48e4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8bd32f78-c52f-42b9-874a-80fccc21ade4(cell1) {{(pid=108409) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 12:31:12.966122 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG oslo_concurrency.lockutils [None req-4582b095-48ec-4175-b774-cad5c03d48e4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:31:12.967699 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG oslo_concurrency.lockutils [None req-4582b095-48ec-4175-b774-cad5c03d48e4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:31:12.968530 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG oslo_concurrency.lockutils [None req-4582b095-48ec-4175-b774-cad5c03d48e4 None None] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:31:12.969302 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.context [None req-c3eab5fe-4408-460b-bb0b-1d99f38a3c25 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8bd32f78-c52f-42b9-874a-80fccc21ade4(cell1) {{(pid=108408) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 12:31:12.970468 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG oslo_concurrency.lockutils [None req-4582b095-48ec-4175-b774-cad5c03d48e4 None None] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:31:12.973645 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG oslo_concurrency.lockutils [None req-c3eab5fe-4408-460b-bb0b-1d99f38a3c25 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:31:12.975230 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG oslo_concurrency.lockutils [None req-c3eab5fe-4408-460b-bb0b-1d99f38a3c25 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:31:12.976118 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG oslo_concurrency.lockutils [None req-c3eab5fe-4408-460b-bb0b-1d99f38a3c25 None None] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:31:12.978091 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG oslo_concurrency.lockutils [None req-c3eab5fe-4408-460b-bb0b-1d99f38a3c25 None None] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:31:12.981085 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG oslo_db.sqlalchemy.engines [None req-4582b095-48ec-4175-b774-cad5c03d48e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 12:31:12.984916 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG oslo_db.sqlalchemy.engines [None req-4582b095-48ec-4175-b774-cad5c03d48e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 12:31:12.993545 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG oslo_db.sqlalchemy.engines [None req-c3eab5fe-4408-460b-bb0b-1d99f38a3c25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 12:31:12.998384 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG oslo_db.sqlalchemy.engines [None req-c3eab5fe-4408-460b-bb0b-1d99f38a3c25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 12:31:13.152137 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG oslo_db.sqlalchemy.engines [None req-4582b095-48ec-4175-b774-cad5c03d48e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 12:31:13.179730 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG oslo_db.sqlalchemy.engines [None req-c3eab5fe-4408-460b-bb0b-1d99f38a3c25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 12:31:13.503233 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: WARNING keystonemiddleware.auth_token [None req-c3eab5fe-4408-460b-bb0b-1d99f38a3c25 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 12:31:13.507113 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: WARNING keystonemiddleware.auth_token [None req-4582b095-48ec-4175-b774-cad5c03d48e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 12:31:13.510205 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: WARNING keystonemiddleware.auth_token [None req-c3eab5fe-4408-460b-bb0b-1d99f38a3c25 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 12:31:13.513900 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: WARNING keystonemiddleware.auth_token [None req-4582b095-48ec-4175-b774-cad5c03d48e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 12:31:13.854703 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: WARNING keystonemiddleware.auth_token [None req-c3eab5fe-4408-460b-bb0b-1d99f38a3c25 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 12:31:13.859757 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: WARNING keystonemiddleware.auth_token [None req-c3eab5fe-4408-460b-bb0b-1d99f38a3c25 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 12:31:13.864168 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: WARNING keystonemiddleware.auth_token [None req-4582b095-48ec-4175-b774-cad5c03d48e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 12:31:13.865058 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55be377669c0 pid: 108408 (default app) Dec 15 12:31:13.867377 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-c3eab5fe-4408-460b-bb0b-1d99f38a3c25 None None] Calling method '>' {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:31:13.868556 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-c3eab5fe-4408-460b-bb0b-1d99f38a3c25 None None] 10.222.0.76 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001842 Dec 15 12:31:13.869255 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 1/1] 10.222.0.76 () {50 vars in 788 bytes} [Wed Dec 15 12:31:13 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:31:13.869903 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: WARNING keystonemiddleware.auth_token [None req-4582b095-48ec-4175-b774-cad5c03d48e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 12:31:13.875522 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55be377669c0 pid: 108409 (default app) Dec 15 12:32:39.118933 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-c3eab5fe-4408-460b-bb0b-1d99f38a3c25 None None] Calling method '>' {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:32:39.120248 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-c3eab5fe-4408-460b-bb0b-1d99f38a3c25 None None] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Dec 15 12:32:39.121811 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 2/2] 10.222.0.76 () {54 vars in 930 bytes} [Wed Dec 15 12:32:39 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:32:39.564743 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-d2f5dc80-376b-4e13-af7f-096e24eeb1a4 admin admin] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:32:39.595013 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-d2f5dc80-376b-4e13-af7f-096e24eeb1a4 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.465434 Dec 15 12:32:39.595864 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 1/3] 10.222.0.76 () {60 vars in 1291 bytes} [Wed Dec 15 12:32:39 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:32:42.132474 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-c3eab5fe-4408-460b-bb0b-1d99f38a3c25 None None] Calling method '>' {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:32:42.132953 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-c3eab5fe-4408-460b-bb0b-1d99f38a3c25 None None] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001381 Dec 15 12:32:42.137887 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 3/4] 10.222.0.76 () {54 vars in 930 bytes} [Wed Dec 15 12:32:42 2021] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:32:42.204643 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-773ff347-dd80-4603-8505-68f1ea59e548 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "rxtx_factor": 1.0, "disk": 1, "ram": 256, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:32:42.224508 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:32:42.224508 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: warnings.warn(msg) Dec 15 12:32:42.254745 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-773ff347-dd80-4603-8505-68f1ea59e548 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.114882 Dec 15 12:32:42.255498 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 2/5] 10.222.0.76 () {64 vars in 1282 bytes} [Wed Dec 15 12:32:42 2021] POST /compute/v2.1/flavors => generated 407 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:32:42.541306 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-eaaa4312-740d-4d96-bd01-d4ed0d501b40 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:32:42.543782 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:32:42.543782 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: warnings.warn(msg) Dec 15 12:32:42.596366 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-eaaa4312-740d-4d96-bd01-d4ed0d501b40 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.331769 Dec 15 12:32:42.597218 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 4/6] 10.222.0.76 () {64 vars in 1335 bytes} [Wed Dec 15 12:32:42 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:32:45.117586 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-773ff347-dd80-4603-8505-68f1ea59e548 admin admin] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:32:45.119339 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-773ff347-dd80-4603-8505-68f1ea59e548 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002193 Dec 15 12:32:45.119756 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 3/7] 10.222.0.76 () {54 vars in 930 bytes} [Wed Dec 15 12:32:45 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:32:45.243030 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-3c17f585-db61-453e-8801-625ae1f7674d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "id": "d1", "rxtx_factor": 1.0, "vcpus": 1, "name": "ds512M", "swap": 0}} {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:32:45.261927 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:32:45.261927 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: warnings.warn(msg) Dec 15 12:32:45.284227 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-3c17f585-db61-453e-8801-625ae1f7674d admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.156118 Dec 15 12:32:45.284995 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 5/8] 10.222.0.76 () {64 vars in 1282 bytes} [Wed Dec 15 12:32:45 2021] POST /compute/v2.1/flavors => generated 404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:32:45.297744 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-af030275-6d0f-42d9-8b5b-10e9dc1ad67d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:32:45.299925 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:32:45.299925 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: warnings.warn(msg) Dec 15 12:32:45.336780 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-af030275-6d0f-42d9-8b5b-10e9dc1ad67d admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043387 Dec 15 12:32:45.344597 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 4/9] 10.222.0.76 () {64 vars in 1335 bytes} [Wed Dec 15 12:32:45 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:32:47.816132 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-3c17f585-db61-453e-8801-625ae1f7674d admin admin] Calling method '>' {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:32:47.817144 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-3c17f585-db61-453e-8801-625ae1f7674d admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Dec 15 12:32:47.817584 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 6/10] 10.222.0.76 () {54 vars in 930 bytes} [Wed Dec 15 12:32:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:32:47.891238 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-917ebc9d-16ed-454f-b6e2-a09318e86f33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "id": "d2", "swap": 0, "vcpus": 1, "ram": 1024}} {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:32:47.910801 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-917ebc9d-16ed-454f-b6e2-a09318e86f33 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.086606 Dec 15 12:32:47.911685 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 5/11] 10.222.0.76 () {64 vars in 1282 bytes} [Wed Dec 15 12:32:47 2021] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:32:47.926020 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-bec1e77e-dc1d-4d3d-9868-869ec43b90d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:32:47.954612 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-bec1e77e-dc1d-4d3d-9868-869ec43b90d2 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032977 Dec 15 12:32:47.955776 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 7/12] 10.222.0.76 () {64 vars in 1335 bytes} [Wed Dec 15 12:32:47 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:32:50.502259 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-917ebc9d-16ed-454f-b6e2-a09318e86f33 admin admin] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:32:50.503186 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-917ebc9d-16ed-454f-b6e2-a09318e86f33 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001587 Dec 15 12:32:50.503618 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 6/13] 10.222.0.76 () {54 vars in 930 bytes} [Wed Dec 15 12:32:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:32:50.569925 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-da03165b-43d4-4296-836d-366cbe84020d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "name": "ds2G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 2, "swap": 0}} {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:32:50.588094 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-da03165b-43d4-4296-836d-366cbe84020d admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077028 Dec 15 12:32:50.588905 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 8/14] 10.222.0.76 () {64 vars in 1282 bytes} [Wed Dec 15 12:32:50 2021] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:32:50.601238 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-fca431e1-b9a4-4598-b047-42c5a5321154 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:32:50.623965 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-fca431e1-b9a4-4598-b047-42c5a5321154 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026438 Dec 15 12:32:50.637533 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 7/15] 10.222.0.76 () {64 vars in 1335 bytes} [Wed Dec 15 12:32:50 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:32:53.134180 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-da03165b-43d4-4296-836d-366cbe84020d admin admin] Calling method '>' {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:32:53.135186 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-da03165b-43d4-4296-836d-366cbe84020d admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Dec 15 12:32:53.135589 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 9/16] 10.222.0.76 () {54 vars in 930 bytes} [Wed Dec 15 12:32:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:32:53.201847 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-8e510b62-409e-4e82-a459-cff113e6ab4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "swap": 0, "disk": 20, "id": "d4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 4096}} {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:32:53.223331 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-8e510b62-409e-4e82-a459-cff113e6ab4a admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080836 Dec 15 12:32:53.225559 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 8/17] 10.222.0.76 () {64 vars in 1282 bytes} [Wed Dec 15 12:32:53 2021] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:32:53.236447 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-af3ef5f7-65ae-47ea-bed2-a9fdf2126eab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:32:53.270804 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-af3ef5f7-65ae-47ea-bed2-a9fdf2126eab admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038205 Dec 15 12:32:53.271637 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 10/18] 10.222.0.76 () {64 vars in 1335 bytes} [Wed Dec 15 12:32:53 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:32:55.895716 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-8e510b62-409e-4e82-a459-cff113e6ab4a admin admin] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:32:55.897147 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-8e510b62-409e-4e82-a459-cff113e6ab4a admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001816 Dec 15 12:32:55.897487 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 9/19] 10.222.0.76 () {54 vars in 930 bytes} [Wed Dec 15 12:32:55 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:32:55.976219 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-1eb216df-5ba2-4d94-95af-89dd74d8be2f admin admin] Calling method '>' {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:32:56.031619 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-1eb216df-5ba2-4d94-95af-89dd74d8be2f admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.125280 Dec 15 12:32:56.032576 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 11/20] 10.222.0.76 () {60 vars in 1291 bytes} [Wed Dec 15 12:32:55 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:32:58.588169 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-8e510b62-409e-4e82-a459-cff113e6ab4a admin admin] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:32:58.589222 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-8e510b62-409e-4e82-a459-cff113e6ab4a admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001611 Dec 15 12:32:58.589707 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 10/21] 10.222.0.76 () {54 vars in 930 bytes} [Wed Dec 15 12:32:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:32:58.661826 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-fecf15c3-a393-4e69-a45b-758d9aeaefed admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "disk": 1, "ram": 512, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "1", "os-flavor-access:is_public": true}} {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:32:58.681376 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-fecf15c3-a393-4e69-a45b-758d9aeaefed admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.083984 Dec 15 12:32:58.681983 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 12/22] 10.222.0.76 () {64 vars in 1282 bytes} [Wed Dec 15 12:32:58 2021] POST /compute/v2.1/flavors => generated 402 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:32:58.695507 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-ce88f086-4773-4b4e-9c98-a7d873da1cf2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:32:58.720182 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-ce88f086-4773-4b4e-9c98-a7d873da1cf2 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028527 Dec 15 12:32:58.720790 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 11/23] 10.222.0.76 () {64 vars in 1332 bytes} [Wed Dec 15 12:32:58 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:33:01.162279 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-fecf15c3-a393-4e69-a45b-758d9aeaefed admin admin] Calling method '>' {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:33:01.163216 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-fecf15c3-a393-4e69-a45b-758d9aeaefed admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Dec 15 12:33:01.163620 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 13/24] 10.222.0.76 () {54 vars in 930 bytes} [Wed Dec 15 12:33:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:33:01.232218 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-c6da4c7c-b213-49b1-84eb-c4a6180f6f88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "2", "vcpus": 1, "ram": 2048, "disk": 20, "rxtx_factor": 1.0, "swap": 0, "name": "m1.small"}} {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:33:01.252732 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-c6da4c7c-b213-49b1-84eb-c4a6180f6f88 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082267 Dec 15 12:33:01.253426 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 12/25] 10.222.0.76 () {64 vars in 1282 bytes} [Wed Dec 15 12:33:01 2021] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:33:01.268986 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-c93f7599-180c-468d-9909-7a38bcf7860b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:33:01.292721 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-c93f7599-180c-468d-9909-7a38bcf7860b admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027595 Dec 15 12:33:01.293981 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 14/26] 10.222.0.76 () {64 vars in 1332 bytes} [Wed Dec 15 12:33:01 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:33:03.790898 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-c6da4c7c-b213-49b1-84eb-c4a6180f6f88 admin admin] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:33:03.792035 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-c6da4c7c-b213-49b1-84eb-c4a6180f6f88 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001605 Dec 15 12:33:03.792557 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 13/27] 10.222.0.76 () {54 vars in 930 bytes} [Wed Dec 15 12:33:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:33:03.866707 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-6aeebb20-f961-425a-87a1-0bf9db7952a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 40, "vcpus": 2, "swap": 0, "name": "m1.medium", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:33:03.884210 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-6aeebb20-f961-425a-87a1-0bf9db7952a9 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.084496 Dec 15 12:33:03.884828 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 15/28] 10.222.0.76 () {64 vars in 1282 bytes} [Wed Dec 15 12:33:03 2021] POST /compute/v2.1/flavors => generated 406 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:33:03.903325 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-3b7013f0-545b-4631-8101-64c4505defbd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:33:03.933089 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-3b7013f0-545b-4631-8101-64c4505defbd admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038034 Dec 15 12:33:03.933713 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 14/29] 10.222.0.76 () {64 vars in 1332 bytes} [Wed Dec 15 12:33:03 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:33:06.478500 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-6aeebb20-f961-425a-87a1-0bf9db7952a9 admin admin] Calling method '>' {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:33:06.479629 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-6aeebb20-f961-425a-87a1-0bf9db7952a9 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Dec 15 12:33:06.480483 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 16/30] 10.222.0.76 () {54 vars in 930 bytes} [Wed Dec 15 12:33:06 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:33:06.553230 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-f63c056b-90ef-4db2-85fa-08848ff6f958 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "id": "4", "disk": 80, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large"}} {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:33:06.573374 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-f63c056b-90ef-4db2-85fa-08848ff6f958 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.085932 Dec 15 12:33:06.574609 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 15/31] 10.222.0.76 () {64 vars in 1282 bytes} [Wed Dec 15 12:33:06 2021] POST /compute/v2.1/flavors => generated 405 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:33:06.587967 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-bec1251b-4eed-469e-ba4d-1c08f534db2f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:33:06.613456 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-bec1251b-4eed-469e-ba4d-1c08f534db2f admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029562 Dec 15 12:33:06.614527 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 17/32] 10.222.0.76 () {64 vars in 1332 bytes} [Wed Dec 15 12:33:06 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:33:09.132588 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-f63c056b-90ef-4db2-85fa-08848ff6f958 admin admin] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:33:09.133659 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-f63c056b-90ef-4db2-85fa-08848ff6f958 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Dec 15 12:33:09.134078 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 16/33] 10.222.0.76 () {54 vars in 930 bytes} [Wed Dec 15 12:33:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:33:09.204814 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-39f2a896-8a40-4bbd-9765-3019e23450e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160, "vcpus": 8, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "swap": 0, "rxtx_factor": 1.0}} {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:33:09.224632 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-39f2a896-8a40-4bbd-9765-3019e23450e4 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.083737 Dec 15 12:33:09.225680 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 18/34] 10.222.0.76 () {64 vars in 1282 bytes} [Wed Dec 15 12:33:09 2021] POST /compute/v2.1/flavors => generated 408 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:33:09.239772 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-ae6dde1f-c7ff-443e-80ac-36c0fd3e40ae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:33:09.264710 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-ae6dde1f-c7ff-443e-80ac-36c0fd3e40ae admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030693 Dec 15 12:33:09.265707 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 17/35] 10.222.0.76 () {64 vars in 1332 bytes} [Wed Dec 15 12:33:09 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:33:30.679255 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-39f2a896-8a40-4bbd-9765-3019e23450e4 admin admin] Calling method '>' {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:33:30.680262 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-39f2a896-8a40-4bbd-9765-3019e23450e4 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Dec 15 12:33:30.680669 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 19/36] 10.222.0.76 () {54 vars in 930 bytes} [Wed Dec 15 12:33:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:33:30.742384 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-19e87680-8ec8-4617-825e-d912bf078b72 admin admin] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:33:30.759463 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-19e87680-8ec8-4617-825e-d912bf078b72 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071687 Dec 15 12:33:30.759990 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 18/37] 10.222.0.76 () {60 vars in 1291 bytes} [Wed Dec 15 12:33:30 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:33:32.383675 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-39f2a896-8a40-4bbd-9765-3019e23450e4 admin admin] Calling method '>' {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:33:32.384682 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-39f2a896-8a40-4bbd-9765-3019e23450e4 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Dec 15 12:33:32.385086 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 20/38] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Dec 15 12:33:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:33:32.580195 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-ded809c0-d486-400b-a44f-93c632ec5650 admin admin] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:33:32.585816 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.wsgi [None req-ded809c0-d486-400b-a44f-93c632ec5650 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 15 12:33:32.586375 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-ded809c0-d486-400b-a44f-93c632ec5650 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:33:32.587157 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-ded809c0-d486-400b-a44f-93c632ec5650 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060033 Dec 15 12:33:32.587670 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 19/39] 10.222.0.76 () {60 vars in 1190 bytes} [Wed Dec 15 12:33:32 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 12:33:32.598023 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-087fb83a-692d-4ac3-a3e2-bc8860d23dbe admin admin] Calling method '>' {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:33:32.618712 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-087fb83a-692d-4ac3-a3e2-bc8860d23dbe admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024244 Dec 15 12:33:32.619257 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 21/40] 10.222.0.76 () {60 vars in 1210 bytes} [Wed Dec 15 12:33:32 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:33:32.630575 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-0db0a25c-2a33-4165-98b1-2334d53f1a90 admin admin] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:33:32.654031 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-0db0a25c-2a33-4165-98b1-2334d53f1a90 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026922 Dec 15 12:33:32.654604 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 20/41] 10.222.0.76 () {60 vars in 1210 bytes} [Wed Dec 15 12:33:32 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:33:32.664915 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-77519ea7-bc32-4c52-9f74-99218bc32b36 admin admin] Calling method '>' {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:33:32.671078 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.wsgi [None req-77519ea7-bc32-4c52-9f74-99218bc32b36 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 15 12:33:32.671663 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-77519ea7-bc32-4c52-9f74-99218bc32b36 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:33:32.672463 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-77519ea7-bc32-4c52-9f74-99218bc32b36 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011149 Dec 15 12:33:32.672978 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 22/42] 10.222.0.76 () {60 vars in 1190 bytes} [Wed Dec 15 12:33:32 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 12:33:34.199792 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-0db0a25c-2a33-4165-98b1-2334d53f1a90 admin admin] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:33:34.200790 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-0db0a25c-2a33-4165-98b1-2334d53f1a90 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Dec 15 12:33:34.201181 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 21/43] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Dec 15 12:33:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:33:34.400509 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-54c3aa93-d6eb-4cd8-9329-494470274628 admin admin] Calling method '>' {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:33:34.406547 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.wsgi [None req-54c3aa93-d6eb-4cd8-9329-494470274628 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 15 12:33:34.407053 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-54c3aa93-d6eb-4cd8-9329-494470274628 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:33:34.408236 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-54c3aa93-d6eb-4cd8-9329-494470274628 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.068504 Dec 15 12:33:34.409007 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 23/44] 10.222.0.76 () {60 vars in 1190 bytes} [Wed Dec 15 12:33:34 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 12:33:34.421715 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-77b338a3-ded7-4519-a79a-f03e0348c4e9 admin admin] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:33:34.435274 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-77b338a3-ded7-4519-a79a-f03e0348c4e9 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018008 Dec 15 12:33:34.435867 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 22/45] 10.222.0.76 () {60 vars in 1210 bytes} [Wed Dec 15 12:33:34 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:33:34.446731 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-cc05e06d-2fd9-4b1a-99b5-c7c12d949d85 admin admin] Calling method '>' {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:33:34.460598 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-cc05e06d-2fd9-4b1a-99b5-c7c12d949d85 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017383 Dec 15 12:33:34.461188 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 24/46] 10.222.0.76 () {60 vars in 1210 bytes} [Wed Dec 15 12:33:34 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:33:34.471699 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-b05e810f-2b7e-4995-a35a-b613e82ad091 admin admin] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:33:34.477220 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.wsgi [None req-b05e810f-2b7e-4995-a35a-b613e82ad091 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 15 12:33:34.477814 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-b05e810f-2b7e-4995-a35a-b613e82ad091 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:33:34.478615 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-b05e810f-2b7e-4995-a35a-b613e82ad091 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010761 Dec 15 12:33:34.479145 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 23/47] 10.222.0.76 () {60 vars in 1190 bytes} [Wed Dec 15 12:33:34 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 12:33:36.026888 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-cc05e06d-2fd9-4b1a-99b5-c7c12d949d85 admin admin] Calling method '>' {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:33:36.027886 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-cc05e06d-2fd9-4b1a-99b5-c7c12d949d85 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Dec 15 12:33:36.028284 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 25/48] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Dec 15 12:33:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:33:36.232410 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-6054b44b-59f3-4a7b-87fd-4814f6db40fe admin admin] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:33:36.237652 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.wsgi [None req-6054b44b-59f3-4a7b-87fd-4814f6db40fe admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 15 12:33:36.238283 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-6054b44b-59f3-4a7b-87fd-4814f6db40fe admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:33:36.239107 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-6054b44b-59f3-4a7b-87fd-4814f6db40fe admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.066383 Dec 15 12:33:36.239655 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 24/49] 10.222.0.76 () {60 vars in 1193 bytes} [Wed Dec 15 12:33:36 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 12:33:36.250558 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-65d6bd06-e771-4b83-91f8-cad8c72e7cf0 admin admin] Calling method '>' {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:33:36.263894 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-65d6bd06-e771-4b83-91f8-cad8c72e7cf0 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017647 Dec 15 12:33:36.265376 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 26/50] 10.222.0.76 () {60 vars in 1210 bytes} [Wed Dec 15 12:33:36 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:33:36.276999 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-a687f681-ebbb-4c54-bb4d-21711febb9d6 admin admin] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:33:36.289930 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-a687f681-ebbb-4c54-bb4d-21711febb9d6 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017972 Dec 15 12:33:36.290520 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 25/51] 10.222.0.76 () {60 vars in 1210 bytes} [Wed Dec 15 12:33:36 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:33:36.301430 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-3ee456e8-3ae1-4a23-b587-ff5b6b74a6df admin admin] Calling method '>' {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:33:36.306739 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.wsgi [None req-3ee456e8-3ae1-4a23-b587-ff5b6b74a6df admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 15 12:33:36.307301 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-3ee456e8-3ae1-4a23-b587-ff5b6b74a6df admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:33:36.308082 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-3ee456e8-3ae1-4a23-b587-ff5b6b74a6df admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010381 Dec 15 12:33:36.308584 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 27/52] 10.222.0.76 () {60 vars in 1193 bytes} [Wed Dec 15 12:33:36 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 12:33:37.853101 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-a687f681-ebbb-4c54-bb4d-21711febb9d6 admin admin] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:33:37.854331 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-a687f681-ebbb-4c54-bb4d-21711febb9d6 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Dec 15 12:33:37.854504 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 26/53] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Dec 15 12:33:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:33:38.052611 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-790a4cc1-905a-4517-a1bd-eb776bd5ec8b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:33:38.072990 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-790a4cc1-905a-4517-a1bd-eb776bd5ec8b admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.075030 Dec 15 12:33:38.073465 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 28/54] 10.222.0.76 () {64 vars in 1235 bytes} [Wed Dec 15 12:33:37 2021] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:33:39.602091 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-a687f681-ebbb-4c54-bb4d-21711febb9d6 admin admin] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:33:39.603088 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-a687f681-ebbb-4c54-bb4d-21711febb9d6 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Dec 15 12:33:39.603486 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 27/55] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Dec 15 12:33:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:33:39.805452 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-822497a3-d3b6-4f41-a5c9-ea1902e07bb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:33:39.822609 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-822497a3-d3b6-4f41-a5c9-ea1902e07bb5 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.071519 Dec 15 12:33:39.823088 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 29/56] 10.222.0.76 () {64 vars in 1235 bytes} [Wed Dec 15 12:33:39 2021] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:33:41.378360 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-a687f681-ebbb-4c54-bb4d-21711febb9d6 admin admin] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:33:41.379358 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-a687f681-ebbb-4c54-bb4d-21711febb9d6 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Dec 15 12:33:41.379764 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 28/57] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Dec 15 12:33:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:33:41.574038 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-14454c71-1c36-4f24-8597-97683a933844 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:33:41.593163 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-14454c71-1c36-4f24-8597-97683a933844 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.071728 Dec 15 12:33:41.593727 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 30/58] 10.222.0.76 () {64 vars in 1235 bytes} [Wed Dec 15 12:33:41 2021] POST /compute/v2.1/flavors => generated 407 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:33:43.166004 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-a687f681-ebbb-4c54-bb4d-21711febb9d6 admin admin] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:33:43.167084 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-a687f681-ebbb-4c54-bb4d-21711febb9d6 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Dec 15 12:33:43.167440 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 29/59] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Dec 15 12:33:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:33:43.367888 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-98dcd232-14dc-4520-8f90-7a38adf32c93 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:33:43.387333 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-98dcd232-14dc-4520-8f90-7a38adf32c93 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.072729 Dec 15 12:33:43.387886 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 31/60] 10.222.0.76 () {64 vars in 1235 bytes} [Wed Dec 15 12:33:43 2021] POST /compute/v2.1/flavors => generated 409 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:33:44.902140 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-a687f681-ebbb-4c54-bb4d-21711febb9d6 admin admin] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:33:44.903174 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-a687f681-ebbb-4c54-bb4d-21711febb9d6 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Dec 15 12:33:44.903573 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 30/61] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Dec 15 12:33:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:33:45.103131 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-5c11e1b3-0b77-4a04-adc3-7279c1a98286 admin admin] Calling method '>' {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:33:45.123355 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-5c11e1b3-0b77-4a04-adc3-7279c1a98286 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072016 Dec 15 12:33:45.124404 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 32/62] 10.222.0.76 () {60 vars in 1202 bytes} [Wed Dec 15 12:33:45 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:34:34.444049 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-a687f681-ebbb-4c54-bb4d-21711febb9d6 admin admin] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:34:34.445056 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-a687f681-ebbb-4c54-bb4d-21711febb9d6 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Dec 15 12:34:34.445462 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 31/63] 10.222.0.76 () {54 vars in 930 bytes} [Wed Dec 15 12:34:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:34:34.505689 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-9c5a8913-64c1-4fba-bfa7-2b0f2314f17f admin admin] Calling method '>' {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:34:34.528694 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-9c5a8913-64c1-4fba-bfa7-2b0f2314f17f admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075957 Dec 15 12:34:34.529226 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 33/64] 10.222.0.76 () {60 vars in 1291 bytes} [Wed Dec 15 12:34:34 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:34:34.551350 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-c28bca47-1f8f-4e38-8ae9-81f94036f640 admin admin] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:34:34.558904 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-c28bca47-1f8f-4e38-8ae9-81f94036f640 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011247 Dec 15 12:34:34.559417 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 32/65] 10.222.0.76 () {60 vars in 1282 bytes} [Wed Dec 15 12:34:34 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:34:34.572455 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-78f341d7-3278-47d3-99b6-1f15d0ce342b admin admin] Calling method '>' {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:34:34.581156 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-78f341d7-3278-47d3-99b6-1f15d0ce342b admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012387 Dec 15 12:34:34.581730 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 34/66] 10.222.0.76 () {60 vars in 1285 bytes} [Wed Dec 15 12:34:34 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:34:34.593678 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-c4b7721b-51e9-4ebb-8a37-778b9f2521a7 admin admin] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:34:34.601231 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-c4b7721b-51e9-4ebb-8a37-778b9f2521a7 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011104 Dec 15 12:34:34.601794 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 33/67] 10.222.0.76 () {60 vars in 1285 bytes} [Wed Dec 15 12:34:34 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:34:34.613627 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-07f2310c-02fa-446e-a256-2872ad793b4f admin admin] Calling method '>' {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:34:34.626489 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-07f2310c-02fa-446e-a256-2872ad793b4f admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016211 Dec 15 12:34:34.627071 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 35/68] 10.222.0.76 () {60 vars in 1282 bytes} [Wed Dec 15 12:34:34 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:35:59.885358 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-46bc0e0a-2078-46f3-b52d-31da9c71f574 tempest-verify_tempest_config-261757332 tempest-verify_tempest_config-261757332-project] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:35:59.887373 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-46bc0e0a-2078-46f3-b52d-31da9c71f574 tempest-verify_tempest_config-261757332 tempest-verify_tempest_config-261757332-project] 10.222.0.76 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.109008 Dec 15 12:35:59.887898 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 34/69] 10.222.0.76 () {58 vars in 1133 bytes} [Wed Dec 15 12:35:59 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:37:35.155212 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-07f2310c-02fa-446e-a256-2872ad793b4f admin admin] Calling method '>' {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:37:35.156217 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-07f2310c-02fa-446e-a256-2872ad793b4f admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Dec 15 12:37:35.156617 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 36/70] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Dec 15 12:37:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:37:35.422296 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-d87b135c-884b-483f-983e-728f0818a493 admin admin] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:37:35.423431 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:37:35.423431 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: warnings.warn(msg) Dec 15 12:37:35.424982 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG oslo_concurrency.lockutils [None req-d87b135c-884b-483f-983e-728f0818a493 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:37:35.425419 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG oslo_concurrency.lockutils [None req-d87b135c-884b-483f-983e-728f0818a493 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:37:35.426242 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG oslo_concurrency.lockutils [None req-d87b135c-884b-483f-983e-728f0818a493 admin admin] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:37:35.426665 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG oslo_concurrency.lockutils [None req-d87b135c-884b-483f-983e-728f0818a493 admin admin] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:37:35.459292 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-d87b135c-884b-483f-983e-728f0818a493 admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.155163 Dec 15 12:37:35.459903 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 35/71] 10.222.0.76 () {60 vars in 1193 bytes} [Wed Dec 15 12:37:35 2021] GET /compute/v2.1/os-services => generated 791 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:37:37.012793 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-07f2310c-02fa-446e-a256-2872ad793b4f admin admin] Calling method '>' {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:37:37.013842 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-07f2310c-02fa-446e-a256-2872ad793b4f admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Dec 15 12:37:37.014238 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 37/72] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Dec 15 12:37:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:37:37.210834 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-9e808292-3da7-4706-8605-8a8b8f4a8adb admin admin] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:37:37.211997 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:37:37.211997 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: warnings.warn(msg) Dec 15 12:37:37.213592 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG oslo_concurrency.lockutils [None req-9e808292-3da7-4706-8605-8a8b8f4a8adb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:37:37.214114 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG oslo_concurrency.lockutils [None req-9e808292-3da7-4706-8605-8a8b8f4a8adb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:37:37.215020 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG oslo_concurrency.lockutils [None req-9e808292-3da7-4706-8605-8a8b8f4a8adb admin admin] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:37:37.215341 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG oslo_concurrency.lockutils [None req-9e808292-3da7-4706-8605-8a8b8f4a8adb admin admin] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:37:37.240516 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-9e808292-3da7-4706-8605-8a8b8f4a8adb admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084482 Dec 15 12:37:37.241087 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 36/73] 10.222.0.76 () {60 vars in 1193 bytes} [Wed Dec 15 12:37:37 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:37:49.226688 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-07f2310c-02fa-446e-a256-2872ad793b4f admin admin] Calling method '>' {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:37:49.227690 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-07f2310c-02fa-446e-a256-2872ad793b4f admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Dec 15 12:37:49.228092 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 38/74] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Dec 15 12:37:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:37:49.429198 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-e6d11d40-4f7a-4f95-846e-c1af1dbc733f admin admin] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:37:49.430396 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:37:49.430396 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: warnings.warn(msg) Dec 15 12:37:49.431959 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG oslo_concurrency.lockutils [None req-e6d11d40-4f7a-4f95-846e-c1af1dbc733f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:37:49.432402 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG oslo_concurrency.lockutils [None req-e6d11d40-4f7a-4f95-846e-c1af1dbc733f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:37:49.433259 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG oslo_concurrency.lockutils [None req-e6d11d40-4f7a-4f95-846e-c1af1dbc733f admin admin] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:37:49.433810 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG oslo_concurrency.lockutils [None req-e6d11d40-4f7a-4f95-846e-c1af1dbc733f admin admin] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:37:49.455212 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-e6d11d40-4f7a-4f95-846e-c1af1dbc733f admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079789 Dec 15 12:37:49.455765 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 37/75] 10.222.0.76 () {60 vars in 1193 bytes} [Wed Dec 15 12:37:49 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:37:51.004824 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: DEBUG nova.api.openstack.wsgi [None req-07f2310c-02fa-446e-a256-2872ad793b4f admin admin] Calling method '>' {{(pid=108408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:37:51.005847 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: INFO nova.api.openstack.requestlog [None req-07f2310c-02fa-446e-a256-2872ad793b4f admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Dec 15 12:37:51.006242 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: [pid: 108408|app: 0|req: 39/76] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Dec 15 12:37:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:37:51.215528 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG nova.api.openstack.wsgi [None req-b9e0c5c8-da21-4552-9de5-bcbc22bd25da admin admin] Calling method '>' {{(pid=108409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:37:51.216642 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:37:51.216642 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: warnings.warn(msg) Dec 15 12:37:51.218249 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG oslo_concurrency.lockutils [None req-b9e0c5c8-da21-4552-9de5-bcbc22bd25da admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:37:51.218691 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG oslo_concurrency.lockutils [None req-b9e0c5c8-da21-4552-9de5-bcbc22bd25da admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:37:51.219512 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG oslo_concurrency.lockutils [None req-b9e0c5c8-da21-4552-9de5-bcbc22bd25da admin admin] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:37:51.219941 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: DEBUG oslo_concurrency.lockutils [None req-b9e0c5c8-da21-4552-9de5-bcbc22bd25da admin admin] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:37:51.241932 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: INFO nova.api.openstack.requestlog [None req-b9e0c5c8-da21-4552-9de5-bcbc22bd25da admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086931 Dec 15 12:37:51.242507 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: [pid: 108409|app: 0|req: 38/77] 10.222.0.76 () {60 vars in 1193 bytes} [Wed Dec 15 12:37:51 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:38:51.939854 dv-cinder-813224-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 15 12:38:51.940398 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: Wed Dec 15 12:38:51 2021 - graceful shutdown triggered... Dec 15 12:38:51.940842 dv-cinder-813224-4-iscsi devstack@n-api.service[108409]: Gracefully killing worker 2 (pid: 108409)... Dec 15 12:38:51.941199 dv-cinder-813224-4-iscsi devstack@n-api.service[108408]: Gracefully killing worker 1 (pid: 108408)... Dec 15 12:38:52.941567 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: worker 1 buried after 1 seconds Dec 15 12:38:52.941567 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: worker 2 buried after 1 seconds Dec 15 12:38:52.941567 dv-cinder-813224-4-iscsi devstack@n-api.service[108407]: goodbye to uWSGI. Dec 15 12:38:52.943158 dv-cinder-813224-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 15 12:38:52.943791 dv-cinder-813224-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 15 12:38:52.947490 dv-cinder-813224-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 15 12:38:52.957579 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 15 12:38:52.959668 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 12:38:52 2021] *** Dec 15 12:38:52.959668 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 12:38:52.959668 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 12:38:52.959668 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: nodename: dv-cinder-813224-4-iscsi Dec 15 12:38:52.959668 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: machine: x86_64 Dec 15 12:38:52.959668 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: clock source: unix Dec 15 12:38:52.959668 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: pcre jit disabled Dec 15 12:38:52.959668 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: detected number of CPU cores: 4 Dec 15 12:38:52.959668 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: current working directory: / Dec 15 12:38:52.959668 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: detected binary path: /usr/bin/uwsgi-core Dec 15 12:38:52.960479 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: your processes number limit is 47680 Dec 15 12:38:52.960479 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: your memory page size is 4096 bytes Dec 15 12:38:52.960479 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: detected max file descriptor number: 2048 Dec 15 12:38:52.960479 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: lock engine: pthread robust mutexes Dec 15 12:38:52.960479 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: thunder lock: enabled Dec 15 12:38:52.960479 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 15 12:38:52.960479 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 12:38:53.006869 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: Python main interpreter initialized at 0x5618099b99c0 Dec 15 12:38:53.007110 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: python threads support enabled Dec 15 12:38:53.007255 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: your server socket listen backlog is limited to 100 connections Dec 15 12:38:53.007373 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: your mercy for graceful operations on workers is 90 seconds Dec 15 12:38:53.007824 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 12:38:53.008049 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: *** Operational MODE: preforking *** Dec 15 12:38:53.008480 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: *** uWSGI is running in multiple interpreter mode *** Dec 15 12:38:53.008612 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: spawned uWSGI master process (pid: 122596) Dec 15 12:38:53.008917 dv-cinder-813224-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 15 12:38:53.013556 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: spawned uWSGI worker 1 (pid: 122614, cores: 1) Dec 15 12:38:53.013556 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: spawned uWSGI worker 2 (pid: 122615, cores: 1) Dec 15 12:38:53.013556 dv-cinder-813224-4-iscsi devstack@n-api.service[122596]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 12:38:54.959739 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 12:38:54.959739 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: from cryptography.utils import int_from_bytes Dec 15 12:38:54.960436 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 12:38:54.960436 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: from cryptography.utils import int_from_bytes Dec 15 12:38:54.973731 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 12:38:54.973731 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: from cryptography.utils import int_from_bytes Dec 15 12:38:54.974302 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 12:38:54.974302 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: from cryptography.utils import int_from_bytes Dec 15 12:38:57.448010 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 12:38:57.448607 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 12:38:57.448784 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 12:38:57.449100 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 12:38:57.449356 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 12:38:57.449775 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.450105 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.450428 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.450749 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.451078 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.451390 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.451711 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.452030 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.452911 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.453245 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.453663 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.454008 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813224-4-iscsi {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.454331 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.454642 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.454953 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.455273 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.455578 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.455902 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.456210 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.456711 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.457163 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.457474 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.457809 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.458350 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.458527 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.458758 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.459077 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.459386 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.459714 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.460027 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.460429 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813224-4-iscsi {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.460751 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.461068 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.461384 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.461826 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.462142 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.462454 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.462839 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.463152 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.464238 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.464575 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.464903 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.465228 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.465704 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.465953 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.466179 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.466516 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.466817 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.467121 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.467429 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.467688 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.468743 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.469260 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.470695 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.470695 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.470695 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.470695 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.471596 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.471596 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.471596 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.472254 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.472254 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.472522 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.472670 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.472893 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.473210 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.473565 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.474073 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.474537 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.474867 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.475180 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.475504 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.475910 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.476165 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.476477 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.476824 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.476976 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 12:38:57.477416 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.477619 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 12:38:57.477759 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.477899 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 12:38:57.478034 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.478171 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 12:38:57.478311 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.478446 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 12:38:57.478586 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.478725 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.478860 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.478998 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.479142 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.479271 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.479407 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.479604 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.479829 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.480029 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.480179 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.480326 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.480476 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.480604 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.480742 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.480885 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.481029 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.481170 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.481307 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.481445 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.481624 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.481779 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.481919 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.482047 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.482233 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813224-4-iscsi {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.482367 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.482550 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.482684 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.482867 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.483020 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.483173 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.483320 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.483622 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.483792 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.483987 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.484139 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.484139 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.484755 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.485004 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.485145 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.485278 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.485409 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.485632 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.485838 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.485979 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.486122 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.486261 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.486396 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.486537 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.486690 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.486840 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.486977 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.487115 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.487245 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.487383 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.487519 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.487646 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.487646 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.487903 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.488368 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.488532 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.488670 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.488808 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.488952 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.489081 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813224-4-iscsi {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.489222 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.489351 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.489488 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.489672 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.489811 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.489950 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.490157 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.490157 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.490498 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.490664 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.490805 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.490933 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.491077 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.491210 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.491341 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.491480 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.491617 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.491744 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.491871 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.492007 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.492149 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.492287 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.492423 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.492558 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.492693 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.492855 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.493069 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.493208 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.493349 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.493478 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.493727 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.493871 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.494156 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.494289 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.494420 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.494570 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.495056 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.495202 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.495350 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.495508 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.495638 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.495767 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.495894 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.496038 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.496168 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.496297 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.496424 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.496562 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.496698 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.496838 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.496968 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.497107 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.497235 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.497373 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.497537 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.497685 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.497822 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.497960 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.498096 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.498223 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.498383 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.498573 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.498702 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.498835 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.498964 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.499121 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.499305 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.499461 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.499591 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.499591 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.499856 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.500035 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.500164 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.500383 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.500383 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.500709 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.500932 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.501123 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.501298 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.501485 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.501943 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.502119 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.502119 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.502470 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.502649 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.502819 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.503001 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.503259 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.503442 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.503633 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.503810 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.503992 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.504189 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.504459 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.504661 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.504884 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.505405 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.505630 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.505823 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.506000 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.506185 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.506361 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.506542 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.506720 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.506889 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.507056 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.507237 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.507415 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.507589 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.507777 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.507962 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.508136 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.508321 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.508506 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.508679 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.508856 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.509033 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.509223 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.509411 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.509770 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.509972 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.510146 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.510336 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.510540 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.510685 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.510821 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.510950 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.511094 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.511283 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.511283 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.511564 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.511703 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.511844 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.512033 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.512184 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.512327 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.512462 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.512592 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.512727 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.512858 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.512858 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.513112 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.513241 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.513384 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.513533 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.513673 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.513821 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.513949 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.514084 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.514215 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.515970 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.516168 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.516463 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.516697 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.516840 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.516992 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.517129 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.517258 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.517385 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.517536 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.517689 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.517689 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.517689 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.518086 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.518216 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.518355 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.518492 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.518630 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.518770 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.518907 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.519035 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.519188 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.519317 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.519462 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.519603 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.519819 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.520007 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.520206 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.520404 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.520549 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.520690 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.520690 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.520951 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.521087 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.521087 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.521369 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.521651 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.521840 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.521991 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.522122 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.522270 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.522270 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.522623 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.522763 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.522763 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.523642 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.523803 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.523803 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.524058 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.524226 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:38:57.524356 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.524485 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.524638 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.524772 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.524911 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.525046 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.525175 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.525304 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.525304 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.525583 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.525765 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.525941 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.526099 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.526245 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.526373 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.526512 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.526652 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.526790 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.526919 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.527058 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.527058 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.527316 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.527454 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.527709 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.527857 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.527998 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.528139 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.528281 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.528417 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.528557 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.528695 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.528841 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.528973 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.529112 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.529250 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.529390 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.529587 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.529749 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.529957 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.530143 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.530944 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.531250 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.531402 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.531534 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.531666 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.531804 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.531935 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.532068 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.532210 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.532348 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.532487 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.532626 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.532758 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.538531 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.538670 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.538746 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.538839 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.538924 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.539008 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.539106 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.539201 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.539295 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.539389 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.539484 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.539484 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.539662 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.539755 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.539849 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.539849 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.540096 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.540211 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.540332 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.540428 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.540551 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.540663 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.540763 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.540857 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.540962 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.541055 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.541137 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.541209 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.541286 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.541367 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.541491 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.541658 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.541744 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.541841 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.541954 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.542068 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.542156 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.542240 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.542319 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.542390 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.542460 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.542615 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.542690 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.542761 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.542831 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.542900 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.542969 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.543053 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.543125 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.543195 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.543271 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.543402 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.543543 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.543644 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.543775 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.543880 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.543986 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.544082 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.544188 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.544273 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.544403 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.544519 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.544616 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.544711 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.544810 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.545158 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.545261 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.545347 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.545431 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.545562 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.545651 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.545730 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.545810 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.545922 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.546001 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.546082 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.546162 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.546242 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.546322 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.546394 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.546470 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.546470 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.546615 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.546687 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.546687 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.546827 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.546827 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.546976 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.547061 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.547140 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.547219 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.547291 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.547366 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.547366 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.547507 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.547577 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.547645 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.547713 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.547789 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.547872 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.547943 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.548034 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.548140 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.548270 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.548456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.549763 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.549884 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.549962 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.550033 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.550102 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.550182 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.550253 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.550330 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.550408 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.550479 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.550555 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.550635 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.550713 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.550784 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.550909 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.550991 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.551222 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.551337 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.551532 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.551682 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.551841 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.551970 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.552190 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.552286 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.552503 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.552605 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.552808 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.552898 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.553132 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.553225 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.553455 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.553580 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.553963 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.554293 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.554621 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.554756 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.554943 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.555251 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.555357 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.555583 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.555687 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.555908 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.556008 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.556242 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.556343 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.556567 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.556667 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.556899 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.556999 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.557219 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.557319 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.557581 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.557679 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.557907 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.558000 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.558225 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.558315 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.558543 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.558643 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.558857 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.558957 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.559178 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.559278 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.559497 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.559590 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.559808 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.559906 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.560125 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.560227 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.560447 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.560546 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.560774 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.561054 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.561205 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.561389 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.562086 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.562408 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.562521 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.562736 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.562830 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.563063 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.563158 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.563386 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.563476 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.563719 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.563813 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.564041 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.564134 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.564361 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.564452 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.564674 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.564779 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.564991 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.565092 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.565305 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.565418 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.565635 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.565752 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.565954 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.566055 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.566264 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.566366 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.566574 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.566677 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.566884 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.566985 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.567199 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.567291 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.567507 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.567613 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.567817 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.567910 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.568148 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.568247 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.568465 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.568557 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.568781 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.568899 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.569085 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.569189 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.569394 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.569532 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.569742 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.569836 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.570061 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.570161 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.570375 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.570476 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.570681 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.570772 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.570998 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.571108 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.571297 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.571455 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.571608 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.571717 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.571933 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.572035 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.572264 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.572355 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.572587 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.572701 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.572917 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.573014 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.573227 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.573326 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.573593 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.573706 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.573890 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.573990 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.574205 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.574305 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.574515 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.574623 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.574835 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.575047 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.575150 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.575253 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.575450 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.575579 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.575803 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.575922 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.576785 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.576987 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.577187 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.577897 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.578128 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.578272 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.578416 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.578556 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.578556 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.578556 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.578956 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.579113 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.579346 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.579658 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.580061 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.580433 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.580828 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.581162 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.581483 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.581721 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.581830 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.582119 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.582221 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.582429 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.582632 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.582734 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.582993 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.583085 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.583338 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.583439 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.583650 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.583754 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.583967 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.584060 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.584282 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.584383 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.584591 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.584693 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.585037 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.585360 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.585721 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.586110 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.586350 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.586661 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.586971 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.587285 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.587614 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.587934 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.588242 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.588556 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.588864 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.589176 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.589589 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.589829 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.590174 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.590329 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.590459 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.590756 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.590900 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.591031 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.591183 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.591423 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.591621 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.591934 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.592213 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.592356 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.592537 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.592909 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.593128 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.593270 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.593618 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.593828 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.594006 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.594213 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.594371 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.594532 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.594856 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.595178 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.595311 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.595492 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.595750 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.595899 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.596102 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.596243 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.596419 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.596693 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.596836 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.597035 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.597215 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.597349 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.597668 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.597864 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.598177 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.598310 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.598545 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.598677 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.598867 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.599139 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.599273 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.599622 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.599776 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.599919 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.600118 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.600305 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.600436 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.600781 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.600940 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.601071 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.601236 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.601371 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.601692 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.601989 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.602187 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.602329 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.602667 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.602815 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.602944 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.603173 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.603305 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.603508 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.603676 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.603828 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.604131 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.604271 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.604436 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.604631 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.604770 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.605063 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.605193 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.605372 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.605635 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.605768 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.606004 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.606151 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.606368 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.606579 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.606721 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.607025 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.607171 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.607348 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.607532 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.607671 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.607956 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.608086 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.608273 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.608489 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.608690 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.608935 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.609073 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.609359 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.609498 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.609811 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.609957 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.610096 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.610604 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.610813 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.611112 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.611253 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.611393 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.611393 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.611662 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.611886 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.612022 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.612295 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.612437 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.612575 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.612815 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.612968 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.613108 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.613362 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.613616 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.613746 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.613991 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.614138 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.614440 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.614572 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.614767 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.614957 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.615098 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.615402 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.615535 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.615836 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.615993 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.616217 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.616358 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.616487 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.616691 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.616869 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.617001 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.617311 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.617450 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.617708 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.617887 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.618048 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.618296 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.618442 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.618684 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.618821 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.618997 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.619226 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.619357 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.619602 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.619748 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.620049 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.620182 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.620319 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.620536 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.620769 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.620908 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.621213 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.621346 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.621590 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.621726 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.622899 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.622899 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.622899 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.623358 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.623495 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.623495 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.623758 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.623894 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.624526 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.624660 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.624660 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.624911 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.625040 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.625176 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.625310 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.625440 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.625729 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.625881 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.626060 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.626282 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.626431 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.626659 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.628350 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.628498 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.628631 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.628760 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.628888 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.629016 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.629154 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.629283 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.629283 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.629589 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.629736 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.629736 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.630175 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.630318 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.630455 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.630591 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.630591 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.630841 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.630980 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.630980 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.631239 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.631369 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.631369 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.631625 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.631768 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.631898 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.632024 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.632159 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.632413 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.632672 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.632815 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.633057 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.633272 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.633412 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.633578 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.633720 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.634010 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.634142 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.634317 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.634505 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.634637 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.634917 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.635050 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.635222 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.635446 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.635589 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.635816 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.635958 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.636125 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.636430 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.636574 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.636777 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.637180 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.637581 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.637910 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.638185 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.638496 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.638804 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.639112 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.639417 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.640537 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.640716 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.641211 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.641645 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.641907 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.642250 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.642569 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.642896 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.643219 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.643541 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.643861 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.644190 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.644509 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.644937 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.645151 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.645394 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.645760 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.646108 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.646108 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.646399 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.646678 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.646845 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.646845 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.647364 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.647364 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.647364 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.647799 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.647954 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.648098 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.648248 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.648392 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.648536 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.648678 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.648862 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.649007 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.649149 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.649299 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.649484 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.649727 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.649874 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.650024 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.650176 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.650320 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.650483 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.650873 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.650873 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.651175 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.651330 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.651486 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.651486 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.651777 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.651930 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.652073 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.652215 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.652370 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.652515 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.652912 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.653225 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.653384 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.653691 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.653855 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.654007 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.654158 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.654322 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.654473 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.654634 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.654634 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.654922 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.655065 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.655207 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.655207 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.655529 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.655681 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.655681 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.655958 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.656120 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.656271 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.656271 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.656560 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.656813 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.656972 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.657124 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.657277 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.657430 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.657650 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.657806 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.657949 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.658103 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.658270 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.658498 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.658651 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.658796 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.658947 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.659097 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.659250 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.659402 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.659552 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.659701 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.659844 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.659995 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.660164 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.660314 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.660464 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.660627 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.660627 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.661252 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.661407 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.661582 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.661732 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.661882 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.662033 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.662204 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.663026 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.663184 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.663329 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.663482 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.663626 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.663888 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.664688 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.664846 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.664846 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.665118 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.665338 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.665494 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.665693 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.665848 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.665992 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.666134 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.666299 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.666444 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.666586 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.666729 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.666988 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.666988 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.666988 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.667415 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.667566 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.667716 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.667716 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.667998 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.668150 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.668301 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.668445 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.668586 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.668728 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.668869 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.669021 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.669172 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.669322 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.669492 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.669735 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.669965 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.670112 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.670255 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.670405 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.670625 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.670787 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.671879 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.672056 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.672212 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.672363 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.672508 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.672508 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.672808 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.672961 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.673283 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.673433 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.673660 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.673807 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.674083 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.674242 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.674387 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.674529 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.675367 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.675541 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.675696 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.675854 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.675998 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.676141 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.676291 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.676446 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.676446 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.676733 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.676879 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.677148 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.677308 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.677308 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.677627 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.677783 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.677944 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.678096 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.678246 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.678399 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.678542 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.678777 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.678777 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.679076 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.679228 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.679379 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.679528 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.679679 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.679822 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.679984 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.680142 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.680286 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.680427 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.680577 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.680735 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.680889 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.681043 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.681193 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.681336 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.681478 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.681657 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.681829 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.682192 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.682350 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.682495 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.682637 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.682788 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.682940 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.683096 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.683259 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.683505 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.683653 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.683796 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.683952 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.683952 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.684353 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.684497 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.684649 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.684792 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.684943 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.685087 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.685231 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.685394 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.685739 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.685901 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.686060 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.686204 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.686366 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.687061 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.687424 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.687599 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.687746 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.687985 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.688180 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.688180 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.688466 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.688628 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.688774 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.688918 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.689075 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.689229 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.689392 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.689561 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.689726 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.689882 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.689882 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.690175 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.690334 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.690481 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.690632 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.690802 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.690948 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.691103 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.691257 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.691409 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.691555 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.691698 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.691698 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.691987 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.692399 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.692568 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.692713 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.692887 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.693107 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.693272 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.693430 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.693756 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.693909 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.694054 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.694216 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.694488 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.694488 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.694781 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.694935 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.695079 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.695223 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.695384 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.695384 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.695682 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.695993 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.696154 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.696313 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.696458 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.696603 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.696755 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.696908 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.697062 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.697220 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.697385 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.697385 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.697838 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.697838 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.698122 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.698319 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.698467 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.698610 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.698753 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.698905 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.699057 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.699213 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.699358 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.699507 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.699670 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.699670 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.699955 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.700100 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.700243 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.700386 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.700529 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.700683 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.700848 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.700994 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.701142 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.701285 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.701428 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.701428 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.701761 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.701916 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.702062 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.702285 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.703162 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.703311 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.703311 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.703596 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.703767 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.704036 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.704189 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.704355 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.704620 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.704781 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.704926 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.705078 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.705231 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.705394 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.705560 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.705711 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.705855 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.706033 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.706335 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.706335 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.706735 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.706882 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.707026 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.707170 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.707322 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.707322 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.707611 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.707884 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.708035 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.708179 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.708333 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.708477 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.708620 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.708782 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.708927 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.709070 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.709227 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.709372 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.709372 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.709372 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.709877 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.710023 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.710176 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.710349 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.710610 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.710779 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.711000 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.711176 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.711334 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.711486 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.711639 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.711782 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.711926 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.712082 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.712227 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.712370 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.712514 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.712671 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.712831 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.713009 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.713371 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.713544 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.713696 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.716341 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.716599 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.716867 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.717035 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.717193 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.717340 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.717485 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.717773 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.718200 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.718364 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.718511 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.718664 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.718819 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.718974 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.719127 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.719271 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.719427 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.719571 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.719724 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 12:38:57.719883 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.719883 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.719883 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.719883 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.719883 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.719883 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.719883 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.719883 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.720983 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.720983 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.720983 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.720983 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.720983 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.720983 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.720983 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.720983 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.722153 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.722153 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.722153 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.722153 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.722153 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.722153 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.722153 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.722153 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.723283 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.723283 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.723283 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.723283 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.724052 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.724052 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.724332 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.724474 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.724749 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.725033 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.725364 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.725709 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.726274 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.727087 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.727266 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.727501 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.727959 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.728191 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.728472 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.728818 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.729125 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.729442 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.729824 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.730148 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.731264 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.731264 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.731972 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.732372 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.733316 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.733316 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.733316 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.734287 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.737551 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.737551 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.737551 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.737551 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.737551 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.737551 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.738029 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_db.sqlalchemy.engines [None req-0e9c9ae1-3fe7-49e2-9e5a-2eb22fdab2c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 12:38:57.738116 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.738116 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.738116 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.738425 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.738975 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.739323 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.739647 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.739977 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.742017 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.742017 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.742017 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.742017 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.742017 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.742017 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.743205 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.743205 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.743205 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.743634 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.743634 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.744332 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.744521 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.744917 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.745363 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.745741 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.746002 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.746325 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.746746 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.747053 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.747281 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.747607 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.747918 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.748284 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.748549 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.748871 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.749792 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.750139 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.750427 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.750749 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.751081 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.751447 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.752037 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.752369 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.752700 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.753029 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.753351 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.753711 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.754261 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.754434 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.754672 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.755054 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.755335 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.755651 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.756096 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.756423 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.756804 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.757161 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.757395 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.757757 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.758087 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.758411 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.758799 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.759054 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.759392 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.759740 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.760076 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.760412 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.760728 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.761043 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.761362 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.761706 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.762048 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.762389 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.762713 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.763046 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.763369 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.763701 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.764019 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.764369 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.764725 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.765581 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.765908 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.766251 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.766574 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.766915 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.767321 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.767585 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.767889 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.768209 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.768546 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.768917 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.769193 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.769554 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.769906 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.770220 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.770544 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.770868 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.771208 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.771536 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.771862 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.772186 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.772510 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.772837 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.773165 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.773551 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.773857 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.774194 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.774537 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.774883 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.775208 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.775564 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.775900 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.776221 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.776546 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.776935 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:38:57.777192 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 12:38:57.800333 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_db.sqlalchemy.engines [None req-9c35a3f8-c755-474b-8385-35eb2645a8c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 12:38:57.817255 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.context [None req-0e9c9ae1-3fe7-49e2-9e5a-2eb22fdab2c5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8bd32f78-c52f-42b9-874a-80fccc21ade4(cell1) {{(pid=122615) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 12:38:57.821585 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e9c9ae1-3fe7-49e2-9e5a-2eb22fdab2c5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:38:57.823165 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e9c9ae1-3fe7-49e2-9e5a-2eb22fdab2c5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:38:57.824002 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e9c9ae1-3fe7-49e2-9e5a-2eb22fdab2c5 None None] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:38:57.826021 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e9c9ae1-3fe7-49e2-9e5a-2eb22fdab2c5 None None] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:38:57.839510 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_db.sqlalchemy.engines [None req-0e9c9ae1-3fe7-49e2-9e5a-2eb22fdab2c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 12:38:57.840353 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_db.sqlalchemy.engines [None req-0e9c9ae1-3fe7-49e2-9e5a-2eb22fdab2c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 12:38:57.872784 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.context [None req-9c35a3f8-c755-474b-8385-35eb2645a8c7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8bd32f78-c52f-42b9-874a-80fccc21ade4(cell1) {{(pid=122614) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 12:38:57.878027 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9c35a3f8-c755-474b-8385-35eb2645a8c7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:38:57.879647 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9c35a3f8-c755-474b-8385-35eb2645a8c7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:38:57.880468 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9c35a3f8-c755-474b-8385-35eb2645a8c7 None None] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:38:57.882599 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9c35a3f8-c755-474b-8385-35eb2645a8c7 None None] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:38:57.895926 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_db.sqlalchemy.engines [None req-9c35a3f8-c755-474b-8385-35eb2645a8c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 12:38:57.898719 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_db.sqlalchemy.engines [None req-9c35a3f8-c755-474b-8385-35eb2645a8c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 12:38:58.008290 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_db.sqlalchemy.engines [None req-0e9c9ae1-3fe7-49e2-9e5a-2eb22fdab2c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 12:38:58.077318 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_db.sqlalchemy.engines [None req-9c35a3f8-c755-474b-8385-35eb2645a8c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 12:38:58.337919 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: WARNING keystonemiddleware.auth_token [None req-0e9c9ae1-3fe7-49e2-9e5a-2eb22fdab2c5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 12:38:58.344803 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: WARNING keystonemiddleware.auth_token [None req-0e9c9ae1-3fe7-49e2-9e5a-2eb22fdab2c5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 12:38:58.403063 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: WARNING keystonemiddleware.auth_token [None req-9c35a3f8-c755-474b-8385-35eb2645a8c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 12:38:58.409938 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: WARNING keystonemiddleware.auth_token [None req-9c35a3f8-c755-474b-8385-35eb2645a8c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 12:38:58.693468 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: WARNING keystonemiddleware.auth_token [None req-0e9c9ae1-3fe7-49e2-9e5a-2eb22fdab2c5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 12:38:58.698728 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: WARNING keystonemiddleware.auth_token [None req-0e9c9ae1-3fe7-49e2-9e5a-2eb22fdab2c5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 12:38:58.705201 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5618099b99c0 pid: 122615 (default app) Dec 15 12:38:58.760617 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: WARNING keystonemiddleware.auth_token [None req-9c35a3f8-c755-474b-8385-35eb2645a8c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 12:38:58.766487 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: WARNING keystonemiddleware.auth_token [None req-9c35a3f8-c755-474b-8385-35eb2645a8c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 12:38:58.771881 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5618099b99c0 pid: 122614 (default app) Dec 15 12:39:33.545634 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f017d402-5aca-437d-a3b6-a3268d29c3e7 tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] Action: 'create', calling method: .version_select at 0x7f3c6a899ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1255353186"}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:39:35.492085 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d90fef5d-3b0c-4449-9f31-f4161cfdccaa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-50647626", "imageRef": "d302555e-2bff-4492-b57d-d59c0097a278", "flavorRef": "452", "networks": [{"uuid": "9067fc36-c028-414f-82b9-4a3d3b202a5f"}]}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:39:35.725213 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f017d402-5aca-437d-a3b6-a3268d29c3e7 tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.394255 Dec 15 12:39:35.726214 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1/1] 10.222.0.76 () {60 vars in 1154 bytes} [Wed Dec 15 12:39:32 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 3397 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 15 12:39:35.891419 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-341ba6a3-1bc3-4521-a246-9a384a555138 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-53564883", "imageRef": "d302555e-2bff-4492-b57d-d59c0097a278", "flavorRef": "452", "networks": [{"uuid": "7c1aa862-8c14-4ea3-9df1-8737e9186880"}]}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:39:36.069891 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.network.neutron [None req-341ba6a3-1bc3-4521-a246-9a384a555138 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] validate_networks() for [('7c1aa862-8c14-4ea3-9df1-8737e9186880', None, None, None, None, None)] {{(pid=122615) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 12:39:36.144093 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.network.neutron [None req-d90fef5d-3b0c-4449-9f31-f4161cfdccaa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] validate_networks() for [('9067fc36-c028-414f-82b9-4a3d3b202a5f', None, None, None, None, None)] {{(pid=122614) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 12:39:37.907175 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-341ba6a3-1bc3-4521-a246-9a384a555138 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Flavor limits 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 12:39:37.908501 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-341ba6a3-1bc3-4521-a246-9a384a555138 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Image limits 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 12:39:37.908995 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-341ba6a3-1bc3-4521-a246-9a384a555138 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Flavor pref 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 12:39:37.909498 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-341ba6a3-1bc3-4521-a246-9a384a555138 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Image pref 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 12:39:37.909941 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-341ba6a3-1bc3-4521-a246-9a384a555138 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 12:39:37.943272 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-341ba6a3-1bc3-4521-a246-9a384a555138 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:37.944137 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-341ba6a3-1bc3-4521-a246-9a384a555138 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:37.945434 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-341ba6a3-1bc3-4521-a246-9a384a555138 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:37.945863 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-341ba6a3-1bc3-4521-a246-9a384a555138 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:37.981585 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-d90fef5d-3b0c-4449-9f31-f4161cfdccaa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Flavor limits 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 12:39:37.982233 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-d90fef5d-3b0c-4449-9f31-f4161cfdccaa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Image limits 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 12:39:37.984999 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-d90fef5d-3b0c-4449-9f31-f4161cfdccaa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Flavor pref 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 12:39:37.986412 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-d90fef5d-3b0c-4449-9f31-f4161cfdccaa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Image pref 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 12:39:37.987352 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-d90fef5d-3b0c-4449-9f31-f4161cfdccaa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 12:39:38.024980 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-341ba6a3-1bc3-4521-a246-9a384a555138 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Getting quotas for project 0d6c1a384856416191a1e503a7119f2a. Resources: {'instances', 'cores', 'ram'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 12:39:38.034322 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d90fef5d-3b0c-4449-9f31-f4161cfdccaa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:38.034766 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d90fef5d-3b0c-4449-9f31-f4161cfdccaa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:38.040058 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d90fef5d-3b0c-4449-9f31-f4161cfdccaa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:38.040802 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d90fef5d-3b0c-4449-9f31-f4161cfdccaa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:38.050331 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-341ba6a3-1bc3-4521-a246-9a384a555138 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Getting quotas for user 5742638c77e3499e8ffcdc51256345f2 and project 0d6c1a384856416191a1e503a7119f2a. Resources: {'instances', 'cores', 'ram'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 12:39:38.096651 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-341ba6a3-1bc3-4521-a246-9a384a555138 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Going to run 1 instances... {{(pid=122615) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 12:39:38.099535 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-341ba6a3-1bc3-4521-a246-9a384a555138 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d302555e-2bff-4492-b57d-d59c0097a278',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 12:39:38.131109 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-d90fef5d-3b0c-4449-9f31-f4161cfdccaa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Getting quotas for project c4b04b03b8f94235be29043cfb8198ce. Resources: {'instances', 'cores', 'ram'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 12:39:38.149254 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-d90fef5d-3b0c-4449-9f31-f4161cfdccaa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Getting quotas for user 20aef34cb7444687acf501f6aedca443 and project c4b04b03b8f94235be29043cfb8198ce. Resources: {'instances', 'cores', 'ram'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 12:39:38.171890 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d90fef5d-3b0c-4449-9f31-f4161cfdccaa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Going to run 1 instances... {{(pid=122614) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 12:39:38.174991 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d90fef5d-3b0c-4449-9f31-f4161cfdccaa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d302555e-2bff-4492-b57d-d59c0097a278',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 12:39:38.277434 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-341ba6a3-1bc3-4521-a246-9a384a555138 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.542009 Dec 15 12:39:38.281125 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 2/2] 10.222.0.76 () {60 vars in 1146 bytes} [Wed Dec 15 12:39:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 2554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 12:39:38.289789 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-259cab6f-2be3-4782-9269-0c6345a85346 tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] Calling method '.version_select at 0x7f3c6a690280>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:38.368972 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d90fef5d-3b0c-4449-9f31-f4161cfdccaa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.726374 Dec 15 12:39:38.377751 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1/3] 10.222.0.76 () {60 vars in 1146 bytes} [Wed Dec 15 12:39:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 3737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 12:39:38.398264 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5be37827-0c74-4ea6-bf6c-c846c7568349 tempest-VolumesTestJSON-233416256 tempest-VolumesTestJSON-233416256-project] Calling method '.version_select at 0x7f3c69ea1790>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:38.429790 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-259cab6f-2be3-4782-9269-0c6345a85346 tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/19f6cbcf-8340-4a6c-84ec-79f25b81936d" status: 200 len: 346 microversion: 2.1 time: 0.146744 Dec 15 12:39:38.430717 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 3/4] 10.222.0.76 () {58 vars in 1244 bytes} [Wed Dec 15 12:39:38 2021] GET /compute/v2.1/os-volumes/19f6cbcf-8340-4a6c-84ec-79f25b81936d => generated 346 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:39:38.442329 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-80f929e4-0ed1-4823-8865-485e72b5037f tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:38.443557 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-80f929e4-0ed1-4823-8865-485e72b5037f tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:38.574138 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5be37827-0c74-4ea6-bf6c-c846c7568349 tempest-VolumesTestJSON-233416256 tempest-VolumesTestJSON-233416256-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/672fcde6-3dd9-4445-a11d-3d2c87f65e98" status: 200 len: 351 microversion: 2.1 time: 0.194573 Dec 15 12:39:38.574946 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 2/5] 10.222.0.76 () {58 vars in 1244 bytes} [Wed Dec 15 12:39:38 2021] GET /compute/v2.1/os-volumes/672fcde6-3dd9-4445-a11d-3d2c87f65e98 => generated 351 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:39:38.580935 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b79eeed7-3a90-48a9-9b9e-a942ad2466e0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:38.593971 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b79eeed7-3a90-48a9-9b9e-a942ad2466e0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:38.763326 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b79eeed7-3a90-48a9-9b9e-a942ad2466e0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:38.781661 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-80f929e4-0ed1-4823-8865-485e72b5037f tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:38.806153 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b79eeed7-3a90-48a9-9b9e-a942ad2466e0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1216 microversion: 2.1 time: 0.229947 Dec 15 12:39:38.810072 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 3/6] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:38 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1216 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:38.813153 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-80f929e4-0ed1-4823-8865-485e72b5037f tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1213 microversion: 2.1 time: 0.377867 Dec 15 12:39:38.818333 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 4/7] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:38 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1213 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:38.821686 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2e6f7bb8-5a23-4d4d-917b-97043c9ac73e tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] Action: 'create', calling method: .version_select at 0x7f3c6962eb80>, body: {"snapshot": {"volume_id": "19f6cbcf-8340-4a6c-84ec-79f25b81936d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1589610526"}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:39:39.827636 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4798bf89-c972-47fe-a960-9e41e0532456 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:39.828265 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4798bf89-c972-47fe-a960-9e41e0532456 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:39.836726 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2e6f7bb8-5a23-4d4d-917b-97043c9ac73e tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] 10.222.0.76 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.023966 Dec 15 12:39:39.837218 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 4/8] 10.222.0.76 () {60 vars in 1161 bytes} [Wed Dec 15 12:39:38 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:39:39.849268 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-eb1da216-6034-47b0-a9c5-e5757607d499 tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] Calling method '.version_select at 0x7f3c69638e50>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:40.118599 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-eb1da216-6034-47b0-a9c5-e5757607d499 tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/437cd836-d5ff-42a5-b23d-be9ec578b912" status: 200 len: 287 microversion: 2.1 time: 0.272580 Dec 15 12:39:40.122353 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 5/9] 10.222.0.76 () {58 vars in 1250 bytes} [Wed Dec 15 12:39:39 2021] GET /compute/v2.1/os-snapshots/437cd836-d5ff-42a5-b23d-be9ec578b912 => generated 287 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:39:40.129291 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a2d14dba-efc1-4919-8476-7cbfcbd2e96c tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:40.138121 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a2d14dba-efc1-4919-8476-7cbfcbd2e96c tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:40.340579 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4798bf89-c972-47fe-a960-9e41e0532456 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:40.347656 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4798bf89-c972-47fe-a960-9e41e0532456 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1216 microversion: 2.1 time: 0.524298 Dec 15 12:39:40.351617 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 5/10] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:39 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1216 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:40.374685 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0d1dc2e9-47e9-4ed3-ab89-c0dc1a968226 tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] Calling method '.version_select at 0x7f3c6a690b80>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:40.501662 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0d1dc2e9-47e9-4ed3-ab89-c0dc1a968226 tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.148646 Dec 15 12:39:40.508000 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 6/11] 10.222.0.76 () {58 vars in 1139 bytes} [Wed Dec 15 12:39:40 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:39:40.525124 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-098bbed3-f38a-42c4-9ac0-2bcff2d922a4 tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] Calling method '.version_select at 0x7f3c69e4d160>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:40.585030 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a2d14dba-efc1-4919-8476-7cbfcbd2e96c tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:40.597055 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a2d14dba-efc1-4919-8476-7cbfcbd2e96c tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1213 microversion: 2.1 time: 0.472347 Dec 15 12:39:40.599708 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 6/12] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:40 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1213 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:40.613930 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-098bbed3-f38a-42c4-9ac0-2bcff2d922a4 tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/437cd836-d5ff-42a5-b23d-be9ec578b912" status: 200 len: 287 microversion: 2.1 time: 0.104386 Dec 15 12:39:40.615049 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 7/13] 10.222.0.76 () {58 vars in 1250 bytes} [Wed Dec 15 12:39:40 2021] GET /compute/v2.1/os-snapshots/437cd836-d5ff-42a5-b23d-be9ec578b912 => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:39:41.021227 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-16838a6b-8306-4df3-afa7-f75d111311a6 tempest-VolumesTestJSON-233416256 tempest-VolumesTestJSON-233416256-project] Calling method '.version_select at 0x7f3c6961d0d0>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:41.114342 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-16838a6b-8306-4df3-afa7-f75d111311a6 tempest-VolumesTestJSON-233416256 tempest-VolumesTestJSON-233416256-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/b8ab61fb-c3e0-4bf8-b603-80f046da2c2a" status: 200 len: 350 microversion: 2.1 time: 0.101309 Dec 15 12:39:41.115096 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 7/14] 10.222.0.76 () {58 vars in 1244 bytes} [Wed Dec 15 12:39:41 2021] GET /compute/v2.1/os-volumes/b8ab61fb-c3e0-4bf8-b603-80f046da2c2a => generated 350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:39:41.367399 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-86a3a964-4943-4d4c-9e44-03e98d59d574 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:41.368163 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-86a3a964-4943-4d4c-9e44-03e98d59d574 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:41.384793 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-86a3a964-4943-4d4c-9e44-03e98d59d574 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:41.385664 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-86a3a964-4943-4d4c-9e44-03e98d59d574 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:41.386458 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-86a3a964-4943-4d4c-9e44-03e98d59d574 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:41.389696 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-86a3a964-4943-4d4c-9e44-03e98d59d574 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:41.630783 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-871aa2e8-633e-4db9-a5d4-896d0625c439 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:41.630783 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-871aa2e8-633e-4db9-a5d4-896d0625c439 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:41.633641 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-871aa2e8-633e-4db9-a5d4-896d0625c439 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:41.634107 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-871aa2e8-633e-4db9-a5d4-896d0625c439 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:41.638684 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-871aa2e8-633e-4db9-a5d4-896d0625c439 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:41.639143 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-871aa2e8-633e-4db9-a5d4-896d0625c439 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:41.869888 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-86a3a964-4943-4d4c-9e44-03e98d59d574 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:41.907855 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-86a3a964-4943-4d4c-9e44-03e98d59d574 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1220 microversion: 2.1 time: 0.546918 Dec 15 12:39:41.911288 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 8/15] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:41 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1220 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:41.928787 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-82f5cc30-c991-407c-951d-cc73e67d43ef tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] Calling method '.version_select at 0x7f3c695ca280>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:42.027791 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-82f5cc30-c991-407c-951d-cc73e67d43ef tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/437cd836-d5ff-42a5-b23d-be9ec578b912" status: 200 len: 287 microversion: 2.1 time: 0.114599 Dec 15 12:39:42.028804 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 9/16] 10.222.0.76 () {58 vars in 1250 bytes} [Wed Dec 15 12:39:41 2021] GET /compute/v2.1/os-snapshots/437cd836-d5ff-42a5-b23d-be9ec578b912 => generated 287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:39:42.187182 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-871aa2e8-633e-4db9-a5d4-896d0625c439 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:42.204007 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-871aa2e8-633e-4db9-a5d4-896d0625c439 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1217 microversion: 2.1 time: 0.590982 Dec 15 12:39:42.205788 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 8/17] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:41 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1217 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:42.928279 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4e8c60cf-6306-4561-807c-d62161830eba tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:42.929587 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4e8c60cf-6306-4561-807c-d62161830eba tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:42.941038 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e8c60cf-6306-4561-807c-d62161830eba tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:42.941718 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e8c60cf-6306-4561-807c-d62161830eba tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:42.942540 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e8c60cf-6306-4561-807c-d62161830eba tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:42.942977 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e8c60cf-6306-4561-807c-d62161830eba tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:43.034080 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4e8c60cf-6306-4561-807c-d62161830eba tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:43.041291 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-01fad8bc-2d4c-47d1-bdbb-e888f5d1283a tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] Calling method '.version_select at 0x7f3c695c7940>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:43.048694 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4e8c60cf-6306-4561-807c-d62161830eba tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1220 microversion: 2.1 time: 0.124054 Dec 15 12:39:43.049918 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 10/18] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:42 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1220 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:43.095113 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-01fad8bc-2d4c-47d1-bdbb-e888f5d1283a tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/437cd836-d5ff-42a5-b23d-be9ec578b912" status: 200 len: 287 microversion: 2.1 time: 0.058573 Dec 15 12:39:43.095983 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 9/19] 10.222.0.76 () {58 vars in 1250 bytes} [Wed Dec 15 12:39:43 2021] GET /compute/v2.1/os-snapshots/437cd836-d5ff-42a5-b23d-be9ec578b912 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:39:43.222710 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5095d2b9-f1a8-4224-9d1f-863122d9adaa tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:43.223337 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5095d2b9-f1a8-4224-9d1f-863122d9adaa tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:43.232593 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5095d2b9-f1a8-4224-9d1f-863122d9adaa tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:43.233053 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5095d2b9-f1a8-4224-9d1f-863122d9adaa tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:43.236494 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5095d2b9-f1a8-4224-9d1f-863122d9adaa tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:43.237151 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5095d2b9-f1a8-4224-9d1f-863122d9adaa tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:43.430554 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5095d2b9-f1a8-4224-9d1f-863122d9adaa tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:43.443227 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5095d2b9-f1a8-4224-9d1f-863122d9adaa tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1217 microversion: 2.1 time: 0.224554 Dec 15 12:39:43.443820 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 11/20] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:43 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1217 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:44.020579 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bb66be49-2114-4c55-b5bc-4dec910c18fc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'create', calling method: .version_select at 0x7f3c6a8ce820>, body: {"keypair": {"name": "tempest-keypair-569722076"}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:39:44.052481 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-bb66be49-2114-4c55-b5bc-4dec910c18fc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Getting quotas for project 0465053a5542468dad24b48ad38f5430. Resources: {'key_pairs'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 12:39:44.058760 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-bb66be49-2114-4c55-b5bc-4dec910c18fc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Getting quotas for user d8dfa6af1a5a4bfcab0eab3ea87226b8 and project 0465053a5542468dad24b48ad38f5430. Resources: {'key_pairs'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 12:39:44.067193 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8dda908e-4f26-4b1b-9a2b-2a6cae2ccbaf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:44.067845 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8dda908e-4f26-4b1b-9a2b-2a6cae2ccbaf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:44.078573 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8dda908e-4f26-4b1b-9a2b-2a6cae2ccbaf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:44.081305 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8dda908e-4f26-4b1b-9a2b-2a6cae2ccbaf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:44.086672 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8dda908e-4f26-4b1b-9a2b-2a6cae2ccbaf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:44.087625 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8dda908e-4f26-4b1b-9a2b-2a6cae2ccbaf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:44.287847 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8dda908e-4f26-4b1b-9a2b-2a6cae2ccbaf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:44.302087 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8dda908e-4f26-4b1b-9a2b-2a6cae2ccbaf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1268 microversion: 2.1 time: 0.239115 Dec 15 12:39:44.303222 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 12/21] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:44 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1268 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:44.317094 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-854b7704-3edb-46e9-a98b-650de3d9dfbc tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] Calling method '.version_select at 0x7f3c6958ddc0>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:44.363290 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-854b7704-3edb-46e9-a98b-650de3d9dfbc tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/437cd836-d5ff-42a5-b23d-be9ec578b912" status: 200 len: 288 microversion: 2.1 time: 0.058761 Dec 15 12:39:44.364518 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 13/22] 10.222.0.76 () {58 vars in 1250 bytes} [Wed Dec 15 12:39:44 2021] GET /compute/v2.1/os-snapshots/437cd836-d5ff-42a5-b23d-be9ec578b912 => generated 288 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:39:44.375955 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-51ecedc8-9f01-451d-97ef-0716bfdceb7e tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] Calling method '.version_select at 0x7f3c6951c4c0>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:44.412400 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-bb66be49-2114-4c55-b5bc-4dec910c18fc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Getting quotas for project 0465053a5542468dad24b48ad38f5430. Resources: {'key_pairs'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 12:39:44.417979 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-bb66be49-2114-4c55-b5bc-4dec910c18fc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Getting quotas for user d8dfa6af1a5a4bfcab0eab3ea87226b8 and project 0465053a5542468dad24b48ad38f5430. Resources: {'key_pairs'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 12:39:44.461767 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-51ecedc8-9f01-451d-97ef-0716bfdceb7e tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] 10.222.0.76 "DELETE /compute/v2.1/os-snapshots/437cd836-d5ff-42a5-b23d-be9ec578b912" status: 202 len: 0 microversion: 2.1 time: 0.091211 Dec 15 12:39:44.462621 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 14/23] 10.222.0.76 () {58 vars in 1253 bytes} [Wed Dec 15 12:39:44 2021] DELETE /compute/v2.1/os-snapshots/437cd836-d5ff-42a5-b23d-be9ec578b912 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 12:39:44.463159 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bb66be49-2114-4c55-b5bc-4dec910c18fc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.839463 Dec 15 12:39:44.466547 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 10/24] 10.222.0.76 () {62 vars in 1198 bytes} [Wed Dec 15 12:39:43 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 845 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Dec 15 12:39:44.468821 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5cb1cea7-a3a6-44bb-9fce-0d6ac5acc319 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:44.469542 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5cb1cea7-a3a6-44bb-9fce-0d6ac5acc319 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:44.471665 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c904764e-5812-45a0-999a-8c43c806f825 tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] Calling method '.version_select at 0x7f3c695c7af0>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:44.486202 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5cb1cea7-a3a6-44bb-9fce-0d6ac5acc319 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:44.486748 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5cb1cea7-a3a6-44bb-9fce-0d6ac5acc319 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:44.488306 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5cb1cea7-a3a6-44bb-9fce-0d6ac5acc319 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:44.491295 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5cb1cea7-a3a6-44bb-9fce-0d6ac5acc319 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:44.545047 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c904764e-5812-45a0-999a-8c43c806f825 tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/437cd836-d5ff-42a5-b23d-be9ec578b912" status: 200 len: 287 microversion: 2.1 time: 0.076734 Dec 15 12:39:44.546487 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 11/25] 10.222.0.76 () {58 vars in 1250 bytes} [Wed Dec 15 12:39:44 2021] GET /compute/v2.1/os-snapshots/437cd836-d5ff-42a5-b23d-be9ec578b912 => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:39:44.608383 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5cb1cea7-a3a6-44bb-9fce-0d6ac5acc319 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:44.624647 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5cb1cea7-a3a6-44bb-9fce-0d6ac5acc319 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1209 microversion: 2.1 time: 0.158847 Dec 15 12:39:44.627399 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 15/26] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:44 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1209 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:45.199551 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-15a65cd3-1ace-4469-910f-402461ff3c7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-303928644", "imageRef": "d302555e-2bff-4492-b57d-d59c0097a278", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "76ae3daa-fc52-4f5a-883d-de7a67ea8f1e"}]}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:39:45.320644 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e48fe4d6-da3e-4771-aac4-c60b0dc7d59b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:45.321124 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e48fe4d6-da3e-4771-aac4-c60b0dc7d59b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:45.336447 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.network.neutron [None req-15a65cd3-1ace-4469-910f-402461ff3c7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] validate_networks() for [('76ae3daa-fc52-4f5a-883d-de7a67ea8f1e', None, None, None, None, None)] {{(pid=122614) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 12:39:45.347182 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e48fe4d6-da3e-4771-aac4-c60b0dc7d59b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:45.348296 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e48fe4d6-da3e-4771-aac4-c60b0dc7d59b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:45.349384 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e48fe4d6-da3e-4771-aac4-c60b0dc7d59b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:45.350120 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e48fe4d6-da3e-4771-aac4-c60b0dc7d59b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:45.616696 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e48fe4d6-da3e-4771-aac4-c60b0dc7d59b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:45.625238 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e48fe4d6-da3e-4771-aac4-c60b0dc7d59b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1268 microversion: 2.1 time: 0.309207 Dec 15 12:39:45.625956 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 16/27] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:45 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1268 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:45.636727 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5465b863-f63e-4bd4-99de-02fcb60370b6 tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] Calling method '.version_select at 0x7f3c69560040>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:45.697255 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5465b863-f63e-4bd4-99de-02fcb60370b6 tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/437cd836-d5ff-42a5-b23d-be9ec578b912" status: 200 len: 287 microversion: 2.1 time: 0.061872 Dec 15 12:39:45.698234 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 17/28] 10.222.0.76 () {58 vars in 1250 bytes} [Wed Dec 15 12:39:45 2021] GET /compute/v2.1/os-snapshots/437cd836-d5ff-42a5-b23d-be9ec578b912 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:39:45.706858 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bb71afc1-31d5-4479-8c74-c022a8df9209 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:45.707501 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bb71afc1-31d5-4479-8c74-c022a8df9209 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:45.713927 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bb71afc1-31d5-4479-8c74-c022a8df9209 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:45.715362 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bb71afc1-31d5-4479-8c74-c022a8df9209 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:45.716608 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bb71afc1-31d5-4479-8c74-c022a8df9209 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:45.718098 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bb71afc1-31d5-4479-8c74-c022a8df9209 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:45.858014 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bb71afc1-31d5-4479-8c74-c022a8df9209 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:45.868893 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bb71afc1-31d5-4479-8c74-c022a8df9209 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1209 microversion: 2.1 time: 0.166988 Dec 15 12:39:45.869711 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 18/29] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:45 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1209 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:46.031373 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-15a65cd3-1ace-4469-910f-402461ff3c7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Flavor limits 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 12:39:46.031799 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-15a65cd3-1ace-4469-910f-402461ff3c7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Image limits 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 12:39:46.032275 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-15a65cd3-1ace-4469-910f-402461ff3c7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Flavor pref 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 12:39:46.032688 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-15a65cd3-1ace-4469-910f-402461ff3c7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Image pref 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 12:39:46.033106 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-15a65cd3-1ace-4469-910f-402461ff3c7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 12:39:46.041467 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-15a65cd3-1ace-4469-910f-402461ff3c7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:46.041943 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-15a65cd3-1ace-4469-910f-402461ff3c7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:46.042751 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-15a65cd3-1ace-4469-910f-402461ff3c7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:46.043187 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-15a65cd3-1ace-4469-910f-402461ff3c7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:46.062935 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-15a65cd3-1ace-4469-910f-402461ff3c7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Getting quotas for project d05491d815914935aff3735da7c30031. Resources: {'instances', 'cores', 'ram'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 12:39:46.073781 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-15a65cd3-1ace-4469-910f-402461ff3c7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Getting quotas for user 97b484644498409ca36d9bb7e0f8554f and project d05491d815914935aff3735da7c30031. Resources: {'instances', 'cores', 'ram'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 12:39:46.096132 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-15a65cd3-1ace-4469-910f-402461ff3c7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Going to run 1 instances... {{(pid=122614) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 12:39:46.098593 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-15a65cd3-1ace-4469-910f-402461ff3c7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d302555e-2bff-4492-b57d-d59c0097a278',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 12:39:46.202271 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-15a65cd3-1ace-4469-910f-402461ff3c7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.193612 Dec 15 12:39:46.207059 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 12/30] 10.222.0.76 () {60 vars in 1146 bytes} [Wed Dec 15 12:39:45 2021] POST /compute/v2.1/servers => generated 383 bytes in 1199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 12:39:46.217935 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-56846e7f-9080-4964-b98b-5c5e8acdb7e5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:46.218889 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-56846e7f-9080-4964-b98b-5c5e8acdb7e5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:46.310978 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-56846e7f-9080-4964-b98b-5c5e8acdb7e5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:46.327693 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-56846e7f-9080-4964-b98b-5c5e8acdb7e5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1221 microversion: 2.1 time: 0.111077 Dec 15 12:39:46.328278 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 19/31] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:46 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1221 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:46.397207 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-21abb3cf-c734-47dc-ad00-46b864538ec7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1584022517", "imageRef": "d302555e-2bff-4492-b57d-d59c0097a278", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "76ae3daa-fc52-4f5a-883d-de7a67ea8f1e"}]}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:39:46.515081 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.network.neutron [None req-21abb3cf-c734-47dc-ad00-46b864538ec7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] validate_networks() for [('76ae3daa-fc52-4f5a-883d-de7a67ea8f1e', None, None, None, None, None)] {{(pid=122614) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 12:39:46.643130 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-51ff92ef-3869-45b6-a91f-34f080d11245 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:46.648281 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-51ff92ef-3869-45b6-a91f-34f080d11245 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:46.672876 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-51ff92ef-3869-45b6-a91f-34f080d11245 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:46.674147 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-51ff92ef-3869-45b6-a91f-34f080d11245 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:46.675233 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-51ff92ef-3869-45b6-a91f-34f080d11245 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:46.676665 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-51ff92ef-3869-45b6-a91f-34f080d11245 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:46.975135 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-51ff92ef-3869-45b6-a91f-34f080d11245 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:46.989643 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-51ff92ef-3869-45b6-a91f-34f080d11245 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1268 microversion: 2.1 time: 0.350561 Dec 15 12:39:46.990591 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 20/32] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:46 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1268 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:39:46.995542 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-73465836-06f7-434f-b9f4-38bb3feedaa4 tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] Calling method '.version_select at 0x7f3c69e4ddc0>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:47.050664 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-73465836-06f7-434f-b9f4-38bb3feedaa4 tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/437cd836-d5ff-42a5-b23d-be9ec578b912" status: 200 len: 287 microversion: 2.1 time: 0.058826 Dec 15 12:39:47.051239 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 21/33] 10.222.0.76 () {58 vars in 1250 bytes} [Wed Dec 15 12:39:46 2021] GET /compute/v2.1/os-snapshots/437cd836-d5ff-42a5-b23d-be9ec578b912 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:39:47.059709 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e643b354-8764-4ab4-bf8f-4662b408cef9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1210173019", "imageRef": "d302555e-2bff-4492-b57d-d59c0097a278", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea8b0c06-630c-43f7-b272-a4f1ec2cec2a"}], "security_groups": [{"name": "tempest-securitygroup--1825829819"}], "key_name": "tempest-keypair-569722076", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:39:47.364624 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.network.neutron [None req-e643b354-8764-4ab4-bf8f-4662b408cef9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] validate_networks() for [('ea8b0c06-630c-43f7-b272-a4f1ec2cec2a', None, None, None, None, None)] {{(pid=122615) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 12:39:47.805183 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-21abb3cf-c734-47dc-ad00-46b864538ec7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Flavor limits 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 12:39:47.805744 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-21abb3cf-c734-47dc-ad00-46b864538ec7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Image limits 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 12:39:47.806222 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-21abb3cf-c734-47dc-ad00-46b864538ec7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Flavor pref 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 12:39:47.806633 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-21abb3cf-c734-47dc-ad00-46b864538ec7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Image pref 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 12:39:47.807046 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-21abb3cf-c734-47dc-ad00-46b864538ec7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 12:39:47.838488 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-21abb3cf-c734-47dc-ad00-46b864538ec7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:47.839184 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-21abb3cf-c734-47dc-ad00-46b864538ec7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:47.840177 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-21abb3cf-c734-47dc-ad00-46b864538ec7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:47.842480 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-21abb3cf-c734-47dc-ad00-46b864538ec7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:47.930394 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-21abb3cf-c734-47dc-ad00-46b864538ec7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Getting quotas for project d05491d815914935aff3735da7c30031. Resources: {'instances', 'cores', 'ram'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 12:39:47.958548 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-21abb3cf-c734-47dc-ad00-46b864538ec7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Getting quotas for user 97b484644498409ca36d9bb7e0f8554f and project d05491d815914935aff3735da7c30031. Resources: {'instances', 'cores', 'ram'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 12:39:47.998710 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-21abb3cf-c734-47dc-ad00-46b864538ec7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Going to run 1 instances... {{(pid=122614) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 12:39:48.006146 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-21abb3cf-c734-47dc-ad00-46b864538ec7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d302555e-2bff-4492-b57d-d59c0097a278',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 12:39:48.097301 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-21abb3cf-c734-47dc-ad00-46b864538ec7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.704783 Dec 15 12:39:48.103354 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 13/34] 10.222.0.76 () {60 vars in 1146 bytes} [Wed Dec 15 12:39:46 2021] POST /compute/v2.1/servers => generated 383 bytes in 1711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 12:39:48.114104 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d58c122d-eedf-4369-8506-cfce9b2a003e tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:48.118380 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d58c122d-eedf-4369-8506-cfce9b2a003e tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:48.139775 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d58c122d-eedf-4369-8506-cfce9b2a003e tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:48.141062 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d58c122d-eedf-4369-8506-cfce9b2a003e tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:48.142625 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d58c122d-eedf-4369-8506-cfce9b2a003e tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:48.145315 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d58c122d-eedf-4369-8506-cfce9b2a003e tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:48.353448 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-e643b354-8764-4ab4-bf8f-4662b408cef9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Flavor limits 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 12:39:48.354117 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-e643b354-8764-4ab4-bf8f-4662b408cef9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Image limits 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 12:39:48.354740 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-e643b354-8764-4ab4-bf8f-4662b408cef9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Flavor pref 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 12:39:48.355426 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-e643b354-8764-4ab4-bf8f-4662b408cef9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Image pref 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 12:39:48.356046 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-e643b354-8764-4ab4-bf8f-4662b408cef9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 12:39:48.383343 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e643b354-8764-4ab4-bf8f-4662b408cef9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:48.383845 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e643b354-8764-4ab4-bf8f-4662b408cef9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:48.384599 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e643b354-8764-4ab4-bf8f-4662b408cef9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:48.394198 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e643b354-8764-4ab4-bf8f-4662b408cef9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:48.469373 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-e643b354-8764-4ab4-bf8f-4662b408cef9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Getting quotas for project 0465053a5542468dad24b48ad38f5430. Resources: {'instances', 'cores', 'ram'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 12:39:48.476536 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-e643b354-8764-4ab4-bf8f-4662b408cef9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Getting quotas for user d8dfa6af1a5a4bfcab0eab3ea87226b8 and project 0465053a5542468dad24b48ad38f5430. Resources: {'instances', 'cores', 'ram'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 12:39:48.476834 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d58c122d-eedf-4369-8506-cfce9b2a003e tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:48.484891 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d58c122d-eedf-4369-8506-cfce9b2a003e tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1273 microversion: 2.1 time: 0.379725 Dec 15 12:39:48.485484 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 14/35] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:48 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1273 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:48.500917 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ef54b480-747f-44c7-842f-91655031fddb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:48.501565 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ef54b480-747f-44c7-842f-91655031fddb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:48.506929 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e643b354-8764-4ab4-bf8f-4662b408cef9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Going to run 1 instances... {{(pid=122615) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 12:39:48.509479 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e643b354-8764-4ab4-bf8f-4662b408cef9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d302555e-2bff-4492-b57d-d59c0097a278',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 12:39:48.531692 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ef54b480-747f-44c7-842f-91655031fddb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:48.535520 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ef54b480-747f-44c7-842f-91655031fddb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:48.556156 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ef54b480-747f-44c7-842f-91655031fddb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:48.556156 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ef54b480-747f-44c7-842f-91655031fddb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:48.662799 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e643b354-8764-4ab4-bf8f-4662b408cef9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.607514 Dec 15 12:39:48.669355 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 22/36] 10.222.0.76 () {62 vars in 1187 bytes} [Wed Dec 15 12:39:47 2021] POST /compute/v2.1/servers => generated 402 bytes in 1616 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 15 12:39:48.697414 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-962338c4-c4a7-4632-b372-c922b1b419af tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] Calling method '.version_select at 0x7f3c695603a0>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:48.941147 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ef54b480-747f-44c7-842f-91655031fddb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:48.954449 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ef54b480-747f-44c7-842f-91655031fddb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1274 microversion: 2.1 time: 0.467851 Dec 15 12:39:48.958876 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 15/37] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:48 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1274 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:48.984036 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-cd8555a1-f5c3-473b-9766-0f0b06af0206 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:48.984642 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-cd8555a1-f5c3-473b-9766-0f0b06af0206 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:49.006193 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.wsgi [None req-962338c4-c4a7-4632-b372-c922b1b419af tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] HTTP exception thrown: Snapshot 437cd836-d5ff-42a5-b23d-be9ec578b912 could not be found. Dec 15 12:39:49.006991 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-962338c4-c4a7-4632-b372-c922b1b419af tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] Returning 404 to user: Snapshot 437cd836-d5ff-42a5-b23d-be9ec578b912 could not be found. {{(pid=122615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:39:49.007963 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-962338c4-c4a7-4632-b372-c922b1b419af tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/437cd836-d5ff-42a5-b23d-be9ec578b912" status: 404 len: 111 microversion: 2.1 time: 0.335944 Dec 15 12:39:49.009371 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 23/38] 10.222.0.76 () {58 vars in 1250 bytes} [Wed Dec 15 12:39:48 2021] GET /compute/v2.1/os-snapshots/437cd836-d5ff-42a5-b23d-be9ec578b912 => generated 111 bytes in 338 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 12:39:49.037580 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5b177638-146d-4afb-86e2-c76acf1ab3a8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:49.042820 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5b177638-146d-4afb-86e2-c76acf1ab3a8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:49.199470 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-cd8555a1-f5c3-473b-9766-0f0b06af0206 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:49.210151 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-cd8555a1-f5c3-473b-9766-0f0b06af0206 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1222 microversion: 2.1 time: 0.250149 Dec 15 12:39:49.215220 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 16/39] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:48 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1222 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:49.238895 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e8368e82-be2c-4b09-bd77-99a1e6bf8dfd tempest-VolumesTestJSON-233416256 tempest-VolumesTestJSON-233416256-project] Calling method '.version_select at 0x7f3c68d14280>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:49.415964 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5b177638-146d-4afb-86e2-c76acf1ab3a8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:49.429043 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5b177638-146d-4afb-86e2-c76acf1ab3a8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:49.436444 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5b177638-146d-4afb-86e2-c76acf1ab3a8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:49.456898 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5b177638-146d-4afb-86e2-c76acf1ab3a8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1281 microversion: 2.20 time: 0.443115 Dec 15 12:39:49.461196 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 24/40] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:39:49 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1281 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:39:49.475901 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2310ddb6-93b1-4512-bcb7-556cdb048a0c tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] Calling method '.version_select at 0x7f3c6951c820>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:49.562618 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e8368e82-be2c-4b09-bd77-99a1e6bf8dfd tempest-VolumesTestJSON-233416256 tempest-VolumesTestJSON-233416256-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/9b62520e-6dc2-4819-bab1-f049d76275f4" status: 200 len: 351 microversion: 2.1 time: 0.339286 Dec 15 12:39:49.570138 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 17/41] 10.222.0.76 () {58 vars in 1244 bytes} [Wed Dec 15 12:39:49 2021] GET /compute/v2.1/os-volumes/9b62520e-6dc2-4819-bab1-f049d76275f4 => generated 351 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:39:49.576036 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-095f63fd-1e70-4599-b823-be954a7b5fb4 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:49.580814 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-095f63fd-1e70-4599-b823-be954a7b5fb4 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:49.613752 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-095f63fd-1e70-4599-b823-be954a7b5fb4 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:49.620164 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-095f63fd-1e70-4599-b823-be954a7b5fb4 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:49.629367 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-095f63fd-1e70-4599-b823-be954a7b5fb4 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:49.630286 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-095f63fd-1e70-4599-b823-be954a7b5fb4 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:49.914048 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-095f63fd-1e70-4599-b823-be954a7b5fb4 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:49.929178 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-095f63fd-1e70-4599-b823-be954a7b5fb4 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1271 microversion: 2.1 time: 0.357462 Dec 15 12:39:49.935091 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 18/42] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:49 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1271 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:49.948974 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-612e4442-ee19-4b34-9565-bd17fae457f6 tempest-VolumesTestJSON-233416256 tempest-VolumesTestJSON-233416256-project] Calling method '.version_select at 0x7f3c68d4d160>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:50.097161 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2310ddb6-93b1-4512-bcb7-556cdb048a0c tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/19f6cbcf-8340-4a6c-84ec-79f25b81936d" status: 202 len: 0 microversion: 2.1 time: 0.634702 Dec 15 12:39:50.097927 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 25/43] 10.222.0.76 () {58 vars in 1247 bytes} [Wed Dec 15 12:39:49 2021] DELETE /compute/v2.1/os-volumes/19f6cbcf-8340-4a6c-84ec-79f25b81936d => generated 0 bytes in 636 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:39:50.102990 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3b181d5f-a24e-4b2d-9f6e-e88f927b9c92 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:50.103610 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3b181d5f-a24e-4b2d-9f6e-e88f927b9c92 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:50.125673 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3b181d5f-a24e-4b2d-9f6e-e88f927b9c92 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:50.126123 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3b181d5f-a24e-4b2d-9f6e-e88f927b9c92 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:50.126931 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3b181d5f-a24e-4b2d-9f6e-e88f927b9c92 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:50.136756 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3b181d5f-a24e-4b2d-9f6e-e88f927b9c92 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:50.211416 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-612e4442-ee19-4b34-9565-bd17fae457f6 tempest-VolumesTestJSON-233416256 tempest-VolumesTestJSON-233416256-project] 10.222.0.76 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.274122 Dec 15 12:39:50.221599 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 19/44] 10.222.0.76 () {58 vars in 1133 bytes} [Wed Dec 15 12:39:49 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:50.228788 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3861a33e-3b33-44da-9814-3311d22da0ce tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] Calling method '.version_select at 0x7f3c68d42280>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:50.401146 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3b181d5f-a24e-4b2d-9f6e-e88f927b9c92 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:50.417216 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.wsgi [None req-3861a33e-3b33-44da-9814-3311d22da0ce tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] HTTP exception thrown: Volume 19f6cbcf-8340-4a6c-84ec-79f25b81936d could not be found. Dec 15 12:39:50.417879 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3861a33e-3b33-44da-9814-3311d22da0ce tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] Returning 404 to user: Volume 19f6cbcf-8340-4a6c-84ec-79f25b81936d could not be found. {{(pid=122614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:39:50.418716 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3861a33e-3b33-44da-9814-3311d22da0ce tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/19f6cbcf-8340-4a6c-84ec-79f25b81936d" status: 404 len: 109 microversion: 2.1 time: 0.195590 Dec 15 12:39:50.427917 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 20/45] 10.222.0.76 () {58 vars in 1244 bytes} [Wed Dec 15 12:39:50 2021] GET /compute/v2.1/os-volumes/19f6cbcf-8340-4a6c-84ec-79f25b81936d => generated 109 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 12:39:50.428359 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3b181d5f-a24e-4b2d-9f6e-e88f927b9c92 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1274 microversion: 2.1 time: 0.324584 Dec 15 12:39:50.428359 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 26/46] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:50 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1274 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:50.440436 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-83090424-4161-46ab-a92a-f2bf11ff1a5c tempest-VolumesTestJSON-233416256 tempest-VolumesTestJSON-233416256-project] Calling method '.version_select at 0x7f3c68d4d1f0>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:50.457484 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5a2ad11e-d8f1-4f96-b6d7-1a53455bb44c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:50.462327 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5a2ad11e-d8f1-4f96-b6d7-1a53455bb44c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:50.473556 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5a2ad11e-d8f1-4f96-b6d7-1a53455bb44c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:50.474374 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5a2ad11e-d8f1-4f96-b6d7-1a53455bb44c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:50.475431 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5a2ad11e-d8f1-4f96-b6d7-1a53455bb44c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:50.476136 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5a2ad11e-d8f1-4f96-b6d7-1a53455bb44c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:50.657666 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5a2ad11e-d8f1-4f96-b6d7-1a53455bb44c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:50.670850 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5a2ad11e-d8f1-4f96-b6d7-1a53455bb44c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1274 microversion: 2.1 time: 0.244957 Dec 15 12:39:50.671848 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 27/47] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:50 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1274 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:50.678925 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-89babf73-82f3-4c37-ba25-687fa25f24b6 tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] Calling method '.version_select at 0x7f3c6951dee0>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:50.759501 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.wsgi [None req-89babf73-82f3-4c37-ba25-687fa25f24b6 tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] HTTP exception thrown: Volume 19f6cbcf-8340-4a6c-84ec-79f25b81936d could not be found. Dec 15 12:39:50.760413 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-89babf73-82f3-4c37-ba25-687fa25f24b6 tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] Returning 404 to user: Volume 19f6cbcf-8340-4a6c-84ec-79f25b81936d could not be found. {{(pid=122615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:39:50.761801 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-89babf73-82f3-4c37-ba25-687fa25f24b6 tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/19f6cbcf-8340-4a6c-84ec-79f25b81936d" status: 404 len: 109 microversion: 2.1 time: 0.087770 Dec 15 12:39:50.763572 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 28/48] 10.222.0.76 () {58 vars in 1247 bytes} [Wed Dec 15 12:39:50 2021] DELETE /compute/v2.1/os-volumes/19f6cbcf-8340-4a6c-84ec-79f25b81936d => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 12:39:50.769375 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5c9d934e-3974-41b6-b5d3-3c93337722a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:50.770229 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5c9d934e-3974-41b6-b5d3-3c93337722a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:50.781408 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5c9d934e-3974-41b6-b5d3-3c93337722a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:50.782231 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5c9d934e-3974-41b6-b5d3-3c93337722a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:50.783791 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5c9d934e-3974-41b6-b5d3-3c93337722a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:50.785621 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5c9d934e-3974-41b6-b5d3-3c93337722a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:50.798929 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-83090424-4161-46ab-a92a-f2bf11ff1a5c tempest-VolumesTestJSON-233416256 tempest-VolumesTestJSON-233416256-project] 10.222.0.76 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.377403 Dec 15 12:39:50.799625 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 21/49] 10.222.0.76 () {58 vars in 1148 bytes} [Wed Dec 15 12:39:50 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:39:50.815051 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-908fa171-17c6-412a-a1ab-5004a8a7f3df tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] Calling method '.version_select at 0x7f3c68d42c10>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:50.866725 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.wsgi [None req-908fa171-17c6-412a-a1ab-5004a8a7f3df tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] HTTP exception thrown: Volume 19f6cbcf-8340-4a6c-84ec-79f25b81936d could not be found. Dec 15 12:39:50.866725 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-908fa171-17c6-412a-a1ab-5004a8a7f3df tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] Returning 404 to user: Volume 19f6cbcf-8340-4a6c-84ec-79f25b81936d could not be found. {{(pid=122614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:39:50.866725 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-908fa171-17c6-412a-a1ab-5004a8a7f3df tempest-VolumesSnapshotsTestJSON-269841161 tempest-VolumesSnapshotsTestJSON-269841161-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/19f6cbcf-8340-4a6c-84ec-79f25b81936d" status: 404 len: 109 microversion: 2.1 time: 0.063126 Dec 15 12:39:50.866725 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 22/50] 10.222.0.76 () {58 vars in 1244 bytes} [Wed Dec 15 12:39:50 2021] GET /compute/v2.1/os-volumes/19f6cbcf-8340-4a6c-84ec-79f25b81936d => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 12:39:50.882772 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4a766efb-7cb7-40f5-a928-8ecbfdd18e27 tempest-VolumesTestJSON-233416256 tempest-VolumesTestJSON-233416256-project] Calling method '.version_select at 0x7f3c68d42b80>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:51.145856 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4a766efb-7cb7-40f5-a928-8ecbfdd18e27 tempest-VolumesTestJSON-233416256 tempest-VolumesTestJSON-233416256-project] 10.222.0.76 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.278335 Dec 15 12:39:51.146813 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 23/51] 10.222.0.76 () {58 vars in 1133 bytes} [Wed Dec 15 12:39:50 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:51.157273 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-05622e8d-1760-4c6a-ba74-7e33e164d437 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:51.158187 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-05622e8d-1760-4c6a-ba74-7e33e164d437 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:51.191326 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-05622e8d-1760-4c6a-ba74-7e33e164d437 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:51.195234 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-05622e8d-1760-4c6a-ba74-7e33e164d437 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:51.198505 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-05622e8d-1760-4c6a-ba74-7e33e164d437 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:51.200530 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-05622e8d-1760-4c6a-ba74-7e33e164d437 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:51.271862 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5c9d934e-3974-41b6-b5d3-3c93337722a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:51.301624 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5c9d934e-3974-41b6-b5d3-3c93337722a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:51.318178 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5c9d934e-3974-41b6-b5d3-3c93337722a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:51.322124 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5c9d934e-3974-41b6-b5d3-3c93337722a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1277 microversion: 2.20 time: 0.556435 Dec 15 12:39:51.328745 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 29/52] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:39:50 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1277 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:39:51.347117 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-05622e8d-1760-4c6a-ba74-7e33e164d437 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:51.355034 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-05622e8d-1760-4c6a-ba74-7e33e164d437 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1271 microversion: 2.1 time: 0.206986 Dec 15 12:39:51.360124 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 24/53] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:51 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1271 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:51.364931 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4b863b63-3a0a-43d6-a19a-1c0ac8b2f4c0 tempest-VolumesTestJSON-233416256 tempest-VolumesTestJSON-233416256-project] Calling method '.version_select at 0x7f3c6951d820>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:51.447908 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-60bfb200-c446-41f9-a04a-0753d9da1330 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:51.448839 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-60bfb200-c446-41f9-a04a-0753d9da1330 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:51.458091 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-60bfb200-c446-41f9-a04a-0753d9da1330 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:51.468280 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-60bfb200-c446-41f9-a04a-0753d9da1330 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:51.469697 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-60bfb200-c446-41f9-a04a-0753d9da1330 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:51.470718 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-60bfb200-c446-41f9-a04a-0753d9da1330 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:51.562224 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4b863b63-3a0a-43d6-a19a-1c0ac8b2f4c0 tempest-VolumesTestJSON-233416256 tempest-VolumesTestJSON-233416256-project] 10.222.0.76 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.219941 Dec 15 12:39:51.574953 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 30/54] 10.222.0.76 () {58 vars in 1166 bytes} [Wed Dec 15 12:39:51 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:39:51.588308 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f4fabe9e-8ae5-43a5-9dab-3187b609d029 tempest-VolumesTestJSON-233416256 tempest-VolumesTestJSON-233416256-project] Calling method '.version_select at 0x7f3c6b0f85e0>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:51.898390 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f4fabe9e-8ae5-43a5-9dab-3187b609d029 tempest-VolumesTestJSON-233416256 tempest-VolumesTestJSON-233416256-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.314049 Dec 15 12:39:51.899948 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 31/55] 10.222.0.76 () {58 vars in 1169 bytes} [Wed Dec 15 12:39:51 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:39:51.906009 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2c2c5617-d3c6-4730-b372-cd8b1f50962c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:51.906937 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2c2c5617-d3c6-4730-b372-cd8b1f50962c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:51.937722 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2c2c5617-d3c6-4730-b372-cd8b1f50962c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:51.939731 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2c2c5617-d3c6-4730-b372-cd8b1f50962c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:51.944060 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2c2c5617-d3c6-4730-b372-cd8b1f50962c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:51.948402 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2c2c5617-d3c6-4730-b372-cd8b1f50962c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:52.539212 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2c2c5617-d3c6-4730-b372-cd8b1f50962c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:52.548682 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2c2c5617-d3c6-4730-b372-cd8b1f50962c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1280 microversion: 2.1 time: 0.647455 Dec 15 12:39:52.560943 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 32/56] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:51 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1280 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:52.566503 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fb0952e7-2e9d-4164-9e65-2324314649a0 tempest-VolumesTestJSON-233416256 tempest-VolumesTestJSON-233416256-project] Calling method '.version_select at 0x7f3c6951d310>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:52.760637 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fb0952e7-2e9d-4164-9e65-2324314649a0 tempest-VolumesTestJSON-233416256 tempest-VolumesTestJSON-233416256-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.198358 Dec 15 12:39:52.761486 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 33/57] 10.222.0.76 () {58 vars in 1154 bytes} [Wed Dec 15 12:39:52 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:52.767327 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-acd01be5-b2e0-4bed-8b3f-296df5411e22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:52.768182 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-acd01be5-b2e0-4bed-8b3f-296df5411e22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:52.788409 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-acd01be5-b2e0-4bed-8b3f-296df5411e22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:52.789300 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-acd01be5-b2e0-4bed-8b3f-296df5411e22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:52.790735 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-acd01be5-b2e0-4bed-8b3f-296df5411e22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:52.791396 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-acd01be5-b2e0-4bed-8b3f-296df5411e22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:52.901462 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-acd01be5-b2e0-4bed-8b3f-296df5411e22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:52.915853 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-acd01be5-b2e0-4bed-8b3f-296df5411e22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:52.922912 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-acd01be5-b2e0-4bed-8b3f-296df5411e22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:52.926241 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-acd01be5-b2e0-4bed-8b3f-296df5411e22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1339 microversion: 2.20 time: 0.163198 Dec 15 12:39:52.928462 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 34/58] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:39:52 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1339 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:39:52.941534 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a5324fed-99dc-444d-95d9-03cf7e721964 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:52.942939 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a5324fed-99dc-444d-95d9-03cf7e721964 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:52.952323 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a5324fed-99dc-444d-95d9-03cf7e721964 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:52.953321 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a5324fed-99dc-444d-95d9-03cf7e721964 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:52.955230 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a5324fed-99dc-444d-95d9-03cf7e721964 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:52.956181 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a5324fed-99dc-444d-95d9-03cf7e721964 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:53.126672 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-60bfb200-c446-41f9-a04a-0753d9da1330 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:53.148748 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-60bfb200-c446-41f9-a04a-0753d9da1330 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1316 microversion: 2.1 time: 1.704219 Dec 15 12:39:53.150695 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 25/59] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:51 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1316 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:53.162817 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bf7335ac-b0bf-4e25-a00e-d527149667fc tempest-VolumesTestJSON-233416256 tempest-VolumesTestJSON-233416256-project] Calling method '.version_select at 0x7f3c695601f0>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:53.335368 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bf7335ac-b0bf-4e25-a00e-d527149667fc tempest-VolumesTestJSON-233416256 tempest-VolumesTestJSON-233416256-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.182257 Dec 15 12:39:53.336490 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 26/60] 10.222.0.76 () {58 vars in 1187 bytes} [Wed Dec 15 12:39:53 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:39:53.349437 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-edd3ad21-6422-4110-ab45-9624182e9204 tempest-VolumesTestJSON-233416256 tempest-VolumesTestJSON-233416256-project] Calling method '.version_select at 0x7f3c68d4df70>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:53.584229 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-edd3ad21-6422-4110-ab45-9624182e9204 tempest-VolumesTestJSON-233416256 tempest-VolumesTestJSON-233416256-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.239152 Dec 15 12:39:53.586415 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 27/61] 10.222.0.76 () {58 vars in 1154 bytes} [Wed Dec 15 12:39:53 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:39:53.591150 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ca9c2309-d1e7-400c-8139-a445899a0bca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:53.594037 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ca9c2309-d1e7-400c-8139-a445899a0bca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:53.613479 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ca9c2309-d1e7-400c-8139-a445899a0bca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:53.613952 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ca9c2309-d1e7-400c-8139-a445899a0bca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:53.616456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ca9c2309-d1e7-400c-8139-a445899a0bca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:53.618294 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ca9c2309-d1e7-400c-8139-a445899a0bca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:54.080876 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a5324fed-99dc-444d-95d9-03cf7e721964 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:54.090147 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a5324fed-99dc-444d-95d9-03cf7e721964 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1313 microversion: 2.1 time: 1.155561 Dec 15 12:39:54.106493 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 35/62] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:52 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1313 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:54.121007 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-dd8e42bf-7bf3-48b6-aa27-80baac8e9dab tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:54.122406 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-dd8e42bf-7bf3-48b6-aa27-80baac8e9dab tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:54.143976 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dd8e42bf-7bf3-48b6-aa27-80baac8e9dab tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:54.149544 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dd8e42bf-7bf3-48b6-aa27-80baac8e9dab tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:54.153837 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dd8e42bf-7bf3-48b6-aa27-80baac8e9dab tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:54.154660 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dd8e42bf-7bf3-48b6-aa27-80baac8e9dab tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:54.256939 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ca9c2309-d1e7-400c-8139-a445899a0bca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:54.265845 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ca9c2309-d1e7-400c-8139-a445899a0bca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1280 microversion: 2.1 time: 0.678225 Dec 15 12:39:54.266685 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 28/63] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:53 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1280 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:54.293347 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6d8d0871-71ee-4368-b4ee-faf8f46a9419 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:54.294227 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6d8d0871-71ee-4368-b4ee-faf8f46a9419 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:54.310296 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6d8d0871-71ee-4368-b4ee-faf8f46a9419 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:54.314074 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6d8d0871-71ee-4368-b4ee-faf8f46a9419 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:54.316141 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6d8d0871-71ee-4368-b4ee-faf8f46a9419 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:54.322299 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6d8d0871-71ee-4368-b4ee-faf8f46a9419 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:54.439629 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-dd8e42bf-7bf3-48b6-aa27-80baac8e9dab tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:54.460421 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-dd8e42bf-7bf3-48b6-aa27-80baac8e9dab tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:54.462177 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-dd8e42bf-7bf3-48b6-aa27-80baac8e9dab tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:54.463693 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-dd8e42bf-7bf3-48b6-aa27-80baac8e9dab tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1339 microversion: 2.20 time: 0.352971 Dec 15 12:39:54.470656 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 36/64] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:39:54 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1339 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:39:55.042869 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6d8d0871-71ee-4368-b4ee-faf8f46a9419 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:55.057676 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6d8d0871-71ee-4368-b4ee-faf8f46a9419 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1316 microversion: 2.1 time: 0.786968 Dec 15 12:39:55.061653 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 29/65] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:54 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1316 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:55.115327 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6849cb40-bcf1-409f-8f34-12962f6b4718 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:55.116644 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6849cb40-bcf1-409f-8f34-12962f6b4718 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:55.134960 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6849cb40-bcf1-409f-8f34-12962f6b4718 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:55.139531 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6849cb40-bcf1-409f-8f34-12962f6b4718 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:55.140820 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6849cb40-bcf1-409f-8f34-12962f6b4718 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:55.141843 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6849cb40-bcf1-409f-8f34-12962f6b4718 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:55.285069 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e07a1b60-fba8-4fd7-a315-95cc229634c3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:55.285886 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e07a1b60-fba8-4fd7-a315-95cc229634c3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:55.307368 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e07a1b60-fba8-4fd7-a315-95cc229634c3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:55.309395 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e07a1b60-fba8-4fd7-a315-95cc229634c3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:55.310594 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e07a1b60-fba8-4fd7-a315-95cc229634c3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:55.312426 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e07a1b60-fba8-4fd7-a315-95cc229634c3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:55.650147 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e07a1b60-fba8-4fd7-a315-95cc229634c3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:55.659423 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e07a1b60-fba8-4fd7-a315-95cc229634c3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1280 microversion: 2.1 time: 0.378087 Dec 15 12:39:55.674561 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 30/66] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:55 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1280 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:55.695964 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-64b0b7bc-b997-4e9c-8800-e1e5415b2e2a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:55.699038 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-64b0b7bc-b997-4e9c-8800-e1e5415b2e2a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:55.742044 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-64b0b7bc-b997-4e9c-8800-e1e5415b2e2a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:55.749113 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-64b0b7bc-b997-4e9c-8800-e1e5415b2e2a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:55.760067 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-64b0b7bc-b997-4e9c-8800-e1e5415b2e2a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:55.770704 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-64b0b7bc-b997-4e9c-8800-e1e5415b2e2a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:56.193810 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6849cb40-bcf1-409f-8f34-12962f6b4718 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:56.205578 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6849cb40-bcf1-409f-8f34-12962f6b4718 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1313 microversion: 2.1 time: 1.096299 Dec 15 12:39:56.206744 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 37/67] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:55 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1313 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:56.237005 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f59f5323-e00f-4ed7-af11-0eebc5dd503f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:56.240614 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f59f5323-e00f-4ed7-af11-0eebc5dd503f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:56.254453 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-64b0b7bc-b997-4e9c-8800-e1e5415b2e2a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:56.258898 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f59f5323-e00f-4ed7-af11-0eebc5dd503f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:56.264698 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-64b0b7bc-b997-4e9c-8800-e1e5415b2e2a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:56.267038 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-64b0b7bc-b997-4e9c-8800-e1e5415b2e2a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:56.272118 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f59f5323-e00f-4ed7-af11-0eebc5dd503f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:56.273773 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-64b0b7bc-b997-4e9c-8800-e1e5415b2e2a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1339 microversion: 2.20 time: 0.597759 Dec 15 12:39:56.275138 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 31/68] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:39:55 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1339 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:39:56.286254 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f59f5323-e00f-4ed7-af11-0eebc5dd503f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:56.289397 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f59f5323-e00f-4ed7-af11-0eebc5dd503f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:56.796170 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-e20c027f-4edf-4f73-b932-23d5641dad6b req-80b485c2-8961-485d-afb8-0f6105c44b04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d089a72b-31ce-47c8-bb6c-ea26a1c4dde0", "tag": "90461b16-9e90-4272-a714-ccf84be0bb08"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:39:56.800513 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:39:56.800513 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 12:39:56.833605 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-e20c027f-4edf-4f73-b932-23d5641dad6b req-80b485c2-8961-485d-afb8-0f6105c44b04 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:56.836179 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-e20c027f-4edf-4f73-b932-23d5641dad6b req-80b485c2-8961-485d-afb8-0f6105c44b04 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:56.909500 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-e20c027f-4edf-4f73-b932-23d5641dad6b req-80b485c2-8961-485d-afb8-0f6105c44b04 service nova] Creating event network-changed:90461b16-9e90-4272-a714-ccf84be0bb08 for instance d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 on hv-cinder-81322 Dec 15 12:39:56.912347 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-e20c027f-4edf-4f73-b932-23d5641dad6b req-80b485c2-8961-485d-afb8-0f6105c44b04 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 15 12:39:56.946686 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-185552c5-c374-415a-a1d0-de9093be1ef6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:56.947660 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-185552c5-c374-415a-a1d0-de9093be1ef6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:56.953086 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-185552c5-c374-415a-a1d0-de9093be1ef6 None None] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:56.957449 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-185552c5-c374-415a-a1d0-de9093be1ef6 None None] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:57.004217 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.compute.rpcapi [None req-185552c5-c374-415a-a1d0-de9093be1ef6 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 15 12:39:57.008625 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-185552c5-c374-415a-a1d0-de9093be1ef6 None None] Releasing lock "compute-rpcapi-router" {{(pid=122614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 15 12:39:57.096884 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-185552c5-c374-415a-a1d0-de9093be1ef6 None None] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.471393 Dec 15 12:39:57.098304 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 32/69] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 12:39:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:39:57.104454 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2a13ecdd-27e7-4b8b-ab62-51b123119cf9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:57.105415 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2a13ecdd-27e7-4b8b-ab62-51b123119cf9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:57.125105 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2a13ecdd-27e7-4b8b-ab62-51b123119cf9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:57.126847 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2a13ecdd-27e7-4b8b-ab62-51b123119cf9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:57.128905 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2a13ecdd-27e7-4b8b-ab62-51b123119cf9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:57.133763 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2a13ecdd-27e7-4b8b-ab62-51b123119cf9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:58.173526 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-f59f5323-e00f-4ed7-af11-0eebc5dd503f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:58.183079 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f59f5323-e00f-4ed7-af11-0eebc5dd503f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1316 microversion: 2.1 time: 1.975037 Dec 15 12:39:58.199918 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 38/70] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:56 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1316 bytes in 1992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:58.211502 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-69201937-2c43-4019-8faf-526d8901461c tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:58.212722 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-69201937-2c43-4019-8faf-526d8901461c tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:58.227075 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-69201937-2c43-4019-8faf-526d8901461c tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:58.231250 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-69201937-2c43-4019-8faf-526d8901461c tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:58.235002 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-69201937-2c43-4019-8faf-526d8901461c tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:58.235748 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-69201937-2c43-4019-8faf-526d8901461c tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:58.649181 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2a13ecdd-27e7-4b8b-ab62-51b123119cf9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:58.659657 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2a13ecdd-27e7-4b8b-ab62-51b123119cf9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1322 microversion: 2.1 time: 1.559733 Dec 15 12:39:58.679567 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 33/71] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:57 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1322 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:58.687457 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bad59b65-fd40-4afd-b209-d60135776c3b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:58.688515 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bad59b65-fd40-4afd-b209-d60135776c3b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:58.703155 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bad59b65-fd40-4afd-b209-d60135776c3b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:58.703943 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bad59b65-fd40-4afd-b209-d60135776c3b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:58.706612 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bad59b65-fd40-4afd-b209-d60135776c3b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:58.708698 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bad59b65-fd40-4afd-b209-d60135776c3b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:59.584228 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-69201937-2c43-4019-8faf-526d8901461c tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:59.596124 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-69201937-2c43-4019-8faf-526d8901461c tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1313 microversion: 2.1 time: 1.394553 Dec 15 12:39:59.596596 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 39/72] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:58 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1313 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:39:59.624738 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [req-db7035c0-cc2b-4d47-a701-d88d87c516a9 req-49a459d5-137c-42ae-93a6-07708946f2c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ee02333-4fb9-4dfb-bc00-f57402d7c612", "tag": "457daa7c-40b7-4e38-87bc-a288b566ffa6"}]} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:39:59.626030 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-bad59b65-fd40-4afd-b209-d60135776c3b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:59.635155 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:39:59.635155 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: warnings.warn(msg) Dec 15 12:39:59.644975 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-bad59b65-fd40-4afd-b209-d60135776c3b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:59.647934 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-bad59b65-fd40-4afd-b209-d60135776c3b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:39:59.656427 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bad59b65-fd40-4afd-b209-d60135776c3b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1407 microversion: 2.20 time: 0.989376 Dec 15 12:39:59.657736 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 34/73] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:39:58 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1407 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:39:59.662516 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c85d37df-670a-4727-9e22-70f217defde4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:59.674649 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c85d37df-670a-4727-9e22-70f217defde4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:59.683790 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-db7035c0-cc2b-4d47-a701-d88d87c516a9 req-49a459d5-137c-42ae-93a6-07708946f2c8 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:59.684101 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c85d37df-670a-4727-9e22-70f217defde4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:59.684220 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-db7035c0-cc2b-4d47-a701-d88d87c516a9 req-49a459d5-137c-42ae-93a6-07708946f2c8 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:59.685027 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c85d37df-670a-4727-9e22-70f217defde4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:59.686132 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c85d37df-670a-4727-9e22-70f217defde4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:59.686813 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c85d37df-670a-4727-9e22-70f217defde4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:59.758563 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.compute.server_external_events [req-db7035c0-cc2b-4d47-a701-d88d87c516a9 req-49a459d5-137c-42ae-93a6-07708946f2c8 service nova] Creating event network-changed:457daa7c-40b7-4e38-87bc-a288b566ffa6 for instance 1ee02333-4fb9-4dfb-bc00-f57402d7c612 on hv-cinder-81322 Dec 15 12:39:59.759143 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-db7035c0-cc2b-4d47-a701-d88d87c516a9 req-49a459d5-137c-42ae-93a6-07708946f2c8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122615) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 15 12:39:59.760315 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4d592b7d-5e0c-4fc3-9865-d201a2cd1d6b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:59.760745 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4d592b7d-5e0c-4fc3-9865-d201a2cd1d6b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:59.769424 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4d592b7d-5e0c-4fc3-9865-d201a2cd1d6b None None] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:59.791008 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4d592b7d-5e0c-4fc3-9865-d201a2cd1d6b None None] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:59.840041 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.compute.rpcapi [None req-4d592b7d-5e0c-4fc3-9865-d201a2cd1d6b None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 15 12:39:59.840954 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4d592b7d-5e0c-4fc3-9865-d201a2cd1d6b None None] Releasing lock "compute-rpcapi-router" {{(pid=122615) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 15 12:39:59.938767 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4d592b7d-5e0c-4fc3-9865-d201a2cd1d6b None None] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.321239 Dec 15 12:39:59.939442 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 40/74] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 12:39:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:39:59.944689 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2eb7e53d-8422-4d7f-a067-eae608ca4374 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:39:59.945386 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2eb7e53d-8422-4d7f-a067-eae608ca4374 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:39:59.971557 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2eb7e53d-8422-4d7f-a067-eae608ca4374 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:59.972014 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2eb7e53d-8422-4d7f-a067-eae608ca4374 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:39:59.972896 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2eb7e53d-8422-4d7f-a067-eae608ca4374 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:39:59.973269 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2eb7e53d-8422-4d7f-a067-eae608ca4374 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:00.366153 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c85d37df-670a-4727-9e22-70f217defde4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:00.376988 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c85d37df-670a-4727-9e22-70f217defde4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1316 microversion: 2.1 time: 0.718006 Dec 15 12:40:00.377879 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 35/75] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:59 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1316 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:00.612468 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c4020caa-d608-4835-9488-52fb7e77bf24 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:00.613201 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c4020caa-d608-4835-9488-52fb7e77bf24 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:00.634660 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c4020caa-d608-4835-9488-52fb7e77bf24 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:00.640156 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c4020caa-d608-4835-9488-52fb7e77bf24 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:00.641217 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c4020caa-d608-4835-9488-52fb7e77bf24 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:00.650590 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c4020caa-d608-4835-9488-52fb7e77bf24 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:00.749646 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2eb7e53d-8422-4d7f-a067-eae608ca4374 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:00.776406 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2eb7e53d-8422-4d7f-a067-eae608ca4374 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1322 microversion: 2.1 time: 0.834968 Dec 15 12:40:00.777330 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 41/76] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:39:59 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1322 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:00.793437 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-21e6ac2d-0ad9-4064-ae8e-63259c33cccf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:00.797048 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-21e6ac2d-0ad9-4064-ae8e-63259c33cccf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:00.825466 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-21e6ac2d-0ad9-4064-ae8e-63259c33cccf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:00.833909 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-21e6ac2d-0ad9-4064-ae8e-63259c33cccf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:00.835405 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-21e6ac2d-0ad9-4064-ae8e-63259c33cccf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:00.835748 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-21e6ac2d-0ad9-4064-ae8e-63259c33cccf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:01.413006 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c4020caa-d608-4835-9488-52fb7e77bf24 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:01.428124 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c4020caa-d608-4835-9488-52fb7e77bf24 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1313 microversion: 2.1 time: 0.819280 Dec 15 12:40:01.433441 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 36/77] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:00 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1313 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:01.742567 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-e4313f8b-c8e3-4b83-a982-dc4d5680b94d req-9e08cab0-10c5-46b5-9270-597b2bed4dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2824788a-14d6-488d-8af1-2df6b3de771a", "tag": "e4f59a42-9884-4311-ab2f-2c6eb2422029"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:01.754826 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:40:01.754826 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 12:40:01.778564 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-e4313f8b-c8e3-4b83-a982-dc4d5680b94d req-9e08cab0-10c5-46b5-9270-597b2bed4dc3 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:01.780065 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-e4313f8b-c8e3-4b83-a982-dc4d5680b94d req-9e08cab0-10c5-46b5-9270-597b2bed4dc3 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:01.815610 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-e4313f8b-c8e3-4b83-a982-dc4d5680b94d req-9e08cab0-10c5-46b5-9270-597b2bed4dc3 service nova] Creating event network-changed:e4f59a42-9884-4311-ab2f-2c6eb2422029 for instance 2824788a-14d6-488d-8af1-2df6b3de771a on hv-cinder-81322 Dec 15 12:40:01.835375 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-e4313f8b-c8e3-4b83-a982-dc4d5680b94d req-9e08cab0-10c5-46b5-9270-597b2bed4dc3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.394233 Dec 15 12:40:01.838071 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 37/78] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 12:40:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:40:01.858411 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-567b03fe-3fdd-4e3a-ac9d-4c6e82d07e94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:01.859783 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-567b03fe-3fdd-4e3a-ac9d-4c6e82d07e94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:01.881643 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-567b03fe-3fdd-4e3a-ac9d-4c6e82d07e94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:01.883279 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-567b03fe-3fdd-4e3a-ac9d-4c6e82d07e94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:01.884633 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-567b03fe-3fdd-4e3a-ac9d-4c6e82d07e94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:01.885851 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-567b03fe-3fdd-4e3a-ac9d-4c6e82d07e94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:02.593420 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-21e6ac2d-0ad9-4064-ae8e-63259c33cccf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:02.603571 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-21e6ac2d-0ad9-4064-ae8e-63259c33cccf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:02.615389 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-21e6ac2d-0ad9-4064-ae8e-63259c33cccf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:02.616661 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-21e6ac2d-0ad9-4064-ae8e-63259c33cccf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1407 microversion: 2.20 time: 1.838192 Dec 15 12:40:02.617331 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 42/79] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:40:00 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1407 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:40:02.621801 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-49518bff-6639-4045-a85a-7fe23d5f889e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:02.626269 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-49518bff-6639-4045-a85a-7fe23d5f889e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:02.645881 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-49518bff-6639-4045-a85a-7fe23d5f889e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:02.646694 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-49518bff-6639-4045-a85a-7fe23d5f889e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:02.647848 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-49518bff-6639-4045-a85a-7fe23d5f889e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:02.648535 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-49518bff-6639-4045-a85a-7fe23d5f889e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:03.144399 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-567b03fe-3fdd-4e3a-ac9d-4c6e82d07e94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:03.154862 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-567b03fe-3fdd-4e3a-ac9d-4c6e82d07e94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1316 microversion: 2.1 time: 1.312004 Dec 15 12:40:03.156082 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 38/80] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:01 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1316 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:03.186830 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-1d7e6957-37f3-4b06-be62-fd8547b70386 req-24596df9-c4f6-4f05-ab11-2392c8a57e88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2", "tag": "67d867cb-3a0f-4a77-8182-0e96b6df907f"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:03.192027 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:40:03.192027 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 12:40:03.208589 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-1d7e6957-37f3-4b06-be62-fd8547b70386 req-24596df9-c4f6-4f05-ab11-2392c8a57e88 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:03.209874 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-1d7e6957-37f3-4b06-be62-fd8547b70386 req-24596df9-c4f6-4f05-ab11-2392c8a57e88 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:03.232917 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-1d7e6957-37f3-4b06-be62-fd8547b70386 req-24596df9-c4f6-4f05-ab11-2392c8a57e88 service nova] Creating event network-changed:67d867cb-3a0f-4a77-8182-0e96b6df907f for instance ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 on hv-cinder-81322 Dec 15 12:40:03.244827 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-1d7e6957-37f3-4b06-be62-fd8547b70386 req-24596df9-c4f6-4f05-ab11-2392c8a57e88 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087425 Dec 15 12:40:03.252806 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 39/81] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 12:40:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:40:03.277996 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f3fa2974-3e3c-4070-af4e-85dc3b7feed8 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:03.282183 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f3fa2974-3e3c-4070-af4e-85dc3b7feed8 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:03.295868 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f3fa2974-3e3c-4070-af4e-85dc3b7feed8 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:03.299456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f3fa2974-3e3c-4070-af4e-85dc3b7feed8 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:03.302897 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f3fa2974-3e3c-4070-af4e-85dc3b7feed8 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:03.304570 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f3fa2974-3e3c-4070-af4e-85dc3b7feed8 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:03.469487 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-49518bff-6639-4045-a85a-7fe23d5f889e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:03.482489 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-49518bff-6639-4045-a85a-7fe23d5f889e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1322 microversion: 2.1 time: 0.863414 Dec 15 12:40:03.484555 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 43/82] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:02 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1322 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:03.635366 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-373492f6-1f50-4e9b-890e-ed01fc2fb631 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:03.636826 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-373492f6-1f50-4e9b-890e-ed01fc2fb631 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:03.644870 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-373492f6-1f50-4e9b-890e-ed01fc2fb631 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:03.645659 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-373492f6-1f50-4e9b-890e-ed01fc2fb631 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:03.646710 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-373492f6-1f50-4e9b-890e-ed01fc2fb631 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:03.647345 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-373492f6-1f50-4e9b-890e-ed01fc2fb631 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:03.804309 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f3fa2974-3e3c-4070-af4e-85dc3b7feed8 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:03.811668 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f3fa2974-3e3c-4070-af4e-85dc3b7feed8 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1313 microversion: 2.1 time: 0.557253 Dec 15 12:40:03.815037 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 40/83] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:03 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1313 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:03.869725 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-5cbf7520-5834-4834-a4b5-864fa346c70c req-8bb1a38e-9d6f-4ba8-8f1e-9b567ab052d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a57f09a7-71bf-49d0-9ee5-fe5c4aa09638", "tag": "156bfc68-a57b-4095-8995-41bca77b20eb"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:03.871441 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:40:03.871441 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 12:40:03.890255 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-5cbf7520-5834-4834-a4b5-864fa346c70c req-8bb1a38e-9d6f-4ba8-8f1e-9b567ab052d6 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:03.890796 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-5cbf7520-5834-4834-a4b5-864fa346c70c req-8bb1a38e-9d6f-4ba8-8f1e-9b567ab052d6 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:03.909637 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-5cbf7520-5834-4834-a4b5-864fa346c70c req-8bb1a38e-9d6f-4ba8-8f1e-9b567ab052d6 service nova] Creating event network-changed:156bfc68-a57b-4095-8995-41bca77b20eb for instance a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 on hv-cinder-81322 Dec 15 12:40:03.923332 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-5cbf7520-5834-4834-a4b5-864fa346c70c req-8bb1a38e-9d6f-4ba8-8f1e-9b567ab052d6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057119 Dec 15 12:40:03.923967 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 41/84] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 12:40:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:40:03.986144 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-373492f6-1f50-4e9b-890e-ed01fc2fb631 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:04.012901 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-373492f6-1f50-4e9b-890e-ed01fc2fb631 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:04.016440 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-373492f6-1f50-4e9b-890e-ed01fc2fb631 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:04.017837 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-373492f6-1f50-4e9b-890e-ed01fc2fb631 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1407 microversion: 2.20 time: 0.386335 Dec 15 12:40:04.018890 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 44/85] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:40:03 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1407 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:40:04.178671 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2ab9786b-d111-4dbd-809d-ac9729abdced tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:04.184590 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2ab9786b-d111-4dbd-809d-ac9729abdced tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:04.196475 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2ab9786b-d111-4dbd-809d-ac9729abdced tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:04.204075 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2ab9786b-d111-4dbd-809d-ac9729abdced tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:04.205351 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2ab9786b-d111-4dbd-809d-ac9729abdced tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:04.206719 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2ab9786b-d111-4dbd-809d-ac9729abdced tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:04.503505 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c6f8a274-a53a-412d-9d53-fe2ea16251c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:04.505333 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2ab9786b-d111-4dbd-809d-ac9729abdced tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:04.505712 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c6f8a274-a53a-412d-9d53-fe2ea16251c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:04.514994 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c6f8a274-a53a-412d-9d53-fe2ea16251c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:04.515245 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2ab9786b-d111-4dbd-809d-ac9729abdced tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1316 microversion: 2.1 time: 0.345870 Dec 15 12:40:04.516246 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c6f8a274-a53a-412d-9d53-fe2ea16251c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:04.518153 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c6f8a274-a53a-412d-9d53-fe2ea16251c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:04.519757 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c6f8a274-a53a-412d-9d53-fe2ea16251c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:04.529147 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 42/86] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:04 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1316 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:04.829712 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7b99bd93-cf2a-4d4e-a2b9-be14feba3633 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:04.830255 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7b99bd93-cf2a-4d4e-a2b9-be14feba3633 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:04.840813 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b99bd93-cf2a-4d4e-a2b9-be14feba3633 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:04.842956 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b99bd93-cf2a-4d4e-a2b9-be14feba3633 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:04.844243 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b99bd93-cf2a-4d4e-a2b9-be14feba3633 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:04.844793 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b99bd93-cf2a-4d4e-a2b9-be14feba3633 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:04.859531 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c6f8a274-a53a-412d-9d53-fe2ea16251c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:04.890063 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c6f8a274-a53a-412d-9d53-fe2ea16251c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1322 microversion: 2.1 time: 0.391350 Dec 15 12:40:04.892107 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 45/87] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:04 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1322 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:05.042114 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-36383ded-ebd7-4b8f-a71c-fa2626462d6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:05.042878 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-36383ded-ebd7-4b8f-a71c-fa2626462d6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:05.050520 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-36383ded-ebd7-4b8f-a71c-fa2626462d6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:05.051211 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-36383ded-ebd7-4b8f-a71c-fa2626462d6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:05.052673 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-36383ded-ebd7-4b8f-a71c-fa2626462d6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:05.053273 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-36383ded-ebd7-4b8f-a71c-fa2626462d6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:05.458424 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7b99bd93-cf2a-4d4e-a2b9-be14feba3633 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:05.466238 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7b99bd93-cf2a-4d4e-a2b9-be14feba3633 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1313 microversion: 2.1 time: 0.640651 Dec 15 12:40:05.470975 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 43/88] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:04 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1313 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:05.523116 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-36383ded-ebd7-4b8f-a71c-fa2626462d6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:05.535082 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a121c33a-10ba-454b-9ccb-e53c8aa1e00d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:05.535808 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a121c33a-10ba-454b-9ccb-e53c8aa1e00d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:05.539918 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-36383ded-ebd7-4b8f-a71c-fa2626462d6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:05.546111 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-36383ded-ebd7-4b8f-a71c-fa2626462d6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:05.551511 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a121c33a-10ba-454b-9ccb-e53c8aa1e00d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:05.552456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a121c33a-10ba-454b-9ccb-e53c8aa1e00d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:05.556368 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a121c33a-10ba-454b-9ccb-e53c8aa1e00d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:05.557059 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a121c33a-10ba-454b-9ccb-e53c8aa1e00d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:05.567229 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-36383ded-ebd7-4b8f-a71c-fa2626462d6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1407 microversion: 2.20 time: 0.528935 Dec 15 12:40:05.569457 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 46/89] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:40:05 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1407 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:40:05.781993 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a121c33a-10ba-454b-9ccb-e53c8aa1e00d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:05.792051 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a121c33a-10ba-454b-9ccb-e53c8aa1e00d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1316 microversion: 2.1 time: 0.262902 Dec 15 12:40:05.792784 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 44/90] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:05 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1316 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:05.910055 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7693c325-6b18-4a50-9431-4011d3721cf5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:05.911417 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7693c325-6b18-4a50-9431-4011d3721cf5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:05.921346 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7693c325-6b18-4a50-9431-4011d3721cf5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:05.922100 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7693c325-6b18-4a50-9431-4011d3721cf5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:05.924739 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7693c325-6b18-4a50-9431-4011d3721cf5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:05.927820 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7693c325-6b18-4a50-9431-4011d3721cf5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:06.185817 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7693c325-6b18-4a50-9431-4011d3721cf5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:06.195334 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7693c325-6b18-4a50-9431-4011d3721cf5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1322 microversion: 2.1 time: 0.291173 Dec 15 12:40:06.195919 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 47/91] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:05 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:06.488849 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9de51903-2280-4eb2-8e4d-befb61823c1a tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:06.489911 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9de51903-2280-4eb2-8e4d-befb61823c1a tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:06.519515 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9de51903-2280-4eb2-8e4d-befb61823c1a tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:06.520060 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9de51903-2280-4eb2-8e4d-befb61823c1a tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:06.522560 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9de51903-2280-4eb2-8e4d-befb61823c1a tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:06.523084 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9de51903-2280-4eb2-8e4d-befb61823c1a tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:06.591895 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9d6ef10f-7d1b-42d2-a3c9-7b4835e209c9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:06.593017 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9d6ef10f-7d1b-42d2-a3c9-7b4835e209c9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:06.608361 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9d6ef10f-7d1b-42d2-a3c9-7b4835e209c9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:06.611274 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9d6ef10f-7d1b-42d2-a3c9-7b4835e209c9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:06.623047 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9d6ef10f-7d1b-42d2-a3c9-7b4835e209c9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:06.627688 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9d6ef10f-7d1b-42d2-a3c9-7b4835e209c9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:06.797268 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9de51903-2280-4eb2-8e4d-befb61823c1a tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:06.805816 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9de51903-2280-4eb2-8e4d-befb61823c1a tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1313 microversion: 2.1 time: 0.321864 Dec 15 12:40:06.806867 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 45/92] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:06 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1313 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:06.823535 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-327427ea-b0da-4e59-a48f-5f3ac560709c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:06.824414 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-327427ea-b0da-4e59-a48f-5f3ac560709c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:06.832158 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-327427ea-b0da-4e59-a48f-5f3ac560709c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:06.832863 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-327427ea-b0da-4e59-a48f-5f3ac560709c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:06.834192 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-327427ea-b0da-4e59-a48f-5f3ac560709c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:06.834766 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-327427ea-b0da-4e59-a48f-5f3ac560709c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:07.030624 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9d6ef10f-7d1b-42d2-a3c9-7b4835e209c9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:07.045054 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9d6ef10f-7d1b-42d2-a3c9-7b4835e209c9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:07.050768 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9d6ef10f-7d1b-42d2-a3c9-7b4835e209c9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:07.054825 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9d6ef10f-7d1b-42d2-a3c9-7b4835e209c9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1407 microversion: 2.20 time: 0.469709 Dec 15 12:40:07.069585 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 48/93] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:40:06 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1407 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:40:07.085274 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-327427ea-b0da-4e59-a48f-5f3ac560709c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:07.094845 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-327427ea-b0da-4e59-a48f-5f3ac560709c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1316 microversion: 2.1 time: 0.275469 Dec 15 12:40:07.095640 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 46/94] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:06 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1316 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:07.212979 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2542ace6-24cf-4a92-98dd-15197591f10f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:07.213741 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2542ace6-24cf-4a92-98dd-15197591f10f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:07.220981 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2542ace6-24cf-4a92-98dd-15197591f10f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:07.221822 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2542ace6-24cf-4a92-98dd-15197591f10f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:07.223053 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2542ace6-24cf-4a92-98dd-15197591f10f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:07.223674 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2542ace6-24cf-4a92-98dd-15197591f10f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:07.529356 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2542ace6-24cf-4a92-98dd-15197591f10f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:07.537301 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2542ace6-24cf-4a92-98dd-15197591f10f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1322 microversion: 2.1 time: 0.328714 Dec 15 12:40:07.542690 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 49/95] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:07 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:07.825102 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ac5fea08-12e7-467f-9548-7aad5b643a44 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:07.826325 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ac5fea08-12e7-467f-9548-7aad5b643a44 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:07.834958 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ac5fea08-12e7-467f-9548-7aad5b643a44 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:07.835406 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ac5fea08-12e7-467f-9548-7aad5b643a44 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:07.836294 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ac5fea08-12e7-467f-9548-7aad5b643a44 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:07.836809 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ac5fea08-12e7-467f-9548-7aad5b643a44 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:08.071318 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ac5fea08-12e7-467f-9548-7aad5b643a44 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:08.077899 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-463e6dd0-b5c7-47f4-b109-5e0b80674c8f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:08.079045 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-463e6dd0-b5c7-47f4-b109-5e0b80674c8f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:08.082423 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ac5fea08-12e7-467f-9548-7aad5b643a44 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1313 microversion: 2.1 time: 0.261816 Dec 15 12:40:08.092882 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 47/96] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:07 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:08.102037 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-463e6dd0-b5c7-47f4-b109-5e0b80674c8f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:08.102690 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-463e6dd0-b5c7-47f4-b109-5e0b80674c8f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:08.104930 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-463e6dd0-b5c7-47f4-b109-5e0b80674c8f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:08.105856 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-463e6dd0-b5c7-47f4-b109-5e0b80674c8f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:08.113015 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-32d6c5d0-674d-4f9a-868a-54bebc57382f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:08.113789 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-32d6c5d0-674d-4f9a-868a-54bebc57382f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:08.122286 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-32d6c5d0-674d-4f9a-868a-54bebc57382f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:08.128572 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-32d6c5d0-674d-4f9a-868a-54bebc57382f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:08.129672 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-32d6c5d0-674d-4f9a-868a-54bebc57382f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:08.130582 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-32d6c5d0-674d-4f9a-868a-54bebc57382f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:08.380142 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-463e6dd0-b5c7-47f4-b109-5e0b80674c8f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:08.398308 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-463e6dd0-b5c7-47f4-b109-5e0b80674c8f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:08.403435 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-463e6dd0-b5c7-47f4-b109-5e0b80674c8f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:08.408394 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-463e6dd0-b5c7-47f4-b109-5e0b80674c8f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1407 microversion: 2.20 time: 0.335984 Dec 15 12:40:08.418570 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-32d6c5d0-674d-4f9a-868a-54bebc57382f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:08.421054 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 50/97] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:40:08 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1407 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:40:08.431594 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-32d6c5d0-674d-4f9a-868a-54bebc57382f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1316 microversion: 2.1 time: 0.320606 Dec 15 12:40:08.432400 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 48/98] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:08 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1316 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:08.570367 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b5fe4d46-8bfd-4fd9-8a7a-7f351d4b7dcf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:08.571254 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b5fe4d46-8bfd-4fd9-8a7a-7f351d4b7dcf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:08.581548 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b5fe4d46-8bfd-4fd9-8a7a-7f351d4b7dcf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:08.582997 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b5fe4d46-8bfd-4fd9-8a7a-7f351d4b7dcf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:08.583970 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b5fe4d46-8bfd-4fd9-8a7a-7f351d4b7dcf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:08.584545 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b5fe4d46-8bfd-4fd9-8a7a-7f351d4b7dcf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:08.828978 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b5fe4d46-8bfd-4fd9-8a7a-7f351d4b7dcf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:08.828978 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b5fe4d46-8bfd-4fd9-8a7a-7f351d4b7dcf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1322 microversion: 2.1 time: 0.269810 Dec 15 12:40:08.828978 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 51/99] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:08 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:09.111852 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1b112919-4a0b-4806-a7ed-ee38f16b64cb tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:09.113076 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1b112919-4a0b-4806-a7ed-ee38f16b64cb tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:09.121392 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1b112919-4a0b-4806-a7ed-ee38f16b64cb tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:09.122096 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1b112919-4a0b-4806-a7ed-ee38f16b64cb tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:09.123302 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1b112919-4a0b-4806-a7ed-ee38f16b64cb tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:09.123880 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1b112919-4a0b-4806-a7ed-ee38f16b64cb tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:09.286208 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1b112919-4a0b-4806-a7ed-ee38f16b64cb tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:09.296052 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1b112919-4a0b-4806-a7ed-ee38f16b64cb tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1313 microversion: 2.1 time: 0.194315 Dec 15 12:40:09.310603 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 49/100] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:09 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:09.426671 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7a737c8c-7ba6-4c80-9c73-cd93f9a7008d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:09.427933 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7a737c8c-7ba6-4c80-9c73-cd93f9a7008d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:09.434055 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7a737c8c-7ba6-4c80-9c73-cd93f9a7008d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:09.434687 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7a737c8c-7ba6-4c80-9c73-cd93f9a7008d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:09.436716 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7a737c8c-7ba6-4c80-9c73-cd93f9a7008d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:09.437154 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7a737c8c-7ba6-4c80-9c73-cd93f9a7008d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:09.448343 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-972ac32e-1fe4-4372-bf5c-84510c5b1980 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:09.448960 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-972ac32e-1fe4-4372-bf5c-84510c5b1980 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:09.456066 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-972ac32e-1fe4-4372-bf5c-84510c5b1980 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:09.456517 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-972ac32e-1fe4-4372-bf5c-84510c5b1980 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:09.457380 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-972ac32e-1fe4-4372-bf5c-84510c5b1980 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:09.458284 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-972ac32e-1fe4-4372-bf5c-84510c5b1980 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:10.024894 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7a737c8c-7ba6-4c80-9c73-cd93f9a7008d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:10.037526 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7a737c8c-7ba6-4c80-9c73-cd93f9a7008d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:10.040484 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7a737c8c-7ba6-4c80-9c73-cd93f9a7008d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:10.047642 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7a737c8c-7ba6-4c80-9c73-cd93f9a7008d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1407 microversion: 2.20 time: 0.619524 Dec 15 12:40:10.047642 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 52/101] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:40:09 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1407 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:40:10.054204 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4c79cc5e-6e41-4abb-933b-96fab27eed5b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:10.055057 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-972ac32e-1fe4-4372-bf5c-84510c5b1980 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:10.055815 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4c79cc5e-6e41-4abb-933b-96fab27eed5b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:10.064978 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-972ac32e-1fe4-4372-bf5c-84510c5b1980 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1316 microversion: 2.1 time: 0.620635 Dec 15 12:40:10.066271 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 50/102] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:09 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1316 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:10.067966 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4c79cc5e-6e41-4abb-933b-96fab27eed5b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:10.068456 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4c79cc5e-6e41-4abb-933b-96fab27eed5b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:10.069782 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4c79cc5e-6e41-4abb-933b-96fab27eed5b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:10.070311 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4c79cc5e-6e41-4abb-933b-96fab27eed5b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:10.246785 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4c79cc5e-6e41-4abb-933b-96fab27eed5b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:10.256125 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4c79cc5e-6e41-4abb-933b-96fab27eed5b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1322 microversion: 2.1 time: 0.211604 Dec 15 12:40:10.256711 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 53/103] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:10 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:10.320683 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-66fbef6b-5654-43b4-9091-0361f94fdf73 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:10.321133 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-66fbef6b-5654-43b4-9091-0361f94fdf73 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:10.328313 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-66fbef6b-5654-43b4-9091-0361f94fdf73 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:10.328756 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-66fbef6b-5654-43b4-9091-0361f94fdf73 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:10.330284 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-66fbef6b-5654-43b4-9091-0361f94fdf73 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:10.331145 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-66fbef6b-5654-43b4-9091-0361f94fdf73 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:10.503278 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-66fbef6b-5654-43b4-9091-0361f94fdf73 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:10.511423 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-66fbef6b-5654-43b4-9091-0361f94fdf73 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1313 microversion: 2.1 time: 0.194974 Dec 15 12:40:10.512093 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 51/104] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:10 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:11.072261 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2a67dd17-66f1-4326-b942-4612dbbe8564 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:11.072898 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2a67dd17-66f1-4326-b942-4612dbbe8564 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:11.084401 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ee919c02-b047-4247-b19d-6a1b15e620cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:11.085020 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ee919c02-b047-4247-b19d-6a1b15e620cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:11.088390 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2a67dd17-66f1-4326-b942-4612dbbe8564 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:11.088891 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2a67dd17-66f1-4326-b942-4612dbbe8564 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:11.089655 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2a67dd17-66f1-4326-b942-4612dbbe8564 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:11.090090 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2a67dd17-66f1-4326-b942-4612dbbe8564 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:11.102743 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ee919c02-b047-4247-b19d-6a1b15e620cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:11.103203 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ee919c02-b047-4247-b19d-6a1b15e620cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:11.104010 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ee919c02-b047-4247-b19d-6a1b15e620cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:11.104631 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ee919c02-b047-4247-b19d-6a1b15e620cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:11.327767 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ee919c02-b047-4247-b19d-6a1b15e620cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:11.335158 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ee919c02-b047-4247-b19d-6a1b15e620cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1316 microversion: 2.1 time: 0.255506 Dec 15 12:40:11.335733 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 52/105] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:11 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1316 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:11.343334 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2a67dd17-66f1-4326-b942-4612dbbe8564 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:11.353773 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1734efd3-2979-40b5-b112-0ce67144019c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:11.355190 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2a67dd17-66f1-4326-b942-4612dbbe8564 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:11.355362 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1734efd3-2979-40b5-b112-0ce67144019c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:11.356582 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2a67dd17-66f1-4326-b942-4612dbbe8564 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:11.358267 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2a67dd17-66f1-4326-b942-4612dbbe8564 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1407 microversion: 2.20 time: 0.291992 Dec 15 12:40:11.359133 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 54/106] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:40:11 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1407 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:40:11.363452 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1734efd3-2979-40b5-b112-0ce67144019c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:11.363959 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1734efd3-2979-40b5-b112-0ce67144019c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:11.364848 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1734efd3-2979-40b5-b112-0ce67144019c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:11.365345 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1734efd3-2979-40b5-b112-0ce67144019c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:11.529328 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-acae30ef-ad4d-427f-b65a-e3a931022bd0 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:11.530224 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-acae30ef-ad4d-427f-b65a-e3a931022bd0 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:11.535382 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1734efd3-2979-40b5-b112-0ce67144019c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:11.542420 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-acae30ef-ad4d-427f-b65a-e3a931022bd0 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:11.542860 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-acae30ef-ad4d-427f-b65a-e3a931022bd0 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:11.543716 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-acae30ef-ad4d-427f-b65a-e3a931022bd0 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:11.544240 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-acae30ef-ad4d-427f-b65a-e3a931022bd0 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:11.546661 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1734efd3-2979-40b5-b112-0ce67144019c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1322 microversion: 2.1 time: 0.209418 Dec 15 12:40:11.547579 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 53/107] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:11 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:11.689061 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-acae30ef-ad4d-427f-b65a-e3a931022bd0 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:11.696218 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-acae30ef-ad4d-427f-b65a-e3a931022bd0 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1313 microversion: 2.1 time: 0.171880 Dec 15 12:40:11.696782 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 55/108] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:11 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:12.351776 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-891ad536-9bc1-4255-909a-7f9d2d7c87a0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:12.352378 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-891ad536-9bc1-4255-909a-7f9d2d7c87a0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:12.358902 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-891ad536-9bc1-4255-909a-7f9d2d7c87a0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:12.359400 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-891ad536-9bc1-4255-909a-7f9d2d7c87a0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:12.360180 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-891ad536-9bc1-4255-909a-7f9d2d7c87a0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:12.360610 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-891ad536-9bc1-4255-909a-7f9d2d7c87a0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:12.394223 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-53cbf6ce-5a67-404d-8363-a245b40520f0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:12.395017 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-53cbf6ce-5a67-404d-8363-a245b40520f0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:12.400887 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-53cbf6ce-5a67-404d-8363-a245b40520f0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:12.401334 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-53cbf6ce-5a67-404d-8363-a245b40520f0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:12.402145 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-53cbf6ce-5a67-404d-8363-a245b40520f0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:12.402637 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-53cbf6ce-5a67-404d-8363-a245b40520f0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:12.585155 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-891ad536-9bc1-4255-909a-7f9d2d7c87a0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:12.593625 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-891ad536-9bc1-4255-909a-7f9d2d7c87a0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1316 microversion: 2.1 time: 0.245115 Dec 15 12:40:12.594241 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 54/109] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:12 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1316 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:12.599474 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-594ea4b4-7914-406e-ad12-bb2d168f0768 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:12.600368 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-594ea4b4-7914-406e-ad12-bb2d168f0768 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:12.606588 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-53cbf6ce-5a67-404d-8363-a245b40520f0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:12.614050 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-594ea4b4-7914-406e-ad12-bb2d168f0768 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:12.614519 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-594ea4b4-7914-406e-ad12-bb2d168f0768 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:12.615973 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-594ea4b4-7914-406e-ad12-bb2d168f0768 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:12.616723 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-594ea4b4-7914-406e-ad12-bb2d168f0768 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:12.621635 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-53cbf6ce-5a67-404d-8363-a245b40520f0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:12.624832 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-53cbf6ce-5a67-404d-8363-a245b40520f0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:12.627613 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-53cbf6ce-5a67-404d-8363-a245b40520f0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1407 microversion: 2.20 time: 0.236523 Dec 15 12:40:12.629442 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 56/110] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:40:12 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:40:12.713918 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e0be7f2b-bc2f-49b8-b2b1-d071c5c6233d tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:12.715002 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e0be7f2b-bc2f-49b8-b2b1-d071c5c6233d tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:12.723207 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0be7f2b-bc2f-49b8-b2b1-d071c5c6233d tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:12.724038 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0be7f2b-bc2f-49b8-b2b1-d071c5c6233d tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:12.725136 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0be7f2b-bc2f-49b8-b2b1-d071c5c6233d tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:12.725660 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0be7f2b-bc2f-49b8-b2b1-d071c5c6233d tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:12.777810 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-594ea4b4-7914-406e-ad12-bb2d168f0768 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:12.786130 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-594ea4b4-7914-406e-ad12-bb2d168f0768 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1322 microversion: 2.1 time: 0.190372 Dec 15 12:40:12.787044 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 55/111] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:12 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:12.868219 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e0be7f2b-bc2f-49b8-b2b1-d071c5c6233d tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:12.876161 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e0be7f2b-bc2f-49b8-b2b1-d071c5c6233d tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1313 microversion: 2.1 time: 0.166003 Dec 15 12:40:12.876694 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 57/112] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:12 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:13.610742 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f4cc70ca-71bb-4246-a774-d82f14b6c884 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:13.611433 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f4cc70ca-71bb-4246-a774-d82f14b6c884 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:13.617352 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4cc70ca-71bb-4246-a774-d82f14b6c884 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:13.617999 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4cc70ca-71bb-4246-a774-d82f14b6c884 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:13.618829 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4cc70ca-71bb-4246-a774-d82f14b6c884 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:13.619329 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4cc70ca-71bb-4246-a774-d82f14b6c884 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:13.647416 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b3c5a6c9-e101-491b-8ac4-da54706e2a98 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:13.648413 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b3c5a6c9-e101-491b-8ac4-da54706e2a98 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:13.655090 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b3c5a6c9-e101-491b-8ac4-da54706e2a98 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:13.655537 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b3c5a6c9-e101-491b-8ac4-da54706e2a98 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:13.656508 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b3c5a6c9-e101-491b-8ac4-da54706e2a98 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:13.657100 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b3c5a6c9-e101-491b-8ac4-da54706e2a98 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:13.820889 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f4cc70ca-71bb-4246-a774-d82f14b6c884 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:13.828476 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f4cc70ca-71bb-4246-a774-d82f14b6c884 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1316 microversion: 2.1 time: 0.221677 Dec 15 12:40:13.829376 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 56/113] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:13 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1316 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:13.839136 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-cdf2f06c-46ef-4c9b-856a-ab0bdbf4ae54 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:13.839136 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-cdf2f06c-46ef-4c9b-856a-ab0bdbf4ae54 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:13.848826 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cdf2f06c-46ef-4c9b-856a-ab0bdbf4ae54 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:13.849306 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cdf2f06c-46ef-4c9b-856a-ab0bdbf4ae54 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:13.850637 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cdf2f06c-46ef-4c9b-856a-ab0bdbf4ae54 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:13.851279 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cdf2f06c-46ef-4c9b-856a-ab0bdbf4ae54 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:13.869429 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b3c5a6c9-e101-491b-8ac4-da54706e2a98 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:13.880171 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b3c5a6c9-e101-491b-8ac4-da54706e2a98 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:13.882118 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b3c5a6c9-e101-491b-8ac4-da54706e2a98 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:13.883494 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b3c5a6c9-e101-491b-8ac4-da54706e2a98 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1407 microversion: 2.20 time: 0.240227 Dec 15 12:40:13.884654 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 58/114] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:40:13 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:40:13.892456 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0afa40f0-914f-4d32-a598-ecaf56e750e2 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:13.893313 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0afa40f0-914f-4d32-a598-ecaf56e750e2 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:13.912099 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0afa40f0-914f-4d32-a598-ecaf56e750e2 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:13.912708 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0afa40f0-914f-4d32-a598-ecaf56e750e2 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:13.913833 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0afa40f0-914f-4d32-a598-ecaf56e750e2 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:13.914477 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0afa40f0-914f-4d32-a598-ecaf56e750e2 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:14.034873 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-cdf2f06c-46ef-4c9b-856a-ab0bdbf4ae54 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:14.042052 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-cdf2f06c-46ef-4c9b-856a-ab0bdbf4ae54 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1322 microversion: 2.1 time: 0.211974 Dec 15 12:40:14.042633 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 57/115] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:13 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:14.099155 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0afa40f0-914f-4d32-a598-ecaf56e750e2 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:14.107919 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0afa40f0-914f-4d32-a598-ecaf56e750e2 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1313 microversion: 2.1 time: 0.219148 Dec 15 12:40:14.108782 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 59/116] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:13 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:14.845881 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c5101ae4-94c7-4e4f-94e7-bc8e951b55d3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:14.846481 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c5101ae4-94c7-4e4f-94e7-bc8e951b55d3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:14.852457 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c5101ae4-94c7-4e4f-94e7-bc8e951b55d3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:14.852830 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c5101ae4-94c7-4e4f-94e7-bc8e951b55d3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:14.853622 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c5101ae4-94c7-4e4f-94e7-bc8e951b55d3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:14.854051 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c5101ae4-94c7-4e4f-94e7-bc8e951b55d3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:14.902803 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d06fbe71-8899-446b-bf40-7c277f93efde tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:14.903415 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d06fbe71-8899-446b-bf40-7c277f93efde tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:14.910173 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d06fbe71-8899-446b-bf40-7c277f93efde tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:14.910624 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d06fbe71-8899-446b-bf40-7c277f93efde tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:14.911408 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d06fbe71-8899-446b-bf40-7c277f93efde tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:14.911841 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d06fbe71-8899-446b-bf40-7c277f93efde tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:15.030145 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c5101ae4-94c7-4e4f-94e7-bc8e951b55d3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:15.037352 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c5101ae4-94c7-4e4f-94e7-bc8e951b55d3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1316 microversion: 2.1 time: 0.195255 Dec 15 12:40:15.037937 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 58/117] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:14 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1316 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:15.061901 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-956dae41-7572-4b1c-aabf-265bca71bdd2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:15.062536 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-956dae41-7572-4b1c-aabf-265bca71bdd2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:15.068181 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-956dae41-7572-4b1c-aabf-265bca71bdd2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:15.068624 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-956dae41-7572-4b1c-aabf-265bca71bdd2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:15.069415 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-956dae41-7572-4b1c-aabf-265bca71bdd2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:15.069875 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-956dae41-7572-4b1c-aabf-265bca71bdd2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:15.089029 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d06fbe71-8899-446b-bf40-7c277f93efde tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:15.097489 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d06fbe71-8899-446b-bf40-7c277f93efde tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:15.100142 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d06fbe71-8899-446b-bf40-7c277f93efde tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:15.101292 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d06fbe71-8899-446b-bf40-7c277f93efde tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1407 microversion: 2.20 time: 0.202347 Dec 15 12:40:15.101908 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 60/118] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:40:14 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:40:15.125250 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-79782f97-0a47-46de-a076-a664a4a16f5b tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:15.125798 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-79782f97-0a47-46de-a076-a664a4a16f5b tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:15.132063 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-79782f97-0a47-46de-a076-a664a4a16f5b tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:15.132506 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-79782f97-0a47-46de-a076-a664a4a16f5b tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:15.133292 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-79782f97-0a47-46de-a076-a664a4a16f5b tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:15.133754 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-79782f97-0a47-46de-a076-a664a4a16f5b tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:15.238239 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-956dae41-7572-4b1c-aabf-265bca71bdd2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:15.245530 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-956dae41-7572-4b1c-aabf-265bca71bdd2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1322 microversion: 2.1 time: 0.187357 Dec 15 12:40:15.246114 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 59/119] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:15 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:15.307001 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-79782f97-0a47-46de-a076-a664a4a16f5b tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:15.315488 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-79782f97-0a47-46de-a076-a664a4a16f5b tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1313 microversion: 2.1 time: 0.193859 Dec 15 12:40:15.316069 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 61/120] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:15 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:16.054595 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1fbef11e-b32f-4a82-8f19-0de1d7ceb624 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:16.055209 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1fbef11e-b32f-4a82-8f19-0de1d7ceb624 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:16.062085 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1fbef11e-b32f-4a82-8f19-0de1d7ceb624 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:16.062530 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1fbef11e-b32f-4a82-8f19-0de1d7ceb624 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:16.063318 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1fbef11e-b32f-4a82-8f19-0de1d7ceb624 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:16.063751 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1fbef11e-b32f-4a82-8f19-0de1d7ceb624 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:16.119267 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e349e645-68b2-482b-9698-a0c7f7c8fa12 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:16.120046 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e349e645-68b2-482b-9698-a0c7f7c8fa12 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:16.126516 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e349e645-68b2-482b-9698-a0c7f7c8fa12 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:16.126965 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e349e645-68b2-482b-9698-a0c7f7c8fa12 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:16.128013 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e349e645-68b2-482b-9698-a0c7f7c8fa12 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:16.128504 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e349e645-68b2-482b-9698-a0c7f7c8fa12 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:16.224583 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1fbef11e-b32f-4a82-8f19-0de1d7ceb624 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:16.231894 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1fbef11e-b32f-4a82-8f19-0de1d7ceb624 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1316 microversion: 2.1 time: 0.180979 Dec 15 12:40:16.232565 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 60/121] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:16 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1316 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:16.262777 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f2742213-4faf-4bb1-826f-47870de413fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:16.264326 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f2742213-4faf-4bb1-826f-47870de413fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:16.270329 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f2742213-4faf-4bb1-826f-47870de413fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:16.270853 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f2742213-4faf-4bb1-826f-47870de413fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:16.271630 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f2742213-4faf-4bb1-826f-47870de413fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:16.272055 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f2742213-4faf-4bb1-826f-47870de413fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:16.291317 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e349e645-68b2-482b-9698-a0c7f7c8fa12 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:16.299917 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e349e645-68b2-482b-9698-a0c7f7c8fa12 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:16.301460 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e349e645-68b2-482b-9698-a0c7f7c8fa12 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:16.302597 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e349e645-68b2-482b-9698-a0c7f7c8fa12 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1407 microversion: 2.20 time: 0.187029 Dec 15 12:40:16.303154 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 62/122] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:40:16 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:40:16.332590 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4edf94f9-4ddc-4849-81ae-7111e582b0fb tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:16.333417 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4edf94f9-4ddc-4849-81ae-7111e582b0fb tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:16.339245 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4edf94f9-4ddc-4849-81ae-7111e582b0fb tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:16.339692 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4edf94f9-4ddc-4849-81ae-7111e582b0fb tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:16.340473 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4edf94f9-4ddc-4849-81ae-7111e582b0fb tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:16.340905 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4edf94f9-4ddc-4849-81ae-7111e582b0fb tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:16.434001 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f2742213-4faf-4bb1-826f-47870de413fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:16.442850 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f2742213-4faf-4bb1-826f-47870de413fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1322 microversion: 2.1 time: 0.183655 Dec 15 12:40:16.443417 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 61/123] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:16 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:16.504686 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4edf94f9-4ddc-4849-81ae-7111e582b0fb tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:16.512340 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4edf94f9-4ddc-4849-81ae-7111e582b0fb tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1313 microversion: 2.1 time: 0.183298 Dec 15 12:40:16.512964 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 63/124] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:16 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:17.256929 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3c1ac391-72d3-46d5-8368-ce7cd6119301 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:17.257774 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3c1ac391-72d3-46d5-8368-ce7cd6119301 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:17.282096 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3c1ac391-72d3-46d5-8368-ce7cd6119301 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:17.282538 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3c1ac391-72d3-46d5-8368-ce7cd6119301 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:17.283584 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3c1ac391-72d3-46d5-8368-ce7cd6119301 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:17.284017 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3c1ac391-72d3-46d5-8368-ce7cd6119301 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:17.320706 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-eb410d65-1f1d-48c7-84ba-c663020ae3a5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:17.321457 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-eb410d65-1f1d-48c7-84ba-c663020ae3a5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:17.333425 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eb410d65-1f1d-48c7-84ba-c663020ae3a5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:17.334102 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eb410d65-1f1d-48c7-84ba-c663020ae3a5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:17.335249 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eb410d65-1f1d-48c7-84ba-c663020ae3a5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:17.347288 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eb410d65-1f1d-48c7-84ba-c663020ae3a5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:17.507973 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3c1ac391-72d3-46d5-8368-ce7cd6119301 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:17.516768 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3c1ac391-72d3-46d5-8368-ce7cd6119301 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1316 microversion: 2.1 time: 0.263613 Dec 15 12:40:17.518177 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 62/125] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:17 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1316 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:17.522891 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1b6b5fde-b180-439c-8a79-2b2e95e40075 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:17.524005 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1b6b5fde-b180-439c-8a79-2b2e95e40075 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:17.533477 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1b6b5fde-b180-439c-8a79-2b2e95e40075 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:17.534456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1b6b5fde-b180-439c-8a79-2b2e95e40075 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:17.535307 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1b6b5fde-b180-439c-8a79-2b2e95e40075 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:17.535896 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1b6b5fde-b180-439c-8a79-2b2e95e40075 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:17.649028 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-eb410d65-1f1d-48c7-84ba-c663020ae3a5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:17.662550 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-eb410d65-1f1d-48c7-84ba-c663020ae3a5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:17.664319 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-eb410d65-1f1d-48c7-84ba-c663020ae3a5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:17.665483 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-eb410d65-1f1d-48c7-84ba-c663020ae3a5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1407 microversion: 2.20 time: 0.349140 Dec 15 12:40:17.677539 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 64/126] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:40:17 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1407 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:40:17.677539 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-64130a43-1498-49e3-92fa-6a1f6bd9638d tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:17.677539 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-64130a43-1498-49e3-92fa-6a1f6bd9638d tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:17.681860 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-64130a43-1498-49e3-92fa-6a1f6bd9638d tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:17.682454 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-64130a43-1498-49e3-92fa-6a1f6bd9638d tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:17.683438 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-64130a43-1498-49e3-92fa-6a1f6bd9638d tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:17.684100 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-64130a43-1498-49e3-92fa-6a1f6bd9638d tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:17.800158 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1b6b5fde-b180-439c-8a79-2b2e95e40075 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:17.808285 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1b6b5fde-b180-439c-8a79-2b2e95e40075 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1322 microversion: 2.1 time: 0.288641 Dec 15 12:40:17.808919 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 63/127] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:17 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:17.905154 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-64130a43-1498-49e3-92fa-6a1f6bd9638d tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:17.913338 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-64130a43-1498-49e3-92fa-6a1f6bd9638d tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1313 microversion: 2.1 time: 0.245905 Dec 15 12:40:17.924843 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 65/128] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:17 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:17.975981 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-c8697e0e-fabc-4915-981a-3434a70acf4e req-c71f035b-7642-40b2-a928-afee9b73438e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2", "name": "network-vif-plugged", "status": "completed", "tag": "67d867cb-3a0f-4a77-8182-0e96b6df907f"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:17.977602 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:40:17.977602 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 12:40:17.985336 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-c8697e0e-fabc-4915-981a-3434a70acf4e req-c71f035b-7642-40b2-a928-afee9b73438e service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:17.985767 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-c8697e0e-fabc-4915-981a-3434a70acf4e req-c71f035b-7642-40b2-a928-afee9b73438e service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:17.997950 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-c8697e0e-fabc-4915-981a-3434a70acf4e req-c71f035b-7642-40b2-a928-afee9b73438e service nova] Creating event network-vif-plugged:67d867cb-3a0f-4a77-8182-0e96b6df907f for instance ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 on hv-cinder-81322 Dec 15 12:40:18.004180 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-c8697e0e-fabc-4915-981a-3434a70acf4e req-c71f035b-7642-40b2-a928-afee9b73438e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117507 Dec 15 12:40:18.004938 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 64/129] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 12:40:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:40:18.536769 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-68eea1bf-ecfa-48f2-a05f-1f7181eee00a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:18.537806 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-68eea1bf-ecfa-48f2-a05f-1f7181eee00a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:18.545454 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-68eea1bf-ecfa-48f2-a05f-1f7181eee00a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:18.546344 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-68eea1bf-ecfa-48f2-a05f-1f7181eee00a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:18.547282 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-68eea1bf-ecfa-48f2-a05f-1f7181eee00a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:18.548065 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-68eea1bf-ecfa-48f2-a05f-1f7181eee00a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:18.699541 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-68eea1bf-ecfa-48f2-a05f-1f7181eee00a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:18.704949 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a304b188-31c1-4569-98f6-759a431879f0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:18.706543 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a304b188-31c1-4569-98f6-759a431879f0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:18.710086 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-68eea1bf-ecfa-48f2-a05f-1f7181eee00a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1316 microversion: 2.1 time: 0.176980 Dec 15 12:40:18.710662 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 66/130] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:18 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:18.721693 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a304b188-31c1-4569-98f6-759a431879f0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:18.722882 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a304b188-31c1-4569-98f6-759a431879f0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:18.723794 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a304b188-31c1-4569-98f6-759a431879f0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:18.724331 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a304b188-31c1-4569-98f6-759a431879f0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:18.827171 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4e52afeb-5999-424f-9ac3-3c6a7e12af09 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:18.828098 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4e52afeb-5999-424f-9ac3-3c6a7e12af09 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:18.835752 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e52afeb-5999-424f-9ac3-3c6a7e12af09 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:18.836381 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e52afeb-5999-424f-9ac3-3c6a7e12af09 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:18.837346 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e52afeb-5999-424f-9ac3-3c6a7e12af09 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:18.838126 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e52afeb-5999-424f-9ac3-3c6a7e12af09 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:18.913761 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a304b188-31c1-4569-98f6-759a431879f0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:18.922147 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a304b188-31c1-4569-98f6-759a431879f0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:18.923659 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a304b188-31c1-4569-98f6-759a431879f0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:18.924749 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a304b188-31c1-4569-98f6-759a431879f0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1407 microversion: 2.20 time: 0.225606 Dec 15 12:40:18.925315 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 65/131] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:40:18 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:40:18.931955 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-331a56a5-7c0c-4eae-b545-9cd5bc80d4e7 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:18.932563 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-331a56a5-7c0c-4eae-b545-9cd5bc80d4e7 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:18.939757 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-331a56a5-7c0c-4eae-b545-9cd5bc80d4e7 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:18.940208 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-331a56a5-7c0c-4eae-b545-9cd5bc80d4e7 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:18.941003 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-331a56a5-7c0c-4eae-b545-9cd5bc80d4e7 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:18.941443 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-331a56a5-7c0c-4eae-b545-9cd5bc80d4e7 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:19.024346 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4e52afeb-5999-424f-9ac3-3c6a7e12af09 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:19.032298 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4e52afeb-5999-424f-9ac3-3c6a7e12af09 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1322 microversion: 2.1 time: 0.209541 Dec 15 12:40:19.032871 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 67/132] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:18 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:19.098016 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-331a56a5-7c0c-4eae-b545-9cd5bc80d4e7 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:19.105191 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-331a56a5-7c0c-4eae-b545-9cd5bc80d4e7 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1313 microversion: 2.1 time: 0.176936 Dec 15 12:40:19.105763 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 66/133] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:18 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:19.727375 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-cfa73bb0-43b6-4e4a-9f14-fa56cfb20260 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:19.728078 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-cfa73bb0-43b6-4e4a-9f14-fa56cfb20260 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:19.734124 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cfa73bb0-43b6-4e4a-9f14-fa56cfb20260 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:19.734562 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cfa73bb0-43b6-4e4a-9f14-fa56cfb20260 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:19.735323 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cfa73bb0-43b6-4e4a-9f14-fa56cfb20260 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:19.735742 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cfa73bb0-43b6-4e4a-9f14-fa56cfb20260 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:19.896589 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-cfa73bb0-43b6-4e4a-9f14-fa56cfb20260 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:19.906716 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cfa73bb0-43b6-4e4a-9f14-fa56cfb20260 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1316 microversion: 2.1 time: 0.182911 Dec 15 12:40:19.907305 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 68/134] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:19 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1316 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:19.943843 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-86fa752e-0d90-42e1-89fb-5ff3b518be05 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:19.944451 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-86fa752e-0d90-42e1-89fb-5ff3b518be05 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:19.951275 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-86fa752e-0d90-42e1-89fb-5ff3b518be05 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:19.951798 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-86fa752e-0d90-42e1-89fb-5ff3b518be05 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:19.952626 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-86fa752e-0d90-42e1-89fb-5ff3b518be05 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:19.953059 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-86fa752e-0d90-42e1-89fb-5ff3b518be05 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:20.022747 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [req-29125cc3-5123-403b-808e-29f618a06238 req-6939434e-0127-465e-b39b-c1b37cea062c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a57f09a7-71bf-49d0-9ee5-fe5c4aa09638", "name": "network-vif-plugged", "status": "completed", "tag": "156bfc68-a57b-4095-8995-41bca77b20eb"}, {"server_uuid": "1ee02333-4fb9-4dfb-bc00-f57402d7c612", "name": "network-vif-plugged", "status": "completed", "tag": "457daa7c-40b7-4e38-87bc-a288b566ffa6"}, {"server_uuid": "2824788a-14d6-488d-8af1-2df6b3de771a", "name": "network-vif-plugged", "status": "completed", "tag": "e4f59a42-9884-4311-ab2f-2c6eb2422029"}, {"server_uuid": "d089a72b-31ce-47c8-bb6c-ea26a1c4dde0", "name": "network-vif-plugged", "status": "completed", "tag": "90461b16-9e90-4272-a714-ccf84be0bb08"}]} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:20.024702 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:40:20.024702 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: warnings.warn(msg) Dec 15 12:40:20.033357 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-29125cc3-5123-403b-808e-29f618a06238 req-6939434e-0127-465e-b39b-c1b37cea062c service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:20.033833 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-29125cc3-5123-403b-808e-29f618a06238 req-6939434e-0127-465e-b39b-c1b37cea062c service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:20.056513 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.compute.server_external_events [req-29125cc3-5123-403b-808e-29f618a06238 req-6939434e-0127-465e-b39b-c1b37cea062c service nova] Creating event network-vif-plugged:156bfc68-a57b-4095-8995-41bca77b20eb for instance a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 on hv-cinder-81322 Dec 15 12:40:20.056513 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.compute.server_external_events [req-29125cc3-5123-403b-808e-29f618a06238 req-6939434e-0127-465e-b39b-c1b37cea062c service nova] Creating event network-vif-plugged:457daa7c-40b7-4e38-87bc-a288b566ffa6 for instance 1ee02333-4fb9-4dfb-bc00-f57402d7c612 on hv-cinder-81322 Dec 15 12:40:20.056513 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.compute.server_external_events [req-29125cc3-5123-403b-808e-29f618a06238 req-6939434e-0127-465e-b39b-c1b37cea062c service nova] Creating event network-vif-plugged:e4f59a42-9884-4311-ab2f-2c6eb2422029 for instance 2824788a-14d6-488d-8af1-2df6b3de771a on hv-cinder-81322 Dec 15 12:40:20.056513 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.compute.server_external_events [req-29125cc3-5123-403b-808e-29f618a06238 req-6939434e-0127-465e-b39b-c1b37cea062c service nova] Creating event network-vif-plugged:90461b16-9e90-4272-a714-ccf84be0bb08 for instance d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 on hv-cinder-81322 Dec 15 12:40:20.062221 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [req-29125cc3-5123-403b-808e-29f618a06238 req-6939434e-0127-465e-b39b-c1b37cea062c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.042967 Dec 15 12:40:20.062833 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 69/135] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 12:40:20 2021] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:40:20.067651 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a65f8d52-bedc-4c09-a661-fe5cf7c9080e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:20.068349 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a65f8d52-bedc-4c09-a661-fe5cf7c9080e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:20.074932 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a65f8d52-bedc-4c09-a661-fe5cf7c9080e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:20.076043 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a65f8d52-bedc-4c09-a661-fe5cf7c9080e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:20.076857 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a65f8d52-bedc-4c09-a661-fe5cf7c9080e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:20.077286 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a65f8d52-bedc-4c09-a661-fe5cf7c9080e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:20.093182 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-86fa752e-0d90-42e1-89fb-5ff3b518be05 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:20.101242 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-86fa752e-0d90-42e1-89fb-5ff3b518be05 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:20.102865 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-86fa752e-0d90-42e1-89fb-5ff3b518be05 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:20.104008 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-86fa752e-0d90-42e1-89fb-5ff3b518be05 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1407 microversion: 2.20 time: 0.163791 Dec 15 12:40:20.104573 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 67/136] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:40:19 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:40:20.124281 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fa1bbfa8-c982-4286-92f6-44597e827902 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:20.124987 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fa1bbfa8-c982-4286-92f6-44597e827902 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:20.131343 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fa1bbfa8-c982-4286-92f6-44597e827902 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:20.131873 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fa1bbfa8-c982-4286-92f6-44597e827902 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:20.132725 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fa1bbfa8-c982-4286-92f6-44597e827902 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:20.133226 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fa1bbfa8-c982-4286-92f6-44597e827902 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:20.244467 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a65f8d52-bedc-4c09-a661-fe5cf7c9080e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:20.252865 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a65f8d52-bedc-4c09-a661-fe5cf7c9080e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1322 microversion: 2.1 time: 0.188638 Dec 15 12:40:20.253563 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 70/137] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:20 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:20.305938 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-fa1bbfa8-c982-4286-92f6-44597e827902 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:20.314672 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fa1bbfa8-c982-4286-92f6-44597e827902 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1313 microversion: 2.1 time: 0.195280 Dec 15 12:40:20.315467 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 68/138] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:20 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:20.925035 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-41f7dadf-d39a-4e2f-b701-584629578f1b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:20.925947 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-41f7dadf-d39a-4e2f-b701-584629578f1b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:20.934893 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-41f7dadf-d39a-4e2f-b701-584629578f1b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:20.939199 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-41f7dadf-d39a-4e2f-b701-584629578f1b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:20.940312 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-41f7dadf-d39a-4e2f-b701-584629578f1b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:20.943102 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-41f7dadf-d39a-4e2f-b701-584629578f1b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:21.124817 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5e625585-bc02-4172-8303-c5c4addd0523 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:21.126099 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5e625585-bc02-4172-8303-c5c4addd0523 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:21.133714 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5e625585-bc02-4172-8303-c5c4addd0523 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:21.134480 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5e625585-bc02-4172-8303-c5c4addd0523 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:21.135416 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5e625585-bc02-4172-8303-c5c4addd0523 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:21.135986 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5e625585-bc02-4172-8303-c5c4addd0523 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:21.205153 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-41f7dadf-d39a-4e2f-b701-584629578f1b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:21.213104 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-41f7dadf-d39a-4e2f-b701-584629578f1b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1316 microversion: 2.1 time: 0.292842 Dec 15 12:40:21.213714 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 71/139] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:20 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1316 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:21.269263 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c1ac191d-89bb-4a8d-b732-772268ef2bb1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:21.269981 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c1ac191d-89bb-4a8d-b732-772268ef2bb1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:21.276345 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c1ac191d-89bb-4a8d-b732-772268ef2bb1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:21.276865 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c1ac191d-89bb-4a8d-b732-772268ef2bb1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:21.277692 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c1ac191d-89bb-4a8d-b732-772268ef2bb1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:21.278189 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c1ac191d-89bb-4a8d-b732-772268ef2bb1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:21.312403 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5e625585-bc02-4172-8303-c5c4addd0523 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:21.322012 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5e625585-bc02-4172-8303-c5c4addd0523 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:21.323587 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5e625585-bc02-4172-8303-c5c4addd0523 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:21.324678 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5e625585-bc02-4172-8303-c5c4addd0523 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1407 microversion: 2.20 time: 0.205326 Dec 15 12:40:21.326686 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 69/140] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:40:21 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:40:21.332757 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ca14caee-9f6a-4b0a-8bfc-943ab7fd69ec tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:21.333423 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ca14caee-9f6a-4b0a-8bfc-943ab7fd69ec tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:21.341732 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ca14caee-9f6a-4b0a-8bfc-943ab7fd69ec tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:21.342450 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ca14caee-9f6a-4b0a-8bfc-943ab7fd69ec tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:21.343412 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ca14caee-9f6a-4b0a-8bfc-943ab7fd69ec tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:21.343905 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ca14caee-9f6a-4b0a-8bfc-943ab7fd69ec tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:21.808609 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c1ac191d-89bb-4a8d-b732-772268ef2bb1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:21.816912 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c1ac191d-89bb-4a8d-b732-772268ef2bb1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1322 microversion: 2.1 time: 0.551773 Dec 15 12:40:21.817658 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 72/141] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:21 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1322 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:21.848651 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ca14caee-9f6a-4b0a-8bfc-943ab7fd69ec tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:21.855946 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ca14caee-9f6a-4b0a-8bfc-943ab7fd69ec tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1313 microversion: 2.1 time: 0.527734 Dec 15 12:40:21.857096 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 70/142] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:21 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1313 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:22.229801 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-64c34726-2bde-4292-b7b2-fa3854a58be2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:22.230484 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-64c34726-2bde-4292-b7b2-fa3854a58be2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:22.237475 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-64c34726-2bde-4292-b7b2-fa3854a58be2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:22.239388 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-64c34726-2bde-4292-b7b2-fa3854a58be2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:22.240254 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-64c34726-2bde-4292-b7b2-fa3854a58be2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:22.240829 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-64c34726-2bde-4292-b7b2-fa3854a58be2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:22.343863 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b713e08b-c28f-47d4-820c-9b22e0bb2600 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:22.344497 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b713e08b-c28f-47d4-820c-9b22e0bb2600 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:22.352978 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b713e08b-c28f-47d4-820c-9b22e0bb2600 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:22.354265 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b713e08b-c28f-47d4-820c-9b22e0bb2600 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:22.355326 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b713e08b-c28f-47d4-820c-9b22e0bb2600 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:22.355927 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b713e08b-c28f-47d4-820c-9b22e0bb2600 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:22.440601 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-64c34726-2bde-4292-b7b2-fa3854a58be2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:22.454441 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-64c34726-2bde-4292-b7b2-fa3854a58be2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1316 microversion: 2.1 time: 0.228294 Dec 15 12:40:22.455039 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 73/143] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:22 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1316 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:22.532985 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b713e08b-c28f-47d4-820c-9b22e0bb2600 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:22.541230 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b713e08b-c28f-47d4-820c-9b22e0bb2600 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:22.542747 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b713e08b-c28f-47d4-820c-9b22e0bb2600 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:22.543943 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b713e08b-c28f-47d4-820c-9b22e0bb2600 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1407 microversion: 2.20 time: 0.204446 Dec 15 12:40:22.544502 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 71/144] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:40:22 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:40:22.833802 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-387790a7-f952-47f4-acfd-e6917937f6cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:22.834352 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-387790a7-f952-47f4-acfd-e6917937f6cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:22.840633 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-387790a7-f952-47f4-acfd-e6917937f6cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:22.841561 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-387790a7-f952-47f4-acfd-e6917937f6cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:22.842351 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-387790a7-f952-47f4-acfd-e6917937f6cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:22.842785 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-387790a7-f952-47f4-acfd-e6917937f6cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:22.874368 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4a72a310-864f-4432-8e20-9d5cfb95a1ef tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:22.875264 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4a72a310-864f-4432-8e20-9d5cfb95a1ef tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:22.883543 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4a72a310-864f-4432-8e20-9d5cfb95a1ef tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:22.883990 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4a72a310-864f-4432-8e20-9d5cfb95a1ef tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:22.884814 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4a72a310-864f-4432-8e20-9d5cfb95a1ef tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:22.885287 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4a72a310-864f-4432-8e20-9d5cfb95a1ef tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:23.102842 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-387790a7-f952-47f4-acfd-e6917937f6cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:23.110517 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-387790a7-f952-47f4-acfd-e6917937f6cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1322 microversion: 2.1 time: 0.280559 Dec 15 12:40:23.119948 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 74/145] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:22 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:23.133207 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4a72a310-864f-4432-8e20-9d5cfb95a1ef tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:23.141092 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4a72a310-864f-4432-8e20-9d5cfb95a1ef tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1313 microversion: 2.1 time: 0.271252 Dec 15 12:40:23.141859 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 72/146] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:22 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:23.471607 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8f7335d3-60a6-4208-9b52-669ee87dca51 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:23.473046 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8f7335d3-60a6-4208-9b52-669ee87dca51 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:23.480670 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8f7335d3-60a6-4208-9b52-669ee87dca51 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:23.481479 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8f7335d3-60a6-4208-9b52-669ee87dca51 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:23.483317 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8f7335d3-60a6-4208-9b52-669ee87dca51 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:23.484068 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8f7335d3-60a6-4208-9b52-669ee87dca51 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:23.562526 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3d454a44-25d1-4550-8a77-6a3ab076536d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:23.563165 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3d454a44-25d1-4550-8a77-6a3ab076536d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:23.574407 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3d454a44-25d1-4550-8a77-6a3ab076536d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:23.574930 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3d454a44-25d1-4550-8a77-6a3ab076536d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:23.576002 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3d454a44-25d1-4550-8a77-6a3ab076536d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:23.577830 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3d454a44-25d1-4550-8a77-6a3ab076536d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:23.913197 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8f7335d3-60a6-4208-9b52-669ee87dca51 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:23.917804 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3d454a44-25d1-4550-8a77-6a3ab076536d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:23.938020 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3d454a44-25d1-4550-8a77-6a3ab076536d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:23.938562 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8f7335d3-60a6-4208-9b52-669ee87dca51 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1316 microversion: 2.1 time: 0.468812 Dec 15 12:40:23.939540 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 75/147] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:23 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:23.941804 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3d454a44-25d1-4550-8a77-6a3ab076536d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:23.943345 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3d454a44-25d1-4550-8a77-6a3ab076536d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1407 microversion: 2.20 time: 0.385388 Dec 15 12:40:23.944266 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 73/148] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:40:23 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1407 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:40:24.131600 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-224d7d2d-112e-47b2-bd7d-ead417b82df5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:24.132694 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-224d7d2d-112e-47b2-bd7d-ead417b82df5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:24.139911 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-224d7d2d-112e-47b2-bd7d-ead417b82df5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:24.140608 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-224d7d2d-112e-47b2-bd7d-ead417b82df5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:24.141749 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-224d7d2d-112e-47b2-bd7d-ead417b82df5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:24.142520 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-224d7d2d-112e-47b2-bd7d-ead417b82df5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:24.159926 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-59f6fa8c-4b9b-4032-80d5-53102c1f7d1e tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:24.160834 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-59f6fa8c-4b9b-4032-80d5-53102c1f7d1e tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:24.177108 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-59f6fa8c-4b9b-4032-80d5-53102c1f7d1e tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:24.178656 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-59f6fa8c-4b9b-4032-80d5-53102c1f7d1e tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:24.180606 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-59f6fa8c-4b9b-4032-80d5-53102c1f7d1e tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:24.181419 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-59f6fa8c-4b9b-4032-80d5-53102c1f7d1e tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:24.520075 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-224d7d2d-112e-47b2-bd7d-ead417b82df5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:24.532831 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-224d7d2d-112e-47b2-bd7d-ead417b82df5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1322 microversion: 2.1 time: 0.405673 Dec 15 12:40:24.533454 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 76/149] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:24 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:24.540823 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-59f6fa8c-4b9b-4032-80d5-53102c1f7d1e tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:24.549938 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-59f6fa8c-4b9b-4032-80d5-53102c1f7d1e tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1313 microversion: 2.1 time: 0.394954 Dec 15 12:40:24.550533 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 74/150] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:24 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1313 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:24.969063 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e17d8de6-1213-41c2-883a-723893237a6a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:24.969823 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d2634424-eb4e-4a5e-b7a2-52b027dd9b7f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:24.969823 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d2634424-eb4e-4a5e-b7a2-52b027dd9b7f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:24.970012 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e17d8de6-1213-41c2-883a-723893237a6a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:24.977059 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d2634424-eb4e-4a5e-b7a2-52b027dd9b7f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:24.977538 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d2634424-eb4e-4a5e-b7a2-52b027dd9b7f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:24.978305 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d2634424-eb4e-4a5e-b7a2-52b027dd9b7f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:24.978737 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d2634424-eb4e-4a5e-b7a2-52b027dd9b7f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:24.978859 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e17d8de6-1213-41c2-883a-723893237a6a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:24.979211 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e17d8de6-1213-41c2-883a-723893237a6a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:24.980009 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e17d8de6-1213-41c2-883a-723893237a6a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:24.980449 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e17d8de6-1213-41c2-883a-723893237a6a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:25.264183 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d2634424-eb4e-4a5e-b7a2-52b027dd9b7f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:25.271669 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d2634424-eb4e-4a5e-b7a2-52b027dd9b7f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:25.273165 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d2634424-eb4e-4a5e-b7a2-52b027dd9b7f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:25.274356 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d2634424-eb4e-4a5e-b7a2-52b027dd9b7f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1599 microversion: 2.20 time: 0.309482 Dec 15 12:40:25.288086 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e17d8de6-1213-41c2-883a-723893237a6a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:25.288086 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e17d8de6-1213-41c2-883a-723893237a6a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1505 microversion: 2.1 time: 0.320740 Dec 15 12:40:25.288721 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 77/151] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:40:24 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1599 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:40:25.293839 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fa89e089-b74f-494f-b2a9-776f704f1e3e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:25.294653 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fa89e089-b74f-494f-b2a9-776f704f1e3e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:25.300801 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fa89e089-b74f-494f-b2a9-776f704f1e3e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:25.301262 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fa89e089-b74f-494f-b2a9-776f704f1e3e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:25.302058 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fa89e089-b74f-494f-b2a9-776f704f1e3e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:25.302486 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fa89e089-b74f-494f-b2a9-776f704f1e3e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:25.317982 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 75/152] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:24 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1505 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:25.443853 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fa89e089-b74f-494f-b2a9-776f704f1e3e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.153641 Dec 15 12:40:25.444448 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 78/153] 10.222.0.76 () {60 vars in 1315 bytes} [Wed Dec 15 12:40:25 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-interface => generated 284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:40:25.554065 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-08fafc45-f113-4775-bbd1-dd4481599d7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:25.554974 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-08fafc45-f113-4775-bbd1-dd4481599d7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:25.568708 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1bfac791-c5a2-43c2-a91a-d18c25f69b03 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:25.570674 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1bfac791-c5a2-43c2-a91a-d18c25f69b03 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:25.575396 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-08fafc45-f113-4775-bbd1-dd4481599d7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:25.580720 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-08fafc45-f113-4775-bbd1-dd4481599d7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:25.581822 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-08fafc45-f113-4775-bbd1-dd4481599d7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:25.582851 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1bfac791-c5a2-43c2-a91a-d18c25f69b03 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:25.583672 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1bfac791-c5a2-43c2-a91a-d18c25f69b03 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:25.584353 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-08fafc45-f113-4775-bbd1-dd4481599d7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:25.586499 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1bfac791-c5a2-43c2-a91a-d18c25f69b03 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:25.587341 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1bfac791-c5a2-43c2-a91a-d18c25f69b03 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:25.906799 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1bfac791-c5a2-43c2-a91a-d18c25f69b03 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:25.919020 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1bfac791-c5a2-43c2-a91a-d18c25f69b03 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1501 microversion: 2.1 time: 0.354734 Dec 15 12:40:25.920341 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 79/154] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:25 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1501 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:25.924019 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-08fafc45-f113-4775-bbd1-dd4481599d7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:25.931738 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-08fafc45-f113-4775-bbd1-dd4481599d7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1515 microversion: 2.1 time: 0.382755 Dec 15 12:40:25.934252 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 76/155] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:25 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1515 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:25.951790 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ce031c42-c041-4747-9ae8-ae4694c7f07d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:25.952802 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ce031c42-c041-4747-9ae8-ae4694c7f07d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:25.972692 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ce031c42-c041-4747-9ae8-ae4694c7f07d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:25.973426 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ce031c42-c041-4747-9ae8-ae4694c7f07d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:25.974433 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ce031c42-c041-4747-9ae8-ae4694c7f07d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:25.975004 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ce031c42-c041-4747-9ae8-ae4694c7f07d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:26.016328 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.objects.instance [None req-ce031c42-c041-4747-9ae8-ae4694c7f07d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lazy-loading 'flavor' on Instance uuid a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 {{(pid=122615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 12:40:26.281860 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ce031c42-c041-4747-9ae8-ae4694c7f07d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "POST /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638/action" status: 200 len: 32 microversion: 2.1 time: 0.334665 Dec 15 12:40:26.284191 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 80/156] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 12:40:25 2021] POST /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638/action => generated 32 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 12:40:26.292760 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-258974c4-f4a4-4ab1-8459-8f8ecf49aeef tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:26.303967 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-258974c4-f4a4-4ab1-8459-8f8ecf49aeef tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:26.313449 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-258974c4-f4a4-4ab1-8459-8f8ecf49aeef tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:26.313981 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-258974c4-f4a4-4ab1-8459-8f8ecf49aeef tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:26.314846 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-258974c4-f4a4-4ab1-8459-8f8ecf49aeef tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:26.315357 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-258974c4-f4a4-4ab1-8459-8f8ecf49aeef tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:26.536740 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-258974c4-f4a4-4ab1-8459-8f8ecf49aeef tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:26.544869 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-258974c4-f4a4-4ab1-8459-8f8ecf49aeef tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1521 microversion: 2.1 time: 0.255715 Dec 15 12:40:26.545923 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 77/157] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:26 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:27.257128 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a9c66091-3836-47a7-b08f-d8a4c5a874d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:27.258224 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a9c66091-3836-47a7-b08f-d8a4c5a874d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:27.281537 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a9c66091-3836-47a7-b08f-d8a4c5a874d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:27.282030 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a9c66091-3836-47a7-b08f-d8a4c5a874d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:27.282832 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a9c66091-3836-47a7-b08f-d8a4c5a874d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:27.283262 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a9c66091-3836-47a7-b08f-d8a4c5a874d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:27.283600 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-1da07de0-c62b-48bc-a360-ee8ac7cd3115 req-0436ebfb-4e48-48d1-9b3a-6ebe70cefe45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2", "tag": "67d867cb-3a0f-4a77-8182-0e96b6df907f"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:27.285267 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:40:27.285267 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 12:40:27.300836 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-1da07de0-c62b-48bc-a360-ee8ac7cd3115 req-0436ebfb-4e48-48d1-9b3a-6ebe70cefe45 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:27.302207 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-1da07de0-c62b-48bc-a360-ee8ac7cd3115 req-0436ebfb-4e48-48d1-9b3a-6ebe70cefe45 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:27.336630 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-1da07de0-c62b-48bc-a360-ee8ac7cd3115 req-0436ebfb-4e48-48d1-9b3a-6ebe70cefe45 service nova] Creating event network-changed:67d867cb-3a0f-4a77-8182-0e96b6df907f for instance ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 on hv-cinder-81322 Dec 15 12:40:27.348102 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-1da07de0-c62b-48bc-a360-ee8ac7cd3115 req-0436ebfb-4e48-48d1-9b3a-6ebe70cefe45 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065461 Dec 15 12:40:27.349185 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 78/158] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 12:40:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:40:27.564237 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8001abed-b9a5-4341-b414-8696da9432c0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:27.565108 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8001abed-b9a5-4341-b414-8696da9432c0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:27.578524 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8001abed-b9a5-4341-b414-8696da9432c0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:27.579231 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8001abed-b9a5-4341-b414-8696da9432c0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:27.580171 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8001abed-b9a5-4341-b414-8696da9432c0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:27.580766 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8001abed-b9a5-4341-b414-8696da9432c0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:27.756582 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-8001abed-b9a5-4341-b414-8696da9432c0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:27.766443 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8001abed-b9a5-4341-b414-8696da9432c0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1521 microversion: 2.1 time: 0.207341 Dec 15 12:40:27.767726 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 79/159] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:27 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:28.421497 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a9c66091-3836-47a7-b08f-d8a4c5a874d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 14 microversion: 2.20 time: 1.168349 Dec 15 12:40:28.422718 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 81/160] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:40:27 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 14 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:28.785622 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d0f8b324-15d0-4782-9bb4-4fe68a24eca2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:28.786450 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d0f8b324-15d0-4782-9bb4-4fe68a24eca2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:28.795371 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d0f8b324-15d0-4782-9bb4-4fe68a24eca2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:28.797458 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d0f8b324-15d0-4782-9bb4-4fe68a24eca2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:28.798657 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d0f8b324-15d0-4782-9bb4-4fe68a24eca2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:28.800392 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d0f8b324-15d0-4782-9bb4-4fe68a24eca2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:28.986832 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-87a25132-26f5-4ad2-9f66-06eb057e2e20 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbfa16bf-6643-41ad-8c75-759412a0291f"}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:28.995525 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-87a25132-26f5-4ad2-9f66-06eb057e2e20 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:29.033661 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-87a25132-26f5-4ad2-9f66-06eb057e2e20 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:29.037536 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-87a25132-26f5-4ad2-9f66-06eb057e2e20 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:29.041906 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-87a25132-26f5-4ad2-9f66-06eb057e2e20 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:29.043005 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-87a25132-26f5-4ad2-9f66-06eb057e2e20 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:29.201234 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d0f8b324-15d0-4782-9bb4-4fe68a24eca2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:29.210531 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d0f8b324-15d0-4782-9bb4-4fe68a24eca2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1521 microversion: 2.1 time: 0.427468 Dec 15 12:40:29.212006 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 80/161] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:28 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1521 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:29.433840 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-dea51202-5c7a-46a9-ba6a-582951822273 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:29.435715 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-dea51202-5c7a-46a9-ba6a-582951822273 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:29.461704 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dea51202-5c7a-46a9-ba6a-582951822273 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:29.462156 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dea51202-5c7a-46a9-ba6a-582951822273 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:29.462957 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dea51202-5c7a-46a9-ba6a-582951822273 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:29.463393 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dea51202-5c7a-46a9-ba6a-582951822273 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:29.675835 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-dea51202-5c7a-46a9-ba6a-582951822273 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 14 microversion: 2.20 time: 0.245533 Dec 15 12:40:29.677289 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 81/162] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:40:29 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 14 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:29.689480 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5e3defaa-cdc1-4ca2-b2bc-77f02aa013cb tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cdc2f61-3862-44ed-92e7-3eccc5d7b7d4"}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:29.691027 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5e3defaa-cdc1-4ca2-b2bc-77f02aa013cb tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:29.701247 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5e3defaa-cdc1-4ca2-b2bc-77f02aa013cb tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:29.702397 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5e3defaa-cdc1-4ca2-b2bc-77f02aa013cb tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:29.703882 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5e3defaa-cdc1-4ca2-b2bc-77f02aa013cb tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:29.704639 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5e3defaa-cdc1-4ca2-b2bc-77f02aa013cb tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:29.730926 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-87a25132-26f5-4ad2-9f66-06eb057e2e20 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "POST /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.753070 Dec 15 12:40:29.734549 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 82/163] 10.222.0.76 () {60 vars in 1322 bytes} [Wed Dec 15 12:40:28 2021] POST /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0/os-volume_attachments => generated 194 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:40:30.192808 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5e3defaa-cdc1-4ca2-b2bc-77f02aa013cb tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "POST /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.512494 Dec 15 12:40:30.193443 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 82/164] 10.222.0.76 () {60 vars in 1322 bytes} [Wed Dec 15 12:40:29 2021] POST /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612/os-volume_attachments => generated 194 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:40:30.236044 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d018b973-9eaf-495e-875f-e83cbc09f6ec tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:30.236806 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d018b973-9eaf-495e-875f-e83cbc09f6ec tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:30.245874 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d018b973-9eaf-495e-875f-e83cbc09f6ec tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:30.250505 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d018b973-9eaf-495e-875f-e83cbc09f6ec tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:30.254342 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d018b973-9eaf-495e-875f-e83cbc09f6ec tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:30.256611 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d018b973-9eaf-495e-875f-e83cbc09f6ec tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:30.431798 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d018b973-9eaf-495e-875f-e83cbc09f6ec tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:30.441430 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d018b973-9eaf-495e-875f-e83cbc09f6ec tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1521 microversion: 2.1 time: 0.215895 Dec 15 12:40:30.452608 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 83/165] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:30 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:30.690465 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-df04087e-dfe7-437a-9bd4-873c22d56dc2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:30.691620 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-df04087e-dfe7-437a-9bd4-873c22d56dc2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:30.699258 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df04087e-dfe7-437a-9bd4-873c22d56dc2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:30.701223 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df04087e-dfe7-437a-9bd4-873c22d56dc2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:30.702179 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df04087e-dfe7-437a-9bd4-873c22d56dc2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:30.702863 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df04087e-dfe7-437a-9bd4-873c22d56dc2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:30.776572 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-df04087e-dfe7-437a-9bd4-873c22d56dc2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 14 microversion: 2.20 time: 0.091543 Dec 15 12:40:30.777212 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 83/166] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:40:30 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:31.459118 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-09fc7f7b-80f6-4621-b22f-59b26ccdd084 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:31.459800 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-09fc7f7b-80f6-4621-b22f-59b26ccdd084 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:31.466015 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-09fc7f7b-80f6-4621-b22f-59b26ccdd084 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:31.466491 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-09fc7f7b-80f6-4621-b22f-59b26ccdd084 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:31.470431 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-09fc7f7b-80f6-4621-b22f-59b26ccdd084 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:31.470431 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-09fc7f7b-80f6-4621-b22f-59b26ccdd084 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:31.619634 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-09fc7f7b-80f6-4621-b22f-59b26ccdd084 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:31.630529 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-09fc7f7b-80f6-4621-b22f-59b26ccdd084 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1521 microversion: 2.1 time: 0.174564 Dec 15 12:40:31.631801 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 84/167] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:31 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:31.788264 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-59f65121-1be0-4d47-8db8-238fab6c80c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:31.789291 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-59f65121-1be0-4d47-8db8-238fab6c80c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:31.797285 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-59f65121-1be0-4d47-8db8-238fab6c80c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:31.797775 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-59f65121-1be0-4d47-8db8-238fab6c80c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:31.798563 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-59f65121-1be0-4d47-8db8-238fab6c80c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:31.799036 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-59f65121-1be0-4d47-8db8-238fab6c80c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:31.878426 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-59f65121-1be0-4d47-8db8-238fab6c80c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 14 microversion: 2.20 time: 0.094378 Dec 15 12:40:31.879506 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 84/168] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:40:31 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:32.648857 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-66d9fe84-1d0c-4e5a-8b6d-011a9aaf4c65 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:32.649469 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-66d9fe84-1d0c-4e5a-8b6d-011a9aaf4c65 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:32.657579 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66d9fe84-1d0c-4e5a-8b6d-011a9aaf4c65 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:32.658100 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66d9fe84-1d0c-4e5a-8b6d-011a9aaf4c65 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:32.658957 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66d9fe84-1d0c-4e5a-8b6d-011a9aaf4c65 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:32.659756 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66d9fe84-1d0c-4e5a-8b6d-011a9aaf4c65 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:32.882775 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-66d9fe84-1d0c-4e5a-8b6d-011a9aaf4c65 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:32.895719 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-66d9fe84-1d0c-4e5a-8b6d-011a9aaf4c65 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1521 microversion: 2.1 time: 0.250356 Dec 15 12:40:32.896286 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 85/169] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:32 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:32.898872 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-03b6079b-7320-42ad-bf81-bd04405c39f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:32.901150 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-03b6079b-7320-42ad-bf81-bd04405c39f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:32.912178 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-03b6079b-7320-42ad-bf81-bd04405c39f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:32.912631 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-03b6079b-7320-42ad-bf81-bd04405c39f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:32.913451 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-03b6079b-7320-42ad-bf81-bd04405c39f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:32.913931 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-03b6079b-7320-42ad-bf81-bd04405c39f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:33.914069 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d2476aa4-c9ed-4d57-861b-7a50dfea74ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:33.914994 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d2476aa4-c9ed-4d57-861b-7a50dfea74ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:33.922623 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d2476aa4-c9ed-4d57-861b-7a50dfea74ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:33.923196 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d2476aa4-c9ed-4d57-861b-7a50dfea74ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:33.924176 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d2476aa4-c9ed-4d57-861b-7a50dfea74ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:33.924754 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d2476aa4-c9ed-4d57-861b-7a50dfea74ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:34.091863 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d2476aa4-c9ed-4d57-861b-7a50dfea74ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:34.101923 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d2476aa4-c9ed-4d57-861b-7a50dfea74ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1521 microversion: 2.1 time: 0.191702 Dec 15 12:40:34.112613 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 86/170] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:33 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:35.119532 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6e688196-48f0-443c-bec7-281b12db0402 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:35.120591 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6e688196-48f0-443c-bec7-281b12db0402 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:35.131157 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6e688196-48f0-443c-bec7-281b12db0402 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:35.131157 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6e688196-48f0-443c-bec7-281b12db0402 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:35.131533 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6e688196-48f0-443c-bec7-281b12db0402 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:35.132149 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6e688196-48f0-443c-bec7-281b12db0402 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:35.309844 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6e688196-48f0-443c-bec7-281b12db0402 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:35.317474 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6e688196-48f0-443c-bec7-281b12db0402 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1521 microversion: 2.1 time: 0.201980 Dec 15 12:40:35.318084 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 87/171] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:35 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:35.416186 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-03b6079b-7320-42ad-bf81-bd04405c39f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 14 microversion: 2.20 time: 2.528253 Dec 15 12:40:35.416976 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 85/172] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:40:32 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 14 bytes in 2532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:36.345356 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f9b73644-d737-4eb7-8d2e-78a7e5f5e970 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:36.346006 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f9b73644-d737-4eb7-8d2e-78a7e5f5e970 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:36.358576 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f9b73644-d737-4eb7-8d2e-78a7e5f5e970 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:36.359236 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f9b73644-d737-4eb7-8d2e-78a7e5f5e970 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:36.360196 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f9b73644-d737-4eb7-8d2e-78a7e5f5e970 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:36.360777 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f9b73644-d737-4eb7-8d2e-78a7e5f5e970 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:36.430284 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9e916665-86f3-4be6-badf-34962031f3ad tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:36.431711 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9e916665-86f3-4be6-badf-34962031f3ad tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:36.445605 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9e916665-86f3-4be6-badf-34962031f3ad tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:36.446814 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9e916665-86f3-4be6-badf-34962031f3ad tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:36.447881 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9e916665-86f3-4be6-badf-34962031f3ad tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:36.448550 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9e916665-86f3-4be6-badf-34962031f3ad tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:36.520070 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-f9b73644-d737-4eb7-8d2e-78a7e5f5e970 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:36.527584 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f9b73644-d737-4eb7-8d2e-78a7e5f5e970 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1521 microversion: 2.1 time: 0.194726 Dec 15 12:40:36.528295 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 88/173] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:36 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:36.542486 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9e916665-86f3-4be6-badf-34962031f3ad tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 14 microversion: 2.20 time: 0.117041 Dec 15 12:40:36.547106 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 86/174] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:40:36 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:37.545858 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7bbd8f4f-cb06-4f3b-b1a2-42de98d5e65f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:37.547172 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7bbd8f4f-cb06-4f3b-b1a2-42de98d5e65f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:37.554905 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-23fbd256-fab0-4327-b323-51d0e7b137fb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:37.555952 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-23fbd256-fab0-4327-b323-51d0e7b137fb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:37.557224 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7bbd8f4f-cb06-4f3b-b1a2-42de98d5e65f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:37.558701 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7bbd8f4f-cb06-4f3b-b1a2-42de98d5e65f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:37.559950 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7bbd8f4f-cb06-4f3b-b1a2-42de98d5e65f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:37.560819 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7bbd8f4f-cb06-4f3b-b1a2-42de98d5e65f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:37.562947 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-23fbd256-fab0-4327-b323-51d0e7b137fb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:37.563395 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-23fbd256-fab0-4327-b323-51d0e7b137fb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:37.564173 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-23fbd256-fab0-4327-b323-51d0e7b137fb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:37.564599 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-23fbd256-fab0-4327-b323-51d0e7b137fb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:37.726584 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7bbd8f4f-cb06-4f3b-b1a2-42de98d5e65f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:37.734453 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7bbd8f4f-cb06-4f3b-b1a2-42de98d5e65f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1521 microversion: 2.1 time: 0.192356 Dec 15 12:40:37.735039 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 89/175] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:37 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:38.751458 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3c5d4802-ee57-4f1e-94a7-af1b63ddcf6e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:38.752081 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3c5d4802-ee57-4f1e-94a7-af1b63ddcf6e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:38.758836 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c5d4802-ee57-4f1e-94a7-af1b63ddcf6e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:38.759281 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c5d4802-ee57-4f1e-94a7-af1b63ddcf6e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:38.760065 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c5d4802-ee57-4f1e-94a7-af1b63ddcf6e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:38.760490 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c5d4802-ee57-4f1e-94a7-af1b63ddcf6e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:38.896287 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3c5d4802-ee57-4f1e-94a7-af1b63ddcf6e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:38.904650 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3c5d4802-ee57-4f1e-94a7-af1b63ddcf6e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1521 microversion: 2.1 time: 0.156996 Dec 15 12:40:38.905566 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 90/176] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:38 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:39.922685 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-afb3afe9-ae81-4afd-b5a6-04be240213bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:39.923314 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-afb3afe9-ae81-4afd-b5a6-04be240213bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:39.929805 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afb3afe9-ae81-4afd-b5a6-04be240213bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:39.930275 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afb3afe9-ae81-4afd-b5a6-04be240213bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:39.931249 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afb3afe9-ae81-4afd-b5a6-04be240213bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:39.931689 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afb3afe9-ae81-4afd-b5a6-04be240213bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:39.995406 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-23fbd256-fab0-4327-b323-51d0e7b137fb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 14 microversion: 2.20 time: 2.444523 Dec 15 12:40:39.997368 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 87/177] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:40:37 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 14 bytes in 2448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:40.102008 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-afb3afe9-ae81-4afd-b5a6-04be240213bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:40.110039 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-afb3afe9-ae81-4afd-b5a6-04be240213bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1521 microversion: 2.1 time: 0.191664 Dec 15 12:40:40.110798 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 91/178] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:39 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:41.009417 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0684281b-5ac9-4408-a3bf-dc5ec27b66d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:41.010533 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0684281b-5ac9-4408-a3bf-dc5ec27b66d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:41.020772 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0684281b-5ac9-4408-a3bf-dc5ec27b66d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:41.029632 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0684281b-5ac9-4408-a3bf-dc5ec27b66d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:41.030643 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0684281b-5ac9-4408-a3bf-dc5ec27b66d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:41.031099 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0684281b-5ac9-4408-a3bf-dc5ec27b66d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:41.115323 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0684281b-5ac9-4408-a3bf-dc5ec27b66d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 14 microversion: 2.20 time: 0.110712 Dec 15 12:40:41.116067 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 88/179] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:40:41 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:41.135871 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d799fee5-6279-4007-9bfc-f50c571dde12 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:41.136848 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d799fee5-6279-4007-9bfc-f50c571dde12 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:41.146205 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d799fee5-6279-4007-9bfc-f50c571dde12 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:41.147053 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d799fee5-6279-4007-9bfc-f50c571dde12 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:41.148373 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d799fee5-6279-4007-9bfc-f50c571dde12 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:41.148910 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d799fee5-6279-4007-9bfc-f50c571dde12 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:41.306473 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d799fee5-6279-4007-9bfc-f50c571dde12 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:41.314232 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d799fee5-6279-4007-9bfc-f50c571dde12 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1521 microversion: 2.1 time: 0.190358 Dec 15 12:40:41.314802 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 92/180] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:41 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:41.900460 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ba1e61ab-e071-438e-9c7a-96a6398ee8dd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-701648099", "imageRef": "d302555e-2bff-4492-b57d-d59c0097a278", "flavorRef": "452", "networks": [{"uuid": "9067fc36-c028-414f-82b9-4a3d3b202a5f"}]}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:41.965246 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.network.neutron [None req-ba1e61ab-e071-438e-9c7a-96a6398ee8dd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] validate_networks() for [('9067fc36-c028-414f-82b9-4a3d3b202a5f', None, None, None, None, None)] {{(pid=122614) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 12:40:42.126847 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-72a2ba33-821d-441d-94c5-0f41c6080d92 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:42.128093 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-72a2ba33-821d-441d-94c5-0f41c6080d92 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:42.136702 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-72a2ba33-821d-441d-94c5-0f41c6080d92 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:42.142392 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-72a2ba33-821d-441d-94c5-0f41c6080d92 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:42.143374 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-72a2ba33-821d-441d-94c5-0f41c6080d92 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:42.144661 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-72a2ba33-821d-441d-94c5-0f41c6080d92 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:42.238481 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-72a2ba33-821d-441d-94c5-0f41c6080d92 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 14 microversion: 2.20 time: 0.114475 Dec 15 12:40:42.239657 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 93/181] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:40:42 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:42.334550 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-35df3c46-7185-4251-9fa0-d3ce9c2d8a53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:42.335688 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-35df3c46-7185-4251-9fa0-d3ce9c2d8a53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:42.343444 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-35df3c46-7185-4251-9fa0-d3ce9c2d8a53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:42.344158 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-35df3c46-7185-4251-9fa0-d3ce9c2d8a53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:42.345274 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-35df3c46-7185-4251-9fa0-d3ce9c2d8a53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:42.345946 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-35df3c46-7185-4251-9fa0-d3ce9c2d8a53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:42.444290 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-ba1e61ab-e071-438e-9c7a-96a6398ee8dd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Flavor limits 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 12:40:42.444858 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-ba1e61ab-e071-438e-9c7a-96a6398ee8dd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Image limits 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 12:40:42.445286 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-ba1e61ab-e071-438e-9c7a-96a6398ee8dd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Flavor pref 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 12:40:42.445730 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-ba1e61ab-e071-438e-9c7a-96a6398ee8dd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Image pref 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 12:40:42.446311 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-ba1e61ab-e071-438e-9c7a-96a6398ee8dd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 12:40:42.456617 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ba1e61ab-e071-438e-9c7a-96a6398ee8dd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:42.457057 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ba1e61ab-e071-438e-9c7a-96a6398ee8dd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:42.457904 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ba1e61ab-e071-438e-9c7a-96a6398ee8dd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:42.458394 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ba1e61ab-e071-438e-9c7a-96a6398ee8dd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:42.485612 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-ba1e61ab-e071-438e-9c7a-96a6398ee8dd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Getting quotas for project c4b04b03b8f94235be29043cfb8198ce. Resources: {'instances', 'cores', 'ram'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 12:40:42.490858 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-ba1e61ab-e071-438e-9c7a-96a6398ee8dd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Getting quotas for user 20aef34cb7444687acf501f6aedca443 and project c4b04b03b8f94235be29043cfb8198ce. Resources: {'instances', 'cores', 'ram'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 12:40:42.504243 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ba1e61ab-e071-438e-9c7a-96a6398ee8dd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Going to run 1 instances... {{(pid=122614) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 12:40:42.506801 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ba1e61ab-e071-438e-9c7a-96a6398ee8dd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 20da2f91-d326-43da-9c17-c3b21c20be17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d302555e-2bff-4492-b57d-d59c0097a278',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 12:40:42.524701 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-35df3c46-7185-4251-9fa0-d3ce9c2d8a53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:42.533769 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-35df3c46-7185-4251-9fa0-d3ce9c2d8a53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1521 microversion: 2.1 time: 0.203286 Dec 15 12:40:42.535550 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 94/182] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:42 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:42.563224 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ba1e61ab-e071-438e-9c7a-96a6398ee8dd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671149 Dec 15 12:40:42.564159 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 89/183] 10.222.0.76 () {60 vars in 1146 bytes} [Wed Dec 15 12:40:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 12:40:42.573765 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a7d67b16-80cf-4ca7-8a2b-8b8cd1857e80 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:42.574593 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a7d67b16-80cf-4ca7-8a2b-8b8cd1857e80 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 20da2f91-d326-43da-9c17-c3b21c20be17] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:42.631799 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a7d67b16-80cf-4ca7-8a2b-8b8cd1857e80 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:42.642671 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a7d67b16-80cf-4ca7-8a2b-8b8cd1857e80 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17" status: 200 len: 1217 microversion: 2.1 time: 0.072288 Dec 15 12:40:42.643804 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 95/184] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:42 2021] GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17 => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:43.251769 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d964ccb3-d81f-4a93-99e2-d7fa4a8f0bd0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:43.253755 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d964ccb3-d81f-4a93-99e2-d7fa4a8f0bd0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:43.271896 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d964ccb3-d81f-4a93-99e2-d7fa4a8f0bd0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:43.272722 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d964ccb3-d81f-4a93-99e2-d7fa4a8f0bd0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:43.273801 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d964ccb3-d81f-4a93-99e2-d7fa4a8f0bd0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:43.274308 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d964ccb3-d81f-4a93-99e2-d7fa4a8f0bd0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:43.388271 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d964ccb3-d81f-4a93-99e2-d7fa4a8f0bd0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 6451 microversion: 2.20 time: 0.141218 Dec 15 12:40:43.388983 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 90/185] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:40:43 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 6451 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:40:43.550413 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-eeb17681-20b9-4843-b46b-792c0d93e7dc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:43.551022 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-eeb17681-20b9-4843-b46b-792c0d93e7dc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:43.557398 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eeb17681-20b9-4843-b46b-792c0d93e7dc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:43.557976 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eeb17681-20b9-4843-b46b-792c0d93e7dc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:43.558650 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eeb17681-20b9-4843-b46b-792c0d93e7dc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:43.559245 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eeb17681-20b9-4843-b46b-792c0d93e7dc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:43.660481 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a94d42e9-13ef-48e3-8cad-ab4a9186e4cf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:43.661212 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a94d42e9-13ef-48e3-8cad-ab4a9186e4cf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 20da2f91-d326-43da-9c17-c3b21c20be17] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:43.669307 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a94d42e9-13ef-48e3-8cad-ab4a9186e4cf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:43.684950 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a94d42e9-13ef-48e3-8cad-ab4a9186e4cf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:43.686266 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a94d42e9-13ef-48e3-8cad-ab4a9186e4cf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:43.686911 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a94d42e9-13ef-48e3-8cad-ab4a9186e4cf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:43.719537 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-eeb17681-20b9-4843-b46b-792c0d93e7dc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:43.727115 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-eeb17681-20b9-4843-b46b-792c0d93e7dc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1521 microversion: 2.1 time: 0.180279 Dec 15 12:40:43.727709 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 96/186] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:43 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:43.795604 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a94d42e9-13ef-48e3-8cad-ab4a9186e4cf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:43.801842 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a94d42e9-13ef-48e3-8cad-ab4a9186e4cf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17" status: 200 len: 1269 microversion: 2.1 time: 0.145257 Dec 15 12:40:43.802577 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 91/187] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:43 2021] GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17 => generated 1269 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:44.399198 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f863892d-e140-4dc3-9768-b1e5eecf19de tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:44.400249 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f863892d-e140-4dc3-9768-b1e5eecf19de tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:44.407883 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f863892d-e140-4dc3-9768-b1e5eecf19de tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:44.408329 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f863892d-e140-4dc3-9768-b1e5eecf19de tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:44.409137 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f863892d-e140-4dc3-9768-b1e5eecf19de tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:44.409710 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f863892d-e140-4dc3-9768-b1e5eecf19de tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:44.749752 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7d7e3f7f-bb20-48b4-bbf3-31e762f98d8a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:44.750279 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7d7e3f7f-bb20-48b4-bbf3-31e762f98d8a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:44.756860 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7d7e3f7f-bb20-48b4-bbf3-31e762f98d8a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:44.757309 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7d7e3f7f-bb20-48b4-bbf3-31e762f98d8a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:44.758173 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7d7e3f7f-bb20-48b4-bbf3-31e762f98d8a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:44.758609 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7d7e3f7f-bb20-48b4-bbf3-31e762f98d8a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:44.900416 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7d7e3f7f-bb20-48b4-bbf3-31e762f98d8a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:44.907759 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7d7e3f7f-bb20-48b4-bbf3-31e762f98d8a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1521 microversion: 2.1 time: 0.162462 Dec 15 12:40:44.908326 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 92/188] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:44 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:44.913406 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-53c13e35-3b35-448f-bb7c-dc88d4d72e94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:44.914037 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-53c13e35-3b35-448f-bb7c-dc88d4d72e94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 20da2f91-d326-43da-9c17-c3b21c20be17] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:44.920089 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-53c13e35-3b35-448f-bb7c-dc88d4d72e94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:44.920534 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-53c13e35-3b35-448f-bb7c-dc88d4d72e94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:44.921306 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-53c13e35-3b35-448f-bb7c-dc88d4d72e94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:44.921766 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-53c13e35-3b35-448f-bb7c-dc88d4d72e94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:44.983075 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-53c13e35-3b35-448f-bb7c-dc88d4d72e94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:44.990549 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-53c13e35-3b35-448f-bb7c-dc88d4d72e94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17" status: 200 len: 1277 microversion: 2.1 time: 0.080411 Dec 15 12:40:44.991118 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 93/189] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:44 2021] GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17 => generated 1277 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:45.924626 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6d4d6178-8c8e-423b-afa1-f6437cde15e9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:45.925265 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6d4d6178-8c8e-423b-afa1-f6437cde15e9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:45.931534 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6d4d6178-8c8e-423b-afa1-f6437cde15e9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:45.931976 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6d4d6178-8c8e-423b-afa1-f6437cde15e9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:45.932755 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6d4d6178-8c8e-423b-afa1-f6437cde15e9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:45.933185 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6d4d6178-8c8e-423b-afa1-f6437cde15e9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:46.070886 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6d4d6178-8c8e-423b-afa1-f6437cde15e9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:46.079950 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6d4d6178-8c8e-423b-afa1-f6437cde15e9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1521 microversion: 2.1 time: 0.158900 Dec 15 12:40:46.080541 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 94/190] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:45 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:46.085086 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f1c1fa4c-a3ff-49a7-a95d-39e0466767b1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:46.085724 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f1c1fa4c-a3ff-49a7-a95d-39e0466767b1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 20da2f91-d326-43da-9c17-c3b21c20be17] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:46.092038 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f1c1fa4c-a3ff-49a7-a95d-39e0466767b1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:46.092488 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f1c1fa4c-a3ff-49a7-a95d-39e0466767b1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:46.093411 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f1c1fa4c-a3ff-49a7-a95d-39e0466767b1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:46.093993 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f1c1fa4c-a3ff-49a7-a95d-39e0466767b1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:46.156026 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f1c1fa4c-a3ff-49a7-a95d-39e0466767b1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:46.163350 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f1c1fa4c-a3ff-49a7-a95d-39e0466767b1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17" status: 200 len: 1277 microversion: 2.1 time: 0.081861 Dec 15 12:40:46.163957 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 95/191] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:46 2021] GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17 => generated 1277 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:46.879156 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f863892d-e140-4dc3-9768-b1e5eecf19de tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 18013 microversion: 2.20 time: 2.483261 Dec 15 12:40:46.880367 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 97/192] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:40:44 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 18013 bytes in 2485 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:40:47.097593 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fecb5e0c-02ba-472f-b104-ab5f7fbf8de9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:47.098200 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fecb5e0c-02ba-472f-b104-ab5f7fbf8de9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:47.104433 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fecb5e0c-02ba-472f-b104-ab5f7fbf8de9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:47.104878 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fecb5e0c-02ba-472f-b104-ab5f7fbf8de9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:47.105729 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fecb5e0c-02ba-472f-b104-ab5f7fbf8de9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:47.107012 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fecb5e0c-02ba-472f-b104-ab5f7fbf8de9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:47.185145 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-797bed31-86dd-4cdb-81ee-c6db57d47129 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:47.187317 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-797bed31-86dd-4cdb-81ee-c6db57d47129 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 20da2f91-d326-43da-9c17-c3b21c20be17] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:47.201368 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-797bed31-86dd-4cdb-81ee-c6db57d47129 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:47.202551 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-797bed31-86dd-4cdb-81ee-c6db57d47129 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:47.204528 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-797bed31-86dd-4cdb-81ee-c6db57d47129 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:47.205653 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-797bed31-86dd-4cdb-81ee-c6db57d47129 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:47.295503 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-fecb5e0c-02ba-472f-b104-ab5f7fbf8de9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:47.303589 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fecb5e0c-02ba-472f-b104-ab5f7fbf8de9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1521 microversion: 2.1 time: 0.210436 Dec 15 12:40:47.314107 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 96/193] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:47 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:47.315865 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-797bed31-86dd-4cdb-81ee-c6db57d47129 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:47.323797 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-797bed31-86dd-4cdb-81ee-c6db57d47129 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17" status: 200 len: 1275 microversion: 2.1 time: 0.146528 Dec 15 12:40:47.324374 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 98/194] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:47 2021] GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17 => generated 1275 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:47.895368 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c0cb7753-666b-4e15-b847-e0b7eed963d2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:47.897632 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c0cb7753-666b-4e15-b847-e0b7eed963d2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:47.906821 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c0cb7753-666b-4e15-b847-e0b7eed963d2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:47.907477 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c0cb7753-666b-4e15-b847-e0b7eed963d2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:47.908521 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c0cb7753-666b-4e15-b847-e0b7eed963d2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:47.922184 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c0cb7753-666b-4e15-b847-e0b7eed963d2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:48.044685 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c0cb7753-666b-4e15-b847-e0b7eed963d2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 18013 microversion: 2.20 time: 0.157480 Dec 15 12:40:48.049857 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 97/195] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:40:47 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 18013 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:40:48.322610 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5e62b766-ba53-4ed7-8d80-d63e79533685 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:48.323221 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5e62b766-ba53-4ed7-8d80-d63e79533685 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:48.337321 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5e62b766-ba53-4ed7-8d80-d63e79533685 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:48.341882 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5e62b766-ba53-4ed7-8d80-d63e79533685 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:48.342096 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-dea16217-0f63-4e63-a665-f355935d2d0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:48.343174 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5e62b766-ba53-4ed7-8d80-d63e79533685 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:48.343345 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-dea16217-0f63-4e63-a665-f355935d2d0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 20da2f91-d326-43da-9c17-c3b21c20be17] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:48.344266 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5e62b766-ba53-4ed7-8d80-d63e79533685 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:48.350385 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dea16217-0f63-4e63-a665-f355935d2d0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:48.359283 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dea16217-0f63-4e63-a665-f355935d2d0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:48.360283 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dea16217-0f63-4e63-a665-f355935d2d0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:48.360859 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dea16217-0f63-4e63-a665-f355935d2d0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:48.576824 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5e62b766-ba53-4ed7-8d80-d63e79533685 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:48.588989 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5e62b766-ba53-4ed7-8d80-d63e79533685 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1521 microversion: 2.1 time: 0.269926 Dec 15 12:40:48.592103 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 99/196] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:48 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:48.598518 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-40eb0aeb-f9f9-49bc-aec8-febe6278c365 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:48.599282 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-40eb0aeb-f9f9-49bc-aec8-febe6278c365 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:48.606920 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-40eb0aeb-f9f9-49bc-aec8-febe6278c365 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:48.607670 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-40eb0aeb-f9f9-49bc-aec8-febe6278c365 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:48.608686 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-40eb0aeb-f9f9-49bc-aec8-febe6278c365 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:48.609619 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-40eb0aeb-f9f9-49bc-aec8-febe6278c365 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:48.654974 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-40eb0aeb-f9f9-49bc-aec8-febe6278c365 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Going to try to terminate instance {{(pid=122615) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 12:40:48.687695 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-dea16217-0f63-4e63-a665-f355935d2d0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:48.698289 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-dea16217-0f63-4e63-a665-f355935d2d0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17" status: 200 len: 1317 microversion: 2.1 time: 0.360225 Dec 15 12:40:48.700210 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 98/197] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:48 2021] GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17 => generated 1317 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:48.705646 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-9233c7db-4b1e-4100-8061-7cfa79ae04c2 req-a0e89d80-ab1c-4841-8684-2c3d5d055192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20da2f91-d326-43da-9c17-c3b21c20be17", "tag": "352de345-40ab-4c18-9b0d-4a086975638a"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:48.707456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:40:48.707456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 12:40:48.726734 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-9233c7db-4b1e-4100-8061-7cfa79ae04c2 req-a0e89d80-ab1c-4841-8684-2c3d5d055192 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:48.727207 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-9233c7db-4b1e-4100-8061-7cfa79ae04c2 req-a0e89d80-ab1c-4841-8684-2c3d5d055192 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:48.740427 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-9233c7db-4b1e-4100-8061-7cfa79ae04c2 req-a0e89d80-ab1c-4841-8684-2c3d5d055192 service nova] Creating event network-changed:352de345-40ab-4c18-9b0d-4a086975638a for instance 20da2f91-d326-43da-9c17-c3b21c20be17 on hv-cinder-81322 Dec 15 12:40:48.745877 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-9233c7db-4b1e-4100-8061-7cfa79ae04c2 req-a0e89d80-ab1c-4841-8684-2c3d5d055192 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043866 Dec 15 12:40:48.746639 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 99/198] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 12:40:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:40:48.771111 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-40eb0aeb-f9f9-49bc-aec8-febe6278c365 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "DELETE /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 204 len: 0 microversion: 2.1 time: 0.176080 Dec 15 12:40:48.771792 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 100/199] 10.222.0.76 () {58 vars in 1238 bytes} [Wed Dec 15 12:40:48 2021] DELETE /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 12:40:48.782909 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-af87271a-43fe-446d-a03c-7269c829ff70 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:48.783606 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-af87271a-43fe-446d-a03c-7269c829ff70 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:48.790236 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-af87271a-43fe-446d-a03c-7269c829ff70 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:48.790682 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-af87271a-43fe-446d-a03c-7269c829ff70 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:48.791471 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-af87271a-43fe-446d-a03c-7269c829ff70 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:48.791898 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-af87271a-43fe-446d-a03c-7269c829ff70 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:48.934530 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-af87271a-43fe-446d-a03c-7269c829ff70 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:48.946636 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-af87271a-43fe-446d-a03c-7269c829ff70 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1553 microversion: 2.1 time: 0.169486 Dec 15 12:40:48.947231 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 100/200] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:48 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:49.058546 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-73773194-3c05-4e0e-9fae-a531d4acc9bb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:49.061009 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-73773194-3c05-4e0e-9fae-a531d4acc9bb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:49.076350 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-73773194-3c05-4e0e-9fae-a531d4acc9bb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:49.076900 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-73773194-3c05-4e0e-9fae-a531d4acc9bb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:49.077897 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-73773194-3c05-4e0e-9fae-a531d4acc9bb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:49.078394 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-73773194-3c05-4e0e-9fae-a531d4acc9bb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:49.193494 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-73773194-3c05-4e0e-9fae-a531d4acc9bb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 19342 microversion: 2.20 time: 0.139622 Dec 15 12:40:49.200933 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 101/201] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:40:49 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 19342 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:40:49.609690 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-91fe885f-6f48-497c-8b1e-23aca06cfb21 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:49.610480 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-91fe885f-6f48-497c-8b1e-23aca06cfb21 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:49.617713 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-91fe885f-6f48-497c-8b1e-23aca06cfb21 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:49.618199 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-91fe885f-6f48-497c-8b1e-23aca06cfb21 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:49.619099 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-91fe885f-6f48-497c-8b1e-23aca06cfb21 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:49.619846 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-91fe885f-6f48-497c-8b1e-23aca06cfb21 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:49.718506 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c71c815a-bee4-4193-833b-e26c10a3a29b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:49.720579 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c71c815a-bee4-4193-833b-e26c10a3a29b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 20da2f91-d326-43da-9c17-c3b21c20be17] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:49.743129 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c71c815a-bee4-4193-833b-e26c10a3a29b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:49.743567 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c71c815a-bee4-4193-833b-e26c10a3a29b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:49.747920 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c71c815a-bee4-4193-833b-e26c10a3a29b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:49.748356 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c71c815a-bee4-4193-833b-e26c10a3a29b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:49.769070 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-91fe885f-6f48-497c-8b1e-23aca06cfb21 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:49.777365 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-91fe885f-6f48-497c-8b1e-23aca06cfb21 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1521 microversion: 2.1 time: 0.172438 Dec 15 12:40:49.779251 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 101/202] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:49 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:49.904755 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c71c815a-bee4-4193-833b-e26c10a3a29b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:49.911980 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c71c815a-bee4-4193-833b-e26c10a3a29b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17" status: 200 len: 1317 microversion: 2.1 time: 0.199659 Dec 15 12:40:49.912545 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 102/203] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:49 2021] GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:49.963855 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-295268c8-af18-470e-ab0d-3536edb50982 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:49.964689 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-295268c8-af18-470e-ab0d-3536edb50982 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:49.972315 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-295268c8-af18-470e-ab0d-3536edb50982 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:49.972766 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-295268c8-af18-470e-ab0d-3536edb50982 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:49.973609 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-295268c8-af18-470e-ab0d-3536edb50982 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:49.974051 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-295268c8-af18-470e-ab0d-3536edb50982 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:50.118762 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-295268c8-af18-470e-ab0d-3536edb50982 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:50.128266 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-295268c8-af18-470e-ab0d-3536edb50982 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1553 microversion: 2.1 time: 0.167650 Dec 15 12:40:50.128867 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 102/204] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:49 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:50.210010 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-71fa4909-6027-4a34-bb37-b80470b7f2b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:50.211264 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-71fa4909-6027-4a34-bb37-b80470b7f2b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:50.220004 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-71fa4909-6027-4a34-bb37-b80470b7f2b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:50.221110 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-71fa4909-6027-4a34-bb37-b80470b7f2b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:50.222652 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-71fa4909-6027-4a34-bb37-b80470b7f2b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:50.223492 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-71fa4909-6027-4a34-bb37-b80470b7f2b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:50.332814 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-71fa4909-6027-4a34-bb37-b80470b7f2b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 19342 microversion: 2.20 time: 0.127214 Dec 15 12:40:50.334466 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 103/205] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:40:50 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 19342 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 12:40:50.796487 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-38419ea4-5e9f-4153-bc58-eb65dd2df8ab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:50.797058 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-38419ea4-5e9f-4153-bc58-eb65dd2df8ab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:50.803947 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-38419ea4-5e9f-4153-bc58-eb65dd2df8ab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:50.804392 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-38419ea4-5e9f-4153-bc58-eb65dd2df8ab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:50.808456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-38419ea4-5e9f-4153-bc58-eb65dd2df8ab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:50.808456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-38419ea4-5e9f-4153-bc58-eb65dd2df8ab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:50.929649 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ea758d61-8a9c-4afa-8487-ff83ed4ec661 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:50.930652 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ea758d61-8a9c-4afa-8487-ff83ed4ec661 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 20da2f91-d326-43da-9c17-c3b21c20be17] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:50.939744 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ea758d61-8a9c-4afa-8487-ff83ed4ec661 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:50.940861 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ea758d61-8a9c-4afa-8487-ff83ed4ec661 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:50.942211 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ea758d61-8a9c-4afa-8487-ff83ed4ec661 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:50.943280 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ea758d61-8a9c-4afa-8487-ff83ed4ec661 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:50.954679 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-38419ea4-5e9f-4153-bc58-eb65dd2df8ab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:50.962679 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-38419ea4-5e9f-4153-bc58-eb65dd2df8ab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1521 microversion: 2.1 time: 0.171417 Dec 15 12:40:50.963527 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 103/206] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:50 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:51.094436 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ea758d61-8a9c-4afa-8487-ff83ed4ec661 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:51.101679 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ea758d61-8a9c-4afa-8487-ff83ed4ec661 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17" status: 200 len: 1317 microversion: 2.1 time: 0.176128 Dec 15 12:40:51.102249 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 104/207] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:50 2021] GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:51.186950 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-620036cd-b345-45a6-aed6-9df7fc865a28 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:51.187553 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-620036cd-b345-45a6-aed6-9df7fc865a28 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:51.193781 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-620036cd-b345-45a6-aed6-9df7fc865a28 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:51.194224 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-620036cd-b345-45a6-aed6-9df7fc865a28 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:51.195005 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-620036cd-b345-45a6-aed6-9df7fc865a28 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:51.195429 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-620036cd-b345-45a6-aed6-9df7fc865a28 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:51.347125 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b3fc74ed-c77b-495d-94e7-877b43b0afa5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:51.348409 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b3fc74ed-c77b-495d-94e7-877b43b0afa5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:51.356724 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-620036cd-b345-45a6-aed6-9df7fc865a28 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:51.357377 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b3fc74ed-c77b-495d-94e7-877b43b0afa5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:51.357941 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b3fc74ed-c77b-495d-94e7-877b43b0afa5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:51.359159 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b3fc74ed-c77b-495d-94e7-877b43b0afa5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:51.359696 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b3fc74ed-c77b-495d-94e7-877b43b0afa5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:51.369921 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-620036cd-b345-45a6-aed6-9df7fc865a28 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1553 microversion: 2.1 time: 0.187397 Dec 15 12:40:51.370872 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 104/208] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:51 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1553 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:51.477834 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b3fc74ed-c77b-495d-94e7-877b43b0afa5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 21020 microversion: 2.20 time: 0.135825 Dec 15 12:40:51.478520 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 105/209] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:40:51 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 21020 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 12:40:51.979916 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e53e59ee-fd32-43a6-9817-ca78bb497c2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:51.980526 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e53e59ee-fd32-43a6-9817-ca78bb497c2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:51.986996 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e53e59ee-fd32-43a6-9817-ca78bb497c2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:51.987693 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e53e59ee-fd32-43a6-9817-ca78bb497c2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:51.988481 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e53e59ee-fd32-43a6-9817-ca78bb497c2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:51.989185 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e53e59ee-fd32-43a6-9817-ca78bb497c2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:52.119761 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-de104ec6-9392-4125-82e2-186da2f376a2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:52.120411 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-de104ec6-9392-4125-82e2-186da2f376a2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 20da2f91-d326-43da-9c17-c3b21c20be17] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:52.128340 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-de104ec6-9392-4125-82e2-186da2f376a2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:52.128779 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-de104ec6-9392-4125-82e2-186da2f376a2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:52.129643 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-de104ec6-9392-4125-82e2-186da2f376a2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:52.130156 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-de104ec6-9392-4125-82e2-186da2f376a2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:52.217925 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e53e59ee-fd32-43a6-9817-ca78bb497c2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:52.226104 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e53e59ee-fd32-43a6-9817-ca78bb497c2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1521 microversion: 2.1 time: 0.249725 Dec 15 12:40:52.226971 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 105/210] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:51 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:52.369452 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-de104ec6-9392-4125-82e2-186da2f376a2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:52.383425 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-de104ec6-9392-4125-82e2-186da2f376a2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17" status: 200 len: 1317 microversion: 2.1 time: 0.267852 Dec 15 12:40:52.385812 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-9044feaf-0524-475e-a58d-3b444bd4b017 req-6872fd92-a4a2-45aa-9951-47b4f2684a25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee02333-4fb9-4dfb-bc00-f57402d7c612", "name": "network-vif-deleted", "tag": "457daa7c-40b7-4e38-87bc-a288b566ffa6"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:52.388338 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:40:52.388338 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 12:40:52.395206 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 106/211] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:52 2021] GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17 => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:52.397908 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-9044feaf-0524-475e-a58d-3b444bd4b017 req-6872fd92-a4a2-45aa-9951-47b4f2684a25 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:52.398538 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-9044feaf-0524-475e-a58d-3b444bd4b017 req-6872fd92-a4a2-45aa-9951-47b4f2684a25 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:52.412286 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-9044feaf-0524-475e-a58d-3b444bd4b017 req-6872fd92-a4a2-45aa-9951-47b4f2684a25 service nova] Creating event network-vif-deleted:457daa7c-40b7-4e38-87bc-a288b566ffa6 for instance 1ee02333-4fb9-4dfb-bc00-f57402d7c612 on hv-cinder-81322 Dec 15 12:40:52.416168 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f147fd54-45ef-4051-b7f8-4c0351dad059 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:52.417443 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f147fd54-45ef-4051-b7f8-4c0351dad059 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:52.418060 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-9044feaf-0524-475e-a58d-3b444bd4b017 req-6872fd92-a4a2-45aa-9951-47b4f2684a25 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042987 Dec 15 12:40:52.419981 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 106/212] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 12:40:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:40:52.426887 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f147fd54-45ef-4051-b7f8-4c0351dad059 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:52.427633 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f147fd54-45ef-4051-b7f8-4c0351dad059 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:52.428651 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f147fd54-45ef-4051-b7f8-4c0351dad059 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:52.429169 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f147fd54-45ef-4051-b7f8-4c0351dad059 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:52.498221 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f431368a-aab4-4b8d-b812-39523b108a4a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:52.499991 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f431368a-aab4-4b8d-b812-39523b108a4a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:52.501438 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-f147fd54-45ef-4051-b7f8-4c0351dad059 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5742638c77e3499e8ffcdc51256345f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c1a384856416191a1e503a7119f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:52.507404 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f431368a-aab4-4b8d-b812-39523b108a4a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:52.508354 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f431368a-aab4-4b8d-b812-39523b108a4a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:52.509240 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f431368a-aab4-4b8d-b812-39523b108a4a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:52.509719 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f431368a-aab4-4b8d-b812-39523b108a4a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:52.510618 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f147fd54-45ef-4051-b7f8-4c0351dad059 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 200 len: 1344 microversion: 2.1 time: 0.114122 Dec 15 12:40:52.511432 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 107/213] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:52 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 1344 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:52.599480 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f431368a-aab4-4b8d-b812-39523b108a4a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 22160 microversion: 2.20 time: 0.105734 Dec 15 12:40:52.600157 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 107/214] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:40:52 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 22160 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 12:40:53.245398 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bf246842-7e1e-4d72-ad60-39ff9502d82f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:53.246178 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bf246842-7e1e-4d72-ad60-39ff9502d82f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:53.255348 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bf246842-7e1e-4d72-ad60-39ff9502d82f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:53.256032 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bf246842-7e1e-4d72-ad60-39ff9502d82f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:53.256967 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bf246842-7e1e-4d72-ad60-39ff9502d82f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:53.257890 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bf246842-7e1e-4d72-ad60-39ff9502d82f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:53.404518 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ad91152e-ad73-4b64-94a0-2450199563d7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:53.405642 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ad91152e-ad73-4b64-94a0-2450199563d7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 20da2f91-d326-43da-9c17-c3b21c20be17] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:53.413285 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ad91152e-ad73-4b64-94a0-2450199563d7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:53.413759 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ad91152e-ad73-4b64-94a0-2450199563d7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:53.414676 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ad91152e-ad73-4b64-94a0-2450199563d7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:53.415111 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ad91152e-ad73-4b64-94a0-2450199563d7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:53.498618 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bf246842-7e1e-4d72-ad60-39ff9502d82f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:53.506306 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bf246842-7e1e-4d72-ad60-39ff9502d82f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1521 microversion: 2.1 time: 0.265621 Dec 15 12:40:53.506874 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 108/215] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:53 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:53.529603 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a7e44068-4d09-4ea1-aed7-7a5124335767 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:53.530528 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a7e44068-4d09-4ea1-aed7-7a5124335767 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:53.536696 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a7e44068-4d09-4ea1-aed7-7a5124335767 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:53.537137 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a7e44068-4d09-4ea1-aed7-7a5124335767 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:53.540192 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a7e44068-4d09-4ea1-aed7-7a5124335767 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:53.540634 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a7e44068-4d09-4ea1-aed7-7a5124335767 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:53.565486 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.wsgi [None req-a7e44068-4d09-4ea1-aed7-7a5124335767 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] HTTP exception thrown: Instance 1ee02333-4fb9-4dfb-bc00-f57402d7c612 could not be found. Dec 15 12:40:53.566543 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a7e44068-4d09-4ea1-aed7-7a5124335767 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Returning 404 to user: Instance 1ee02333-4fb9-4dfb-bc00-f57402d7c612 could not be found. {{(pid=122615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:40:53.568032 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a7e44068-4d09-4ea1-aed7-7a5124335767 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 404 len: 111 microversion: 2.1 time: 0.042877 Dec 15 12:40:53.569755 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 109/216] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:53 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 12:40:53.612475 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-530e4467-dac3-4857-964e-86efd4e38210 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:53.613565 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-530e4467-dac3-4857-964e-86efd4e38210 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:53.620166 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-530e4467-dac3-4857-964e-86efd4e38210 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:53.620612 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-530e4467-dac3-4857-964e-86efd4e38210 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:53.622787 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-530e4467-dac3-4857-964e-86efd4e38210 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:53.623345 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-530e4467-dac3-4857-964e-86efd4e38210 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:53.827322 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ad91152e-ad73-4b64-94a0-2450199563d7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:53.843145 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ad91152e-ad73-4b64-94a0-2450199563d7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17" status: 200 len: 1317 microversion: 2.1 time: 0.439449 Dec 15 12:40:53.843145 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 108/217] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:53 2021] GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17 => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:53.854090 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-20e28ef9-5423-4e3c-b465-9f03a8c8677f tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:53.855084 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-20e28ef9-5423-4e3c-b465-9f03a8c8677f tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:53.861729 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20e28ef9-5423-4e3c-b465-9f03a8c8677f tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:53.862112 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20e28ef9-5423-4e3c-b465-9f03a8c8677f tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:53.862891 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20e28ef9-5423-4e3c-b465-9f03a8c8677f tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:53.863320 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20e28ef9-5423-4e3c-b465-9f03a8c8677f tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:53.880158 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.wsgi [None req-20e28ef9-5423-4e3c-b465-9f03a8c8677f tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] HTTP exception thrown: Instance 1ee02333-4fb9-4dfb-bc00-f57402d7c612 could not be found. Dec 15 12:40:53.880754 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-20e28ef9-5423-4e3c-b465-9f03a8c8677f tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Returning 404 to user: Instance 1ee02333-4fb9-4dfb-bc00-f57402d7c612 could not be found. {{(pid=122614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:40:53.881623 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-20e28ef9-5423-4e3c-b465-9f03a8c8677f tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041227 Dec 15 12:40:53.882397 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 109/218] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:40:53 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 12:40:53.897090 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-530e4467-dac3-4857-964e-86efd4e38210 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 23226 microversion: 2.20 time: 0.288657 Dec 15 12:40:53.900020 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 110/219] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:40:53 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 23226 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 12:40:54.529232 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-078286e3-86af-410d-aca1-c65cfeb0b80e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:54.530494 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-078286e3-86af-410d-aca1-c65cfeb0b80e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:54.550483 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-078286e3-86af-410d-aca1-c65cfeb0b80e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:54.551168 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-078286e3-86af-410d-aca1-c65cfeb0b80e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:54.552039 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-078286e3-86af-410d-aca1-c65cfeb0b80e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:54.552853 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-078286e3-86af-410d-aca1-c65cfeb0b80e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:54.719940 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-078286e3-86af-410d-aca1-c65cfeb0b80e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:54.728678 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-078286e3-86af-410d-aca1-c65cfeb0b80e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1521 microversion: 2.1 time: 0.208074 Dec 15 12:40:54.729272 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 110/220] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:54 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:54.857259 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3cfaaa01-5414-4cb7-9d4e-ff40446e09a0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:54.858634 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3cfaaa01-5414-4cb7-9d4e-ff40446e09a0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 20da2f91-d326-43da-9c17-c3b21c20be17] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:54.865707 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3cfaaa01-5414-4cb7-9d4e-ff40446e09a0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:54.866141 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3cfaaa01-5414-4cb7-9d4e-ff40446e09a0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:54.866924 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3cfaaa01-5414-4cb7-9d4e-ff40446e09a0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:54.867357 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3cfaaa01-5414-4cb7-9d4e-ff40446e09a0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:54.909661 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-80ccb45b-3aa4-42bc-9f45-53bec48bbc98 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:54.910572 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-80ccb45b-3aa4-42bc-9f45-53bec48bbc98 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:54.917272 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-80ccb45b-3aa4-42bc-9f45-53bec48bbc98 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:54.917745 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-80ccb45b-3aa4-42bc-9f45-53bec48bbc98 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:54.919165 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-80ccb45b-3aa4-42bc-9f45-53bec48bbc98 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:54.919775 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-80ccb45b-3aa4-42bc-9f45-53bec48bbc98 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:55.025330 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-80ccb45b-3aa4-42bc-9f45-53bec48bbc98 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 24452 microversion: 2.20 time: 0.118685 Dec 15 12:40:55.026324 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 111/221] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:40:54 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 24452 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 12:40:55.044446 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3cfaaa01-5414-4cb7-9d4e-ff40446e09a0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:55.052153 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3cfaaa01-5414-4cb7-9d4e-ff40446e09a0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17" status: 200 len: 1317 microversion: 2.1 time: 0.199484 Dec 15 12:40:55.052853 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 111/222] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:54 2021] GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:55.103789 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-aafde0f5-6d72-4d54-b2b9-0a5db3d89284 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:55.104365 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-aafde0f5-6d72-4d54-b2b9-0a5db3d89284 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:55.112423 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aafde0f5-6d72-4d54-b2b9-0a5db3d89284 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:55.112862 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aafde0f5-6d72-4d54-b2b9-0a5db3d89284 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:55.113758 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aafde0f5-6d72-4d54-b2b9-0a5db3d89284 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:55.114192 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aafde0f5-6d72-4d54-b2b9-0a5db3d89284 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:55.130222 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.wsgi [None req-aafde0f5-6d72-4d54-b2b9-0a5db3d89284 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] HTTP exception thrown: Instance 1ee02333-4fb9-4dfb-bc00-f57402d7c612 could not be found. Dec 15 12:40:55.130810 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-aafde0f5-6d72-4d54-b2b9-0a5db3d89284 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Returning 404 to user: Instance 1ee02333-4fb9-4dfb-bc00-f57402d7c612 could not be found. {{(pid=122614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:40:55.131636 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-aafde0f5-6d72-4d54-b2b9-0a5db3d89284 tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "DELETE /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 404 len: 111 microversion: 2.1 time: 0.031860 Dec 15 12:40:55.132183 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 112/223] 10.222.0.76 () {58 vars in 1238 bytes} [Wed Dec 15 12:40:55 2021] DELETE /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 12:40:55.140948 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8a3b0d92-3b13-41e0-b519-4531bb65e6ee tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:55.141855 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8a3b0d92-3b13-41e0-b519-4531bb65e6ee tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] [instance: 1ee02333-4fb9-4dfb-bc00-f57402d7c612] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:55.148459 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8a3b0d92-3b13-41e0-b519-4531bb65e6ee tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:55.148913 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8a3b0d92-3b13-41e0-b519-4531bb65e6ee tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:55.149747 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8a3b0d92-3b13-41e0-b519-4531bb65e6ee tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:55.150181 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8a3b0d92-3b13-41e0-b519-4531bb65e6ee tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:55.164206 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.wsgi [None req-8a3b0d92-3b13-41e0-b519-4531bb65e6ee tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] HTTP exception thrown: Instance 1ee02333-4fb9-4dfb-bc00-f57402d7c612 could not be found. Dec 15 12:40:55.164807 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8a3b0d92-3b13-41e0-b519-4531bb65e6ee tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] Returning 404 to user: Instance 1ee02333-4fb9-4dfb-bc00-f57402d7c612 could not be found. {{(pid=122615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:40:55.165662 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8a3b0d92-3b13-41e0-b519-4531bb65e6ee tempest-DeleteServersTestJSON-860975145 tempest-DeleteServersTestJSON-860975145-project] 10.222.0.76 "GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612" status: 404 len: 111 microversion: 2.1 time: 0.029299 Dec 15 12:40:55.166197 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 112/224] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:55 2021] GET /compute/v2.1/servers/1ee02333-4fb9-4dfb-bc00-f57402d7c612 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 12:40:55.724623 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-b8d4c638-23b8-4391-9bee-4c6e0fbf93c2 req-75eb06e3-00a2-4641-b5ea-a2bb3dee8344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20da2f91-d326-43da-9c17-c3b21c20be17", "name": "network-vif-plugged", "status": "completed", "tag": "352de345-40ab-4c18-9b0d-4a086975638a"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:55.726173 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:40:55.726173 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 12:40:55.734695 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-b8d4c638-23b8-4391-9bee-4c6e0fbf93c2 req-75eb06e3-00a2-4641-b5ea-a2bb3dee8344 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:55.735331 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-b8d4c638-23b8-4391-9bee-4c6e0fbf93c2 req-75eb06e3-00a2-4641-b5ea-a2bb3dee8344 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:55.749152 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-b8d4c638-23b8-4391-9bee-4c6e0fbf93c2 req-75eb06e3-00a2-4641-b5ea-a2bb3dee8344 service nova] Creating event network-vif-plugged:352de345-40ab-4c18-9b0d-4a086975638a for instance 20da2f91-d326-43da-9c17-c3b21c20be17 on hv-cinder-81322 Dec 15 12:40:55.750468 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a48818ee-6c53-4ebe-a1d9-a0de984bda27 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:55.751204 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a48818ee-6c53-4ebe-a1d9-a0de984bda27 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:55.760873 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a48818ee-6c53-4ebe-a1d9-a0de984bda27 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:55.760873 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a48818ee-6c53-4ebe-a1d9-a0de984bda27 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:55.761151 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-b8d4c638-23b8-4391-9bee-4c6e0fbf93c2 req-75eb06e3-00a2-4641-b5ea-a2bb3dee8344 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034549 Dec 15 12:40:55.761264 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a48818ee-6c53-4ebe-a1d9-a0de984bda27 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:55.761264 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a48818ee-6c53-4ebe-a1d9-a0de984bda27 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:55.763815 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 113/225] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 12:40:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:40:55.976500 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a48818ee-6c53-4ebe-a1d9-a0de984bda27 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:55.984335 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a48818ee-6c53-4ebe-a1d9-a0de984bda27 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1521 microversion: 2.1 time: 0.238925 Dec 15 12:40:55.984919 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 113/226] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:55 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:56.038930 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bcb99e5f-a508-4da3-b929-be239dd532df tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:56.039953 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bcb99e5f-a508-4da3-b929-be239dd532df tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:56.047413 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bcb99e5f-a508-4da3-b929-be239dd532df tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:56.048425 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bcb99e5f-a508-4da3-b929-be239dd532df tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:56.049365 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bcb99e5f-a508-4da3-b929-be239dd532df tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:56.050553 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bcb99e5f-a508-4da3-b929-be239dd532df tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:56.071371 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-afe44322-3ef4-4111-bab0-7f76486c764d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:56.072206 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-afe44322-3ef4-4111-bab0-7f76486c764d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 20da2f91-d326-43da-9c17-c3b21c20be17] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:56.083560 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afe44322-3ef4-4111-bab0-7f76486c764d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:56.084013 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afe44322-3ef4-4111-bab0-7f76486c764d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:56.091397 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afe44322-3ef4-4111-bab0-7f76486c764d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:56.091829 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afe44322-3ef4-4111-bab0-7f76486c764d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:56.271397 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-afe44322-3ef4-4111-bab0-7f76486c764d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:56.280202 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-afe44322-3ef4-4111-bab0-7f76486c764d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17" status: 200 len: 1317 microversion: 2.1 time: 0.214019 Dec 15 12:40:56.281458 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 114/227] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:56 2021] GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:40:56.287430 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-19308d53-0d26-4c4e-9f52-3efdaf4b90a2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-483774681", "imageRef": "d302555e-2bff-4492-b57d-d59c0097a278", "flavorRef": "452", "networks": [{"uuid": "0e6f9adc-0704-4c6a-95ca-a377df4c943a"}]}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:56.344683 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.network.neutron [None req-19308d53-0d26-4c4e-9f52-3efdaf4b90a2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] validate_networks() for [('0e6f9adc-0704-4c6a-95ca-a377df4c943a', None, None, None, None, None)] {{(pid=122615) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 12:40:56.373481 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bcb99e5f-a508-4da3-b929-be239dd532df tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 25236 microversion: 2.20 time: 0.338311 Dec 15 12:40:56.374388 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 114/228] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:40:56 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 25236 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:40:56.741155 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-19308d53-0d26-4c4e-9f52-3efdaf4b90a2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Flavor limits 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 12:40:56.741155 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-19308d53-0d26-4c4e-9f52-3efdaf4b90a2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Image limits 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 12:40:56.742036 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-19308d53-0d26-4c4e-9f52-3efdaf4b90a2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Flavor pref 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 12:40:56.742547 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-19308d53-0d26-4c4e-9f52-3efdaf4b90a2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Image pref 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 12:40:56.743055 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-19308d53-0d26-4c4e-9f52-3efdaf4b90a2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 12:40:56.754281 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-19308d53-0d26-4c4e-9f52-3efdaf4b90a2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:56.754718 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-19308d53-0d26-4c4e-9f52-3efdaf4b90a2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:56.755538 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-19308d53-0d26-4c4e-9f52-3efdaf4b90a2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:56.755963 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-19308d53-0d26-4c4e-9f52-3efdaf4b90a2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:56.775195 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-19308d53-0d26-4c4e-9f52-3efdaf4b90a2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Getting quotas for project d960d0a2e2574caab44c82c717868b06. Resources: {'instances', 'cores', 'ram'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 12:40:56.780069 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-19308d53-0d26-4c4e-9f52-3efdaf4b90a2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Getting quotas for user 2438a8e630b743cfb83d57236a266cf8 and project d960d0a2e2574caab44c82c717868b06. Resources: {'instances', 'cores', 'ram'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 12:40:56.792982 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-19308d53-0d26-4c4e-9f52-3efdaf4b90a2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Going to run 1 instances... {{(pid=122615) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 12:40:56.798220 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-19308d53-0d26-4c4e-9f52-3efdaf4b90a2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d302555e-2bff-4492-b57d-d59c0097a278',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 12:40:56.864667 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-19308d53-0d26-4c4e-9f52-3efdaf4b90a2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581133 Dec 15 12:40:56.871887 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 115/229] 10.222.0.76 () {60 vars in 1146 bytes} [Wed Dec 15 12:40:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 12:40:56.877857 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-995eb832-0f38-4a97-9d36-6a60be54759d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:56.878549 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-995eb832-0f38-4a97-9d36-6a60be54759d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:56.967162 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-995eb832-0f38-4a97-9d36-6a60be54759d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:56.976359 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-995eb832-0f38-4a97-9d36-6a60be54759d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1218 microversion: 2.1 time: 0.103017 Dec 15 12:40:56.977635 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 115/230] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:56 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:57.001208 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-00ec6a4d-7b52-4d0f-8625-fcf20b3dbcd4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:57.003914 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-00ec6a4d-7b52-4d0f-8625-fcf20b3dbcd4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:57.019057 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-00ec6a4d-7b52-4d0f-8625-fcf20b3dbcd4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:57.019905 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-00ec6a4d-7b52-4d0f-8625-fcf20b3dbcd4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:57.020955 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-00ec6a4d-7b52-4d0f-8625-fcf20b3dbcd4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:57.021830 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-00ec6a4d-7b52-4d0f-8625-fcf20b3dbcd4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:57.265985 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-00ec6a4d-7b52-4d0f-8625-fcf20b3dbcd4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:57.278331 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-00ec6a4d-7b52-4d0f-8625-fcf20b3dbcd4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1521 microversion: 2.1 time: 0.280868 Dec 15 12:40:57.279326 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 116/231] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:56 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:57.304356 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3ff93087-384a-44ae-843d-e6a0c43e58a7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:57.304972 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3ff93087-384a-44ae-843d-e6a0c43e58a7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 20da2f91-d326-43da-9c17-c3b21c20be17] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:57.317689 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3ff93087-384a-44ae-843d-e6a0c43e58a7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:57.318343 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3ff93087-384a-44ae-843d-e6a0c43e58a7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:57.319374 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3ff93087-384a-44ae-843d-e6a0c43e58a7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:57.320018 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3ff93087-384a-44ae-843d-e6a0c43e58a7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:57.390075 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bb98a17b-84c0-49c8-868b-1078a7b142ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:57.391424 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bb98a17b-84c0-49c8-868b-1078a7b142ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:57.425560 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bb98a17b-84c0-49c8-868b-1078a7b142ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:57.427360 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bb98a17b-84c0-49c8-868b-1078a7b142ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:57.429061 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bb98a17b-84c0-49c8-868b-1078a7b142ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:57.430148 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bb98a17b-84c0-49c8-868b-1078a7b142ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:57.549270 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3ff93087-384a-44ae-843d-e6a0c43e58a7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:57.567103 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3ff93087-384a-44ae-843d-e6a0c43e58a7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17" status: 200 len: 1317 microversion: 2.1 time: 0.266386 Dec 15 12:40:57.577401 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 116/232] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:57 2021] GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17 => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:57.586484 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bb98a17b-84c0-49c8-868b-1078a7b142ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 25776 microversion: 2.20 time: 0.203735 Dec 15 12:40:57.587701 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 117/233] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:40:57 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 25776 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:40:57.993529 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e39e410a-259a-4b26-8190-c0b70eeee806 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:57.994165 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e39e410a-259a-4b26-8190-c0b70eeee806 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:58.001101 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e39e410a-259a-4b26-8190-c0b70eeee806 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:58.001574 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e39e410a-259a-4b26-8190-c0b70eeee806 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:58.002719 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e39e410a-259a-4b26-8190-c0b70eeee806 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:58.003227 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e39e410a-259a-4b26-8190-c0b70eeee806 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:58.071238 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e39e410a-259a-4b26-8190-c0b70eeee806 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:58.079483 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e39e410a-259a-4b26-8190-c0b70eeee806 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1270 microversion: 2.1 time: 0.089592 Dec 15 12:40:58.080049 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 117/234] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:57 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:58.307549 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-10a7b92e-035d-4e6f-813f-10221402ad5f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:58.309628 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-10a7b92e-035d-4e6f-813f-10221402ad5f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:58.342049 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-10a7b92e-035d-4e6f-813f-10221402ad5f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:58.343455 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-10a7b92e-035d-4e6f-813f-10221402ad5f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:58.344454 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-10a7b92e-035d-4e6f-813f-10221402ad5f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:58.345053 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-10a7b92e-035d-4e6f-813f-10221402ad5f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:58.518622 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-10a7b92e-035d-4e6f-813f-10221402ad5f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:58.535607 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-10a7b92e-035d-4e6f-813f-10221402ad5f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1521 microversion: 2.1 time: 0.224405 Dec 15 12:40:58.546774 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 118/235] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:58 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:58.593358 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9980dd3f-a8d4-401e-be99-d22413f98146 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:58.594133 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9980dd3f-a8d4-401e-be99-d22413f98146 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 20da2f91-d326-43da-9c17-c3b21c20be17] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:58.601165 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9980dd3f-a8d4-401e-be99-d22413f98146 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:58.601962 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9980dd3f-a8d4-401e-be99-d22413f98146 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:58.602750 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9980dd3f-a8d4-401e-be99-d22413f98146 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:58.603189 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9980dd3f-a8d4-401e-be99-d22413f98146 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:58.606952 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a604273f-5f5d-432f-a00a-61e8184963bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:58.609484 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a604273f-5f5d-432f-a00a-61e8184963bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:58.620557 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a604273f-5f5d-432f-a00a-61e8184963bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:58.622055 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a604273f-5f5d-432f-a00a-61e8184963bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:58.623412 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a604273f-5f5d-432f-a00a-61e8184963bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:58.624187 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a604273f-5f5d-432f-a00a-61e8184963bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:58.771435 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a604273f-5f5d-432f-a00a-61e8184963bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 26069 microversion: 2.20 time: 0.169672 Dec 15 12:40:58.772297 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 119/236] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:40:58 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 26069 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 12:40:58.816227 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9980dd3f-a8d4-401e-be99-d22413f98146 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:58.824505 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9980dd3f-a8d4-401e-be99-d22413f98146 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17" status: 200 len: 1506 microversion: 2.1 time: 0.243821 Dec 15 12:40:58.825089 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 118/237] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:58 2021] GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17 => generated 1506 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:58.853467 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5d32c05d-aa8a-4994-a02f-edbcbe69fc90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbfa16bf-6643-41ad-8c75-759412a0291f"}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:58.854950 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5d32c05d-aa8a-4994-a02f-edbcbe69fc90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 20da2f91-d326-43da-9c17-c3b21c20be17] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:58.863194 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5d32c05d-aa8a-4994-a02f-edbcbe69fc90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:58.863628 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5d32c05d-aa8a-4994-a02f-edbcbe69fc90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:58.864641 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5d32c05d-aa8a-4994-a02f-edbcbe69fc90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:58.865074 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5d32c05d-aa8a-4994-a02f-edbcbe69fc90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:58.961281 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.wsgi [None req-5d32c05d-aa8a-4994-a02f-edbcbe69fc90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] HTTP exception thrown: Invalid volume: volume bbfa16bf-6643-41ad-8c75-759412a0291f is already attached to instances: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 Dec 15 12:40:58.961779 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5d32c05d-aa8a-4994-a02f-edbcbe69fc90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Returning 400 to user: Invalid volume: volume bbfa16bf-6643-41ad-8c75-759412a0291f is already attached to instances: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 {{(pid=122615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:40:58.962617 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5d32c05d-aa8a-4994-a02f-edbcbe69fc90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "POST /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.122662 Dec 15 12:40:58.963183 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 120/238] 10.222.0.76 () {60 vars in 1322 bytes} [Wed Dec 15 12:40:58 2021] POST /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17/os-volume_attachments => generated 174 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 12:40:59.038139 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-15065965-5385-4b90-b7db-20a46e649493 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:59.038703 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-15065965-5385-4b90-b7db-20a46e649493 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:59.044832 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-15065965-5385-4b90-b7db-20a46e649493 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:59.045288 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-15065965-5385-4b90-b7db-20a46e649493 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:59.046112 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-15065965-5385-4b90-b7db-20a46e649493 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:59.046543 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-15065965-5385-4b90-b7db-20a46e649493 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:59.099526 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4321b929-a393-48b8-8b3b-7d8ceb7068ba tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:59.101017 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4321b929-a393-48b8-8b3b-7d8ceb7068ba tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:59.114106 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4321b929-a393-48b8-8b3b-7d8ceb7068ba tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:59.114864 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4321b929-a393-48b8-8b3b-7d8ceb7068ba tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:59.116456 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4321b929-a393-48b8-8b3b-7d8ceb7068ba tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:59.117632 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4321b929-a393-48b8-8b3b-7d8ceb7068ba tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:59.228048 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.objects.instance [None req-15065965-5385-4b90-b7db-20a46e649493 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lazy-loading 'services' on Instance uuid d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 {{(pid=122614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 12:40:59.307677 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4321b929-a393-48b8-8b3b-7d8ceb7068ba tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:59.322066 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4321b929-a393-48b8-8b3b-7d8ceb7068ba tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1318 microversion: 2.1 time: 0.228097 Dec 15 12:40:59.323252 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 121/239] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:59 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:59.402270 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-15065965-5385-4b90-b7db-20a46e649493 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0/os-volume_attachments/bbfa16bf-6643-41ad-8c75-759412a0291f" status: 202 len: 0 microversion: 2.1 time: 0.367443 Dec 15 12:40:59.402904 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 119/240] 10.222.0.76 () {58 vars in 1415 bytes} [Wed Dec 15 12:40:59 2021] DELETE /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0/os-volume_attachments/bbfa16bf-6643-41ad-8c75-759412a0291f => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:40:59.411462 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3f03691e-1a92-40b5-baa7-86e195055477 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:59.412437 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3f03691e-1a92-40b5-baa7-86e195055477 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:59.419264 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3f03691e-1a92-40b5-baa7-86e195055477 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:59.419775 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3f03691e-1a92-40b5-baa7-86e195055477 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:59.420717 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3f03691e-1a92-40b5-baa7-86e195055477 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:59.421154 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3f03691e-1a92-40b5-baa7-86e195055477 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:59.452454 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3f03691e-1a92-40b5-baa7-86e195055477 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044801 Dec 15 12:40:59.453018 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 122/241] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:40:59 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:40:59.553732 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-64f9e2ad-969d-4f44-b2c5-160b54ab5fd8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:59.554437 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-64f9e2ad-969d-4f44-b2c5-160b54ab5fd8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:59.560655 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-64f9e2ad-969d-4f44-b2c5-160b54ab5fd8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:59.561112 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-64f9e2ad-969d-4f44-b2c5-160b54ab5fd8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:59.561925 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-64f9e2ad-969d-4f44-b2c5-160b54ab5fd8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:59.562364 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-64f9e2ad-969d-4f44-b2c5-160b54ab5fd8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:59.719844 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-64f9e2ad-969d-4f44-b2c5-160b54ab5fd8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:59.727293 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-64f9e2ad-969d-4f44-b2c5-160b54ab5fd8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1501 microversion: 2.1 time: 0.177641 Dec 15 12:40:59.727874 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 120/242] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:59 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1501 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:40:59.744398 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-52ecb575-eb55-4dbe-a9bf-d8db1b283f21 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:40:59.745022 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-52ecb575-eb55-4dbe-a9bf-d8db1b283f21 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:59.753098 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-52ecb575-eb55-4dbe-a9bf-d8db1b283f21 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:59.753670 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-52ecb575-eb55-4dbe-a9bf-d8db1b283f21 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:59.754572 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-52ecb575-eb55-4dbe-a9bf-d8db1b283f21 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:59.755075 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-52ecb575-eb55-4dbe-a9bf-d8db1b283f21 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:59.784948 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d561b1be-ef69-4525-9f57-f26d8a4b0d83 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:40:59.786291 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d561b1be-ef69-4525-9f57-f26d8a4b0d83 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:40:59.794000 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d561b1be-ef69-4525-9f57-f26d8a4b0d83 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:59.802882 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d561b1be-ef69-4525-9f57-f26d8a4b0d83 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:59.803938 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d561b1be-ef69-4525-9f57-f26d8a4b0d83 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:40:59.804458 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d561b1be-ef69-4525-9f57-f26d8a4b0d83 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:40:59.896890 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-52ecb575-eb55-4dbe-a9bf-d8db1b283f21 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:40:59.904356 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-52ecb575-eb55-4dbe-a9bf-d8db1b283f21 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1514 microversion: 2.1 time: 0.163697 Dec 15 12:40:59.904909 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 123/243] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:40:59 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:00.340156 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-79ad81d9-0664-4f3b-a2de-cca2008eeb55 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:00.340811 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-79ad81d9-0664-4f3b-a2de-cca2008eeb55 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:00.347102 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-79ad81d9-0664-4f3b-a2de-cca2008eeb55 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:00.347550 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-79ad81d9-0664-4f3b-a2de-cca2008eeb55 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:00.348401 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-79ad81d9-0664-4f3b-a2de-cca2008eeb55 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:00.348849 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-79ad81d9-0664-4f3b-a2de-cca2008eeb55 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:00.493238 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-79ad81d9-0664-4f3b-a2de-cca2008eeb55 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:00.501163 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-79ad81d9-0664-4f3b-a2de-cca2008eeb55 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1318 microversion: 2.1 time: 0.164773 Dec 15 12:41:00.502780 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 124/244] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:00 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:41:00.506335 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9d79886a-39e7-4dcf-956f-0e0da5aadc0d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:00.507219 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9d79886a-39e7-4dcf-956f-0e0da5aadc0d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:00.513983 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9d79886a-39e7-4dcf-956f-0e0da5aadc0d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:00.514626 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9d79886a-39e7-4dcf-956f-0e0da5aadc0d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:00.515286 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9d79886a-39e7-4dcf-956f-0e0da5aadc0d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:00.515794 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9d79886a-39e7-4dcf-956f-0e0da5aadc0d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:00.545832 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9d79886a-39e7-4dcf-956f-0e0da5aadc0d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043000 Dec 15 12:41:00.546397 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 125/245] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:41:00 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:41:01.518851 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0d7add96-3eb6-45cb-a527-7ef0f04016a3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:01.519456 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0d7add96-3eb6-45cb-a527-7ef0f04016a3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:01.525696 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0d7add96-3eb6-45cb-a527-7ef0f04016a3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:01.526135 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0d7add96-3eb6-45cb-a527-7ef0f04016a3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:01.526906 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0d7add96-3eb6-45cb-a527-7ef0f04016a3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:01.527326 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0d7add96-3eb6-45cb-a527-7ef0f04016a3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:01.664108 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0d7add96-3eb6-45cb-a527-7ef0f04016a3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:01.672110 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0d7add96-3eb6-45cb-a527-7ef0f04016a3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1318 microversion: 2.1 time: 0.157012 Dec 15 12:41:01.672679 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 126/246] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:01 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:41:01.676995 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-616ee580-6c93-4904-8074-20c571615a6d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:01.677915 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-616ee580-6c93-4904-8074-20c571615a6d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:01.683696 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-616ee580-6c93-4904-8074-20c571615a6d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:01.685014 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-616ee580-6c93-4904-8074-20c571615a6d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:01.685601 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-616ee580-6c93-4904-8074-20c571615a6d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:01.686038 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-616ee580-6c93-4904-8074-20c571615a6d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:01.715987 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-616ee580-6c93-4904-8074-20c571615a6d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042225 Dec 15 12:41:01.716570 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 127/247] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:41:01 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:41:02.689598 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-88f35ae3-9389-40a0-8c02-ab49687ada34 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:02.690294 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-88f35ae3-9389-40a0-8c02-ab49687ada34 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:02.697222 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-88f35ae3-9389-40a0-8c02-ab49687ada34 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:02.697713 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-88f35ae3-9389-40a0-8c02-ab49687ada34 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:02.698544 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-88f35ae3-9389-40a0-8c02-ab49687ada34 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:02.698975 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-88f35ae3-9389-40a0-8c02-ab49687ada34 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:02.838393 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d561b1be-ef69-4525-9f57-f26d8a4b0d83 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 27669 microversion: 2.20 time: 3.057548 Dec 15 12:41:02.839806 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 121/248] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:40:59 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 27669 bytes in 3060 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:41:02.845723 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-88f35ae3-9389-40a0-8c02-ab49687ada34 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:02.847367 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ef281e79-a3bf-44fe-a321-6256f6f795d2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:02.849318 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ef281e79-a3bf-44fe-a321-6256f6f795d2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:02.854218 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-88f35ae3-9389-40a0-8c02-ab49687ada34 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1318 microversion: 2.1 time: 0.168156 Dec 15 12:41:02.855068 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 128/249] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:02 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:41:02.861246 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ef281e79-a3bf-44fe-a321-6256f6f795d2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:02.862214 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ef281e79-a3bf-44fe-a321-6256f6f795d2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:02.863089 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ef281e79-a3bf-44fe-a321-6256f6f795d2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:02.863584 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ef281e79-a3bf-44fe-a321-6256f6f795d2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:02.913673 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ef281e79-a3bf-44fe-a321-6256f6f795d2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071722 Dec 15 12:41:02.914310 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 122/250] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:41:02 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:41:03.441629 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [req-87f4aca0-52e0-4cc2-b164-78fc163a84eb req-0ad60938-e295-4da2-afb7-a3e37f238ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7081597f-acfc-473d-8e16-f7b52bcdd7c9", "tag": "63e1b6fa-4807-4033-9813-10db2ee79bab"}]} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:03.443631 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:41:03.443631 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: warnings.warn(msg) Dec 15 12:41:03.451684 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-87f4aca0-52e0-4cc2-b164-78fc163a84eb req-0ad60938-e295-4da2-afb7-a3e37f238ba0 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:03.452113 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-87f4aca0-52e0-4cc2-b164-78fc163a84eb req-0ad60938-e295-4da2-afb7-a3e37f238ba0 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:03.463966 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.compute.server_external_events [req-87f4aca0-52e0-4cc2-b164-78fc163a84eb req-0ad60938-e295-4da2-afb7-a3e37f238ba0 service nova] Creating event network-changed:63e1b6fa-4807-4033-9813-10db2ee79bab for instance 7081597f-acfc-473d-8e16-f7b52bcdd7c9 on hv-cinder-81322 Dec 15 12:41:03.469569 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [req-87f4aca0-52e0-4cc2-b164-78fc163a84eb req-0ad60938-e295-4da2-afb7-a3e37f238ba0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032503 Dec 15 12:41:03.470252 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 129/251] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 12:41:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:41:03.854792 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fc002d9e-1855-4823-8b78-3bfe0b928eeb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:03.855740 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fc002d9e-1855-4823-8b78-3bfe0b928eeb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:03.862591 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fc002d9e-1855-4823-8b78-3bfe0b928eeb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:03.863054 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fc002d9e-1855-4823-8b78-3bfe0b928eeb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:03.863860 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fc002d9e-1855-4823-8b78-3bfe0b928eeb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:03.864337 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fc002d9e-1855-4823-8b78-3bfe0b928eeb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:03.874410 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f368d690-7d37-4f4a-82c4-36b17dc75ce1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:03.875110 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f368d690-7d37-4f4a-82c4-36b17dc75ce1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:03.881913 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f368d690-7d37-4f4a-82c4-36b17dc75ce1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:03.882459 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f368d690-7d37-4f4a-82c4-36b17dc75ce1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:03.883266 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f368d690-7d37-4f4a-82c4-36b17dc75ce1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:03.883733 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f368d690-7d37-4f4a-82c4-36b17dc75ce1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:03.972665 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fc002d9e-1855-4823-8b78-3bfe0b928eeb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 27882 microversion: 2.20 time: 0.121931 Dec 15 12:41:03.977238 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 123/252] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:41:03 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 27882 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:41:03.984685 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-35558866-9eae-41b2-ae0a-aaacafb7cf78 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:03.985744 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-35558866-9eae-41b2-ae0a-aaacafb7cf78 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:04.003026 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-35558866-9eae-41b2-ae0a-aaacafb7cf78 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:04.003671 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-35558866-9eae-41b2-ae0a-aaacafb7cf78 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:04.004648 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-35558866-9eae-41b2-ae0a-aaacafb7cf78 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:04.005769 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-35558866-9eae-41b2-ae0a-aaacafb7cf78 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:04.047512 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-35558866-9eae-41b2-ae0a-aaacafb7cf78 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068547 Dec 15 12:41:04.048093 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 124/253] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:41:03 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:41:04.082082 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-f368d690-7d37-4f4a-82c4-36b17dc75ce1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:04.091673 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f368d690-7d37-4f4a-82c4-36b17dc75ce1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1318 microversion: 2.1 time: 0.221958 Dec 15 12:41:04.092740 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 130/254] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:03 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:41:04.409463 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e75b07fb-3c27-417d-b259-2688aaeea7df tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:04.410709 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e75b07fb-3c27-417d-b259-2688aaeea7df tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:04.418044 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e75b07fb-3c27-417d-b259-2688aaeea7df tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:04.419017 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e75b07fb-3c27-417d-b259-2688aaeea7df tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:04.419904 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e75b07fb-3c27-417d-b259-2688aaeea7df tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:04.420343 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e75b07fb-3c27-417d-b259-2688aaeea7df tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:04.446697 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.objects.instance [None req-e75b07fb-3c27-417d-b259-2688aaeea7df tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lazy-loading 'flavor' on Instance uuid 2824788a-14d6-488d-8af1-2df6b3de771a {{(pid=122614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 12:41:04.733268 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e75b07fb-3c27-417d-b259-2688aaeea7df tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "POST /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/action" status: 200 len: 32 microversion: 2.1 time: 0.327581 Dec 15 12:41:04.733951 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 125/255] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 12:41:04 2021] POST /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/action => generated 32 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 12:41:04.742672 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1db7a7eb-9a78-4503-9c78-b67b403595f5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:04.743290 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1db7a7eb-9a78-4503-9c78-b67b403595f5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:04.756346 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1db7a7eb-9a78-4503-9c78-b67b403595f5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:04.756794 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1db7a7eb-9a78-4503-9c78-b67b403595f5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:04.757833 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1db7a7eb-9a78-4503-9c78-b67b403595f5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:04.758265 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1db7a7eb-9a78-4503-9c78-b67b403595f5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:04.895795 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1db7a7eb-9a78-4503-9c78-b67b403595f5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:04.904543 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1db7a7eb-9a78-4503-9c78-b67b403595f5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1520 microversion: 2.1 time: 0.165319 Dec 15 12:41:04.905137 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 131/256] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:04 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:04.985983 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-079b3b9b-9fd6-4ba2-a459-b456a051a040 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:04.987227 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-079b3b9b-9fd6-4ba2-a459-b456a051a040 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:04.994364 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-079b3b9b-9fd6-4ba2-a459-b456a051a040 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:04.994814 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-079b3b9b-9fd6-4ba2-a459-b456a051a040 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:04.995641 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-079b3b9b-9fd6-4ba2-a459-b456a051a040 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:04.996079 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-079b3b9b-9fd6-4ba2-a459-b456a051a040 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:05.058469 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-cc543763-22cd-4f00-97b7-37ba299c7767 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:05.060440 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-cc543763-22cd-4f00-97b7-37ba299c7767 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:05.066843 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc543763-22cd-4f00-97b7-37ba299c7767 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:05.067283 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc543763-22cd-4f00-97b7-37ba299c7767 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:05.068250 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc543763-22cd-4f00-97b7-37ba299c7767 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:05.069021 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc543763-22cd-4f00-97b7-37ba299c7767 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:05.099321 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-079b3b9b-9fd6-4ba2-a459-b456a051a040 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 28172 microversion: 2.20 time: 0.118154 Dec 15 12:41:05.100090 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cc543763-22cd-4f00-97b7-37ba299c7767 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045364 Dec 15 12:41:05.100838 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 132/257] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:41:05 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 12:41:05.103781 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 126/258] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:41:04 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 28172 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:41:05.118965 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-45f40f85-3f93-43c6-9e9d-d383012635ab tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:05.119673 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-45f40f85-3f93-43c6-9e9d-d383012635ab tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:05.126408 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-45f40f85-3f93-43c6-9e9d-d383012635ab tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:05.126923 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-45f40f85-3f93-43c6-9e9d-d383012635ab tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:05.128345 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-45f40f85-3f93-43c6-9e9d-d383012635ab tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:05.128848 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-45f40f85-3f93-43c6-9e9d-d383012635ab tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:05.297757 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-45f40f85-3f93-43c6-9e9d-d383012635ab tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:05.306872 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-45f40f85-3f93-43c6-9e9d-d383012635ab tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1318 microversion: 2.1 time: 0.191214 Dec 15 12:41:05.307273 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c3191620-01ef-4345-bdc1-6cdc0c331e9a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1291387883", "imageRef": "d302555e-2bff-4492-b57d-d59c0097a278", "flavorRef": "452", "networks": [{"uuid": "9067fc36-c028-414f-82b9-4a3d3b202a5f"}]}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:05.309567 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 133/259] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:05 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:05.375169 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.network.neutron [None req-c3191620-01ef-4345-bdc1-6cdc0c331e9a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] validate_networks() for [('9067fc36-c028-414f-82b9-4a3d3b202a5f', None, None, None, None, None)] {{(pid=122614) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 12:41:05.851900 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-c3191620-01ef-4345-bdc1-6cdc0c331e9a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Flavor limits 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 12:41:05.852261 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-c3191620-01ef-4345-bdc1-6cdc0c331e9a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Image limits 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 12:41:05.852741 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-c3191620-01ef-4345-bdc1-6cdc0c331e9a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Flavor pref 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 12:41:05.853172 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-c3191620-01ef-4345-bdc1-6cdc0c331e9a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Image pref 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 12:41:05.853622 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-c3191620-01ef-4345-bdc1-6cdc0c331e9a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 12:41:05.862947 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c3191620-01ef-4345-bdc1-6cdc0c331e9a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:05.863399 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c3191620-01ef-4345-bdc1-6cdc0c331e9a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:05.864216 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c3191620-01ef-4345-bdc1-6cdc0c331e9a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:05.864652 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c3191620-01ef-4345-bdc1-6cdc0c331e9a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:05.881847 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-c3191620-01ef-4345-bdc1-6cdc0c331e9a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Getting quotas for project c4b04b03b8f94235be29043cfb8198ce. Resources: {'instances', 'cores', 'ram'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 12:41:05.885796 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-c3191620-01ef-4345-bdc1-6cdc0c331e9a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Getting quotas for user 20aef34cb7444687acf501f6aedca443 and project c4b04b03b8f94235be29043cfb8198ce. Resources: {'instances', 'cores', 'ram'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 12:41:05.905880 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c3191620-01ef-4345-bdc1-6cdc0c331e9a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Going to run 1 instances... {{(pid=122614) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 12:41:05.909218 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c3191620-01ef-4345-bdc1-6cdc0c331e9a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d302555e-2bff-4492-b57d-d59c0097a278',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 12:41:05.922913 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-78783978-b1e3-42dc-a1a8-9561f43c7845 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:05.924261 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-78783978-b1e3-42dc-a1a8-9561f43c7845 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:05.932257 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-78783978-b1e3-42dc-a1a8-9561f43c7845 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:05.932744 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-78783978-b1e3-42dc-a1a8-9561f43c7845 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:05.933608 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-78783978-b1e3-42dc-a1a8-9561f43c7845 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:05.934714 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-78783978-b1e3-42dc-a1a8-9561f43c7845 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:05.962078 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c3191620-01ef-4345-bdc1-6cdc0c331e9a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.664356 Dec 15 12:41:05.965829 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 127/260] 10.222.0.76 () {60 vars in 1146 bytes} [Wed Dec 15 12:41:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 12:41:05.973253 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-689b52a8-1c74-467f-9ad5-7ee04c17d7d4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:05.974057 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-689b52a8-1c74-467f-9ad5-7ee04c17d7d4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:06.041040 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-689b52a8-1c74-467f-9ad5-7ee04c17d7d4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:06.049878 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-689b52a8-1c74-467f-9ad5-7ee04c17d7d4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18" status: 200 len: 1218 microversion: 2.1 time: 0.080252 Dec 15 12:41:06.060187 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 128/261] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:05 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:06.115271 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-80cd3d34-c10d-42a6-aecf-9d5a6a05df8a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:06.116970 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-80cd3d34-c10d-42a6-aecf-9d5a6a05df8a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:06.118911 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-78783978-b1e3-42dc-a1a8-9561f43c7845 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:06.125921 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-80cd3d34-c10d-42a6-aecf-9d5a6a05df8a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:06.126594 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-80cd3d34-c10d-42a6-aecf-9d5a6a05df8a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:06.128086 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-80cd3d34-c10d-42a6-aecf-9d5a6a05df8a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:06.128750 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-80cd3d34-c10d-42a6-aecf-9d5a6a05df8a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:06.129341 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-78783978-b1e3-42dc-a1a8-9561f43c7845 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1520 microversion: 2.1 time: 0.210382 Dec 15 12:41:06.130197 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 134/262] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:05 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:41:06.211954 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-80cd3d34-c10d-42a6-aecf-9d5a6a05df8a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 28172 microversion: 2.20 time: 0.103077 Dec 15 12:41:06.212673 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 129/263] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:41:06 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 28172 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:41:06.324547 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-51ba3eb1-e127-49fb-b661-6b274cf16664 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:06.325697 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-51ba3eb1-e127-49fb-b661-6b274cf16664 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:06.332044 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-51ba3eb1-e127-49fb-b661-6b274cf16664 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:06.332527 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-51ba3eb1-e127-49fb-b661-6b274cf16664 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:06.333330 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-51ba3eb1-e127-49fb-b661-6b274cf16664 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:06.333790 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-51ba3eb1-e127-49fb-b661-6b274cf16664 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:06.494163 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-51ba3eb1-e127-49fb-b661-6b274cf16664 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:06.503220 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-51ba3eb1-e127-49fb-b661-6b274cf16664 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1318 microversion: 2.1 time: 0.182126 Dec 15 12:41:06.504142 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 135/264] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:06 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:07.071360 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1d8e7cc1-2eb2-4d57-8fb3-54f892d59183 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:07.073108 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1d8e7cc1-2eb2-4d57-8fb3-54f892d59183 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:07.083685 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1d8e7cc1-2eb2-4d57-8fb3-54f892d59183 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:07.084377 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1d8e7cc1-2eb2-4d57-8fb3-54f892d59183 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:07.085443 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1d8e7cc1-2eb2-4d57-8fb3-54f892d59183 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:07.087394 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1d8e7cc1-2eb2-4d57-8fb3-54f892d59183 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:07.149154 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b903e7d5-cdae-471b-bd9d-3a3a9b6ca68b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:07.151376 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b903e7d5-cdae-471b-bd9d-3a3a9b6ca68b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:07.171099 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b903e7d5-cdae-471b-bd9d-3a3a9b6ca68b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:07.172556 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b903e7d5-cdae-471b-bd9d-3a3a9b6ca68b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:07.173849 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b903e7d5-cdae-471b-bd9d-3a3a9b6ca68b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:07.174360 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b903e7d5-cdae-471b-bd9d-3a3a9b6ca68b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:07.217449 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1d8e7cc1-2eb2-4d57-8fb3-54f892d59183 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:07.229589 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1d8e7cc1-2eb2-4d57-8fb3-54f892d59183 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18" status: 200 len: 1278 microversion: 2.1 time: 0.163730 Dec 15 12:41:07.240704 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 130/265] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:07 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18 => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:07.240704 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f14690a4-64db-457f-b657-bf327f81a517 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:07.240704 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f14690a4-64db-457f-b657-bf327f81a517 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:07.264247 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f14690a4-64db-457f-b657-bf327f81a517 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:07.265956 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f14690a4-64db-457f-b657-bf327f81a517 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:07.267170 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f14690a4-64db-457f-b657-bf327f81a517 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:07.270522 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f14690a4-64db-457f-b657-bf327f81a517 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:07.413812 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f14690a4-64db-457f-b657-bf327f81a517 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 28463 microversion: 2.20 time: 0.178739 Dec 15 12:41:07.414796 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 131/266] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:41:07 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 28463 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:41:07.429013 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b903e7d5-cdae-471b-bd9d-3a3a9b6ca68b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:07.443021 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b903e7d5-cdae-471b-bd9d-3a3a9b6ca68b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1520 microversion: 2.1 time: 0.298686 Dec 15 12:41:07.454036 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 136/267] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:07 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1520 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:07.524313 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-93b6a03d-9df0-431e-b02d-19aee926a623 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:07.525324 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-93b6a03d-9df0-431e-b02d-19aee926a623 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:07.533025 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-93b6a03d-9df0-431e-b02d-19aee926a623 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:07.533466 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-93b6a03d-9df0-431e-b02d-19aee926a623 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:07.534288 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-93b6a03d-9df0-431e-b02d-19aee926a623 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:07.534716 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-93b6a03d-9df0-431e-b02d-19aee926a623 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:07.678497 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-93b6a03d-9df0-431e-b02d-19aee926a623 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:07.692252 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-93b6a03d-9df0-431e-b02d-19aee926a623 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1318 microversion: 2.1 time: 0.171831 Dec 15 12:41:07.694151 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 132/268] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:07 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:08.250081 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b1f1339b-57b7-4a90-a3e4-3e16f8c47a8a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:08.250818 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b1f1339b-57b7-4a90-a3e4-3e16f8c47a8a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:08.260046 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1f1339b-57b7-4a90-a3e4-3e16f8c47a8a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:08.261677 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1f1339b-57b7-4a90-a3e4-3e16f8c47a8a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:08.263232 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1f1339b-57b7-4a90-a3e4-3e16f8c47a8a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:08.264471 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1f1339b-57b7-4a90-a3e4-3e16f8c47a8a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:08.434855 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ae9a5c3a-1953-43fc-a68c-54efe283a546 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:08.437787 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ae9a5c3a-1953-43fc-a68c-54efe283a546 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:08.469708 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b1f1339b-57b7-4a90-a3e4-3e16f8c47a8a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:08.471074 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ae9a5c3a-1953-43fc-a68c-54efe283a546 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:08.471622 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ae9a5c3a-1953-43fc-a68c-54efe283a546 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:08.472501 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ae9a5c3a-1953-43fc-a68c-54efe283a546 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:08.474542 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ae9a5c3a-1953-43fc-a68c-54efe283a546 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:08.480212 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b1f1339b-57b7-4a90-a3e4-3e16f8c47a8a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18" status: 200 len: 1318 microversion: 2.1 time: 0.235597 Dec 15 12:41:08.482473 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 137/269] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:08 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:08.489860 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7d4b3152-4585-4ff7-bacb-dc204e57b486 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:08.490876 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7d4b3152-4585-4ff7-bacb-dc204e57b486 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:08.500948 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7d4b3152-4585-4ff7-bacb-dc204e57b486 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:08.501528 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7d4b3152-4585-4ff7-bacb-dc204e57b486 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:08.502494 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7d4b3152-4585-4ff7-bacb-dc204e57b486 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:08.503213 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7d4b3152-4585-4ff7-bacb-dc204e57b486 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:08.570761 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ae9a5c3a-1953-43fc-a68c-54efe283a546 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 28463 microversion: 2.20 time: 0.146464 Dec 15 12:41:08.572654 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 133/270] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:41:08 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 28463 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:41:08.675550 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7d4b3152-4585-4ff7-bacb-dc204e57b486 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:08.683011 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7d4b3152-4585-4ff7-bacb-dc204e57b486 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1520 microversion: 2.1 time: 0.198738 Dec 15 12:41:08.683599 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 138/271] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:08 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:08.713375 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-df9f194a-95d6-451d-8d07-3e869440db1f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:08.714097 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-df9f194a-95d6-451d-8d07-3e869440db1f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:08.730912 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df9f194a-95d6-451d-8d07-3e869440db1f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:08.731614 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df9f194a-95d6-451d-8d07-3e869440db1f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:08.732761 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df9f194a-95d6-451d-8d07-3e869440db1f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:08.733486 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df9f194a-95d6-451d-8d07-3e869440db1f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:08.832157 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [req-f230f889-5dc9-4f06-8b70-f0f8d8bbcff8 req-b5d641c9-d7c1-4613-a58d-d8fde52bcb6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83492504-2fc0-4ea0-adeb-387ceb971a18", "tag": "a2b23d25-387c-46a4-a653-a1777ac34527"}]} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:08.837591 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:41:08.837591 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: warnings.warn(msg) Dec 15 12:41:08.850463 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-f230f889-5dc9-4f06-8b70-f0f8d8bbcff8 req-b5d641c9-d7c1-4613-a58d-d8fde52bcb6c service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:08.852138 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-f230f889-5dc9-4f06-8b70-f0f8d8bbcff8 req-b5d641c9-d7c1-4613-a58d-d8fde52bcb6c service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:08.873285 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.compute.server_external_events [req-f230f889-5dc9-4f06-8b70-f0f8d8bbcff8 req-b5d641c9-d7c1-4613-a58d-d8fde52bcb6c service nova] Creating event network-changed:a2b23d25-387c-46a4-a653-a1777ac34527 for instance 83492504-2fc0-4ea0-adeb-387ceb971a18 on hv-cinder-81322 Dec 15 12:41:08.878555 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [req-f230f889-5dc9-4f06-8b70-f0f8d8bbcff8 req-b5d641c9-d7c1-4613-a58d-d8fde52bcb6c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049931 Dec 15 12:41:08.879439 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 139/272] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 12:41:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:41:08.891169 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-df9f194a-95d6-451d-8d07-3e869440db1f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:08.898925 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-df9f194a-95d6-451d-8d07-3e869440db1f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1318 microversion: 2.1 time: 0.192021 Dec 15 12:41:08.899415 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 134/273] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:08 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:41:09.500592 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ed6db89a-7aba-4a21-b4ff-129161531a99 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:09.501748 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ed6db89a-7aba-4a21-b4ff-129161531a99 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:09.508217 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ed6db89a-7aba-4a21-b4ff-129161531a99 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:09.508673 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ed6db89a-7aba-4a21-b4ff-129161531a99 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:09.509459 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ed6db89a-7aba-4a21-b4ff-129161531a99 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:09.509923 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ed6db89a-7aba-4a21-b4ff-129161531a99 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:09.585088 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c91f51ad-255f-4696-962f-1123984a9d01 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:09.586161 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c91f51ad-255f-4696-962f-1123984a9d01 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:09.596729 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c91f51ad-255f-4696-962f-1123984a9d01 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:09.600613 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c91f51ad-255f-4696-962f-1123984a9d01 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:09.603827 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c91f51ad-255f-4696-962f-1123984a9d01 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:09.604117 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c91f51ad-255f-4696-962f-1123984a9d01 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:09.707792 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ed6db89a-7aba-4a21-b4ff-129161531a99 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:09.715019 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ed6db89a-7aba-4a21-b4ff-129161531a99 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18" status: 200 len: 1318 microversion: 2.1 time: 0.219615 Dec 15 12:41:09.715731 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 140/274] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:09 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:41:09.720219 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-cefc14da-d0e6-4b7e-b0b9-ec67953e1614 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:09.721058 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-cefc14da-d0e6-4b7e-b0b9-ec67953e1614 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:09.727857 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cefc14da-d0e6-4b7e-b0b9-ec67953e1614 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:09.728147 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cefc14da-d0e6-4b7e-b0b9-ec67953e1614 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:09.729276 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cefc14da-d0e6-4b7e-b0b9-ec67953e1614 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:09.729739 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cefc14da-d0e6-4b7e-b0b9-ec67953e1614 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:09.870047 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-cefc14da-d0e6-4b7e-b0b9-ec67953e1614 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:09.877870 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cefc14da-d0e6-4b7e-b0b9-ec67953e1614 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1520 microversion: 2.1 time: 0.160765 Dec 15 12:41:09.878441 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 141/275] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:09 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:09.915675 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-efb38806-ea6c-4f36-8cbe-7d7779f69987 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:09.916280 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-efb38806-ea6c-4f36-8cbe-7d7779f69987 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:09.922651 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-efb38806-ea6c-4f36-8cbe-7d7779f69987 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:09.923104 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-efb38806-ea6c-4f36-8cbe-7d7779f69987 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:09.923879 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-efb38806-ea6c-4f36-8cbe-7d7779f69987 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:09.924302 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-efb38806-ea6c-4f36-8cbe-7d7779f69987 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:10.132286 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-efb38806-ea6c-4f36-8cbe-7d7779f69987 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:10.140734 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-efb38806-ea6c-4f36-8cbe-7d7779f69987 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1318 microversion: 2.1 time: 0.228534 Dec 15 12:41:10.150571 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 142/276] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:09 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:41:10.732113 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8fc53adb-5bb9-4125-9e0d-080aa03b5857 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:10.732722 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8fc53adb-5bb9-4125-9e0d-080aa03b5857 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:10.742879 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8fc53adb-5bb9-4125-9e0d-080aa03b5857 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:10.743328 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8fc53adb-5bb9-4125-9e0d-080aa03b5857 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:10.744130 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8fc53adb-5bb9-4125-9e0d-080aa03b5857 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:10.744559 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8fc53adb-5bb9-4125-9e0d-080aa03b5857 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:10.897324 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8fc53adb-5bb9-4125-9e0d-080aa03b5857 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:10.905175 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8fc53adb-5bb9-4125-9e0d-080aa03b5857 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18" status: 200 len: 1318 microversion: 2.1 time: 0.177432 Dec 15 12:41:10.906204 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 143/277] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:10 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:41:10.910439 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a37e5fc0-0ae1-4a84-b556-1bdb73aa3d96 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:10.911031 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a37e5fc0-0ae1-4a84-b556-1bdb73aa3d96 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:10.916770 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a37e5fc0-0ae1-4a84-b556-1bdb73aa3d96 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:10.917209 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a37e5fc0-0ae1-4a84-b556-1bdb73aa3d96 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:10.918027 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a37e5fc0-0ae1-4a84-b556-1bdb73aa3d96 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:10.918555 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a37e5fc0-0ae1-4a84-b556-1bdb73aa3d96 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:11.069537 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a37e5fc0-0ae1-4a84-b556-1bdb73aa3d96 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:11.077413 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a37e5fc0-0ae1-4a84-b556-1bdb73aa3d96 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1520 microversion: 2.1 time: 0.170230 Dec 15 12:41:11.078027 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 144/278] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:10 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:11.158223 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b6c024fe-2116-46cc-bf54-eba516e3567c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:11.158707 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b6c024fe-2116-46cc-bf54-eba516e3567c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:11.164814 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b6c024fe-2116-46cc-bf54-eba516e3567c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:11.165331 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b6c024fe-2116-46cc-bf54-eba516e3567c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:11.166166 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b6c024fe-2116-46cc-bf54-eba516e3567c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:11.166599 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b6c024fe-2116-46cc-bf54-eba516e3567c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:11.377946 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b6c024fe-2116-46cc-bf54-eba516e3567c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:11.385326 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b6c024fe-2116-46cc-bf54-eba516e3567c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1318 microversion: 2.1 time: 0.231212 Dec 15 12:41:11.386284 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 145/279] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:11 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:11.880005 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c91f51ad-255f-4696-962f-1123984a9d01 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 28630 microversion: 2.20 time: 2.298576 Dec 15 12:41:11.880495 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 135/280] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:41:09 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 28630 bytes in 2300 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:41:11.930084 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c1ae7857-5bd9-4a94-9788-4a2f190fd8a1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:11.930801 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c1ae7857-5bd9-4a94-9788-4a2f190fd8a1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:11.940200 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c1ae7857-5bd9-4a94-9788-4a2f190fd8a1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:11.941306 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c1ae7857-5bd9-4a94-9788-4a2f190fd8a1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:11.942604 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c1ae7857-5bd9-4a94-9788-4a2f190fd8a1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:11.943182 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c1ae7857-5bd9-4a94-9788-4a2f190fd8a1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:12.102984 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c1ae7857-5bd9-4a94-9788-4a2f190fd8a1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:12.111675 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c1ae7857-5bd9-4a94-9788-4a2f190fd8a1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18" status: 200 len: 1318 microversion: 2.1 time: 0.190560 Dec 15 12:41:12.112506 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9b73bc03-6647-4b23-8cac-6fe1c22a43d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:12.115564 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9b73bc03-6647-4b23-8cac-6fe1c22a43d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:12.116774 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 146/281] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:11 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:12.134746 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9b73bc03-6647-4b23-8cac-6fe1c22a43d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:12.135543 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9b73bc03-6647-4b23-8cac-6fe1c22a43d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:12.136639 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9b73bc03-6647-4b23-8cac-6fe1c22a43d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:12.137549 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9b73bc03-6647-4b23-8cac-6fe1c22a43d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:12.313383 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9b73bc03-6647-4b23-8cac-6fe1c22a43d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:12.321599 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9b73bc03-6647-4b23-8cac-6fe1c22a43d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1520 microversion: 2.1 time: 0.230172 Dec 15 12:41:12.322498 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 136/282] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:12 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:12.403814 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1bfda388-1277-411a-a1f1-b76c9ed618ec tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:12.404477 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1bfda388-1277-411a-a1f1-b76c9ed618ec tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:12.411241 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1bfda388-1277-411a-a1f1-b76c9ed618ec tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:12.411599 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1bfda388-1277-411a-a1f1-b76c9ed618ec tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:12.412528 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1bfda388-1277-411a-a1f1-b76c9ed618ec tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:12.412965 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1bfda388-1277-411a-a1f1-b76c9ed618ec tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:12.569367 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1bfda388-1277-411a-a1f1-b76c9ed618ec tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:12.579833 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1bfda388-1277-411a-a1f1-b76c9ed618ec tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1318 microversion: 2.1 time: 0.179836 Dec 15 12:41:12.580785 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 147/283] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:12 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:12.894135 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-488ea9eb-d495-4268-a487-b13dcaffd983 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:12.895643 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-488ea9eb-d495-4268-a487-b13dcaffd983 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:12.907338 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-488ea9eb-d495-4268-a487-b13dcaffd983 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:12.907607 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-488ea9eb-d495-4268-a487-b13dcaffd983 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:12.908567 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-488ea9eb-d495-4268-a487-b13dcaffd983 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:12.908984 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-488ea9eb-d495-4268-a487-b13dcaffd983 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:13.021377 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-488ea9eb-d495-4268-a487-b13dcaffd983 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 28630 microversion: 2.20 time: 0.130598 Dec 15 12:41:13.022546 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 137/284] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:41:12 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 28630 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:41:13.134445 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-df8ee4b6-e8ad-4bb2-a4a2-11f658203e2e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:13.135054 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-df8ee4b6-e8ad-4bb2-a4a2-11f658203e2e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:13.141838 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-df8ee4b6-e8ad-4bb2-a4a2-11f658203e2e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:13.142281 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-df8ee4b6-e8ad-4bb2-a4a2-11f658203e2e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:13.143053 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-df8ee4b6-e8ad-4bb2-a4a2-11f658203e2e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:13.143477 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-df8ee4b6-e8ad-4bb2-a4a2-11f658203e2e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:13.291402 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-df8ee4b6-e8ad-4bb2-a4a2-11f658203e2e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:13.299782 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-df8ee4b6-e8ad-4bb2-a4a2-11f658203e2e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18" status: 200 len: 1318 microversion: 2.1 time: 0.168986 Dec 15 12:41:13.300359 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 148/285] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:13 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:13.339096 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0aa538b6-5bc2-46e4-9715-442582b158ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:13.340462 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0aa538b6-5bc2-46e4-9715-442582b158ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:13.347480 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0aa538b6-5bc2-46e4-9715-442582b158ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:13.347923 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0aa538b6-5bc2-46e4-9715-442582b158ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:13.349016 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0aa538b6-5bc2-46e4-9715-442582b158ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:13.349707 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0aa538b6-5bc2-46e4-9715-442582b158ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:13.495972 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0aa538b6-5bc2-46e4-9715-442582b158ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:13.503568 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0aa538b6-5bc2-46e4-9715-442582b158ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1520 microversion: 2.1 time: 0.168468 Dec 15 12:41:13.504145 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 138/286] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:13 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:13.597455 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7d917e03-98f3-452b-b848-8284772968b4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:13.598095 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7d917e03-98f3-452b-b848-8284772968b4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:13.604131 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7d917e03-98f3-452b-b848-8284772968b4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:13.604691 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7d917e03-98f3-452b-b848-8284772968b4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:13.605460 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7d917e03-98f3-452b-b848-8284772968b4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:13.605987 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7d917e03-98f3-452b-b848-8284772968b4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:13.764199 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7d917e03-98f3-452b-b848-8284772968b4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:13.772036 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7d917e03-98f3-452b-b848-8284772968b4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1318 microversion: 2.1 time: 0.178180 Dec 15 12:41:13.772601 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 149/287] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:13 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:13.889000 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-db96d294-9652-4159-b5cb-08cc6fd755a7 req-d51cbdab-464a-421e-a9e1-11939b737dae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7081597f-acfc-473d-8e16-f7b52bcdd7c9", "name": "network-vif-plugged", "status": "completed", "tag": "63e1b6fa-4807-4033-9813-10db2ee79bab"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:13.891197 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:41:13.891197 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 12:41:13.899950 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-db96d294-9652-4159-b5cb-08cc6fd755a7 req-d51cbdab-464a-421e-a9e1-11939b737dae service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:13.901365 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-db96d294-9652-4159-b5cb-08cc6fd755a7 req-d51cbdab-464a-421e-a9e1-11939b737dae service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:13.911893 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-db96d294-9652-4159-b5cb-08cc6fd755a7 req-d51cbdab-464a-421e-a9e1-11939b737dae service nova] Creating event network-vif-plugged:63e1b6fa-4807-4033-9813-10db2ee79bab for instance 7081597f-acfc-473d-8e16-f7b52bcdd7c9 on hv-cinder-81322 Dec 15 12:41:13.916762 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-db96d294-9652-4159-b5cb-08cc6fd755a7 req-d51cbdab-464a-421e-a9e1-11939b737dae service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036557 Dec 15 12:41:13.917347 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 139/288] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 12:41:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:41:14.036424 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1ad80d78-fb26-4014-b824-28e89eaa1b3f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:14.037337 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1ad80d78-fb26-4014-b824-28e89eaa1b3f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:14.044489 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1ad80d78-fb26-4014-b824-28e89eaa1b3f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:14.045105 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1ad80d78-fb26-4014-b824-28e89eaa1b3f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:14.045927 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1ad80d78-fb26-4014-b824-28e89eaa1b3f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:14.046567 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1ad80d78-fb26-4014-b824-28e89eaa1b3f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:14.120394 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1ad80d78-fb26-4014-b824-28e89eaa1b3f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 28630 microversion: 2.20 time: 0.088152 Dec 15 12:41:14.120889 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 150/289] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:41:14 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 28630 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 12:41:14.317617 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c7d45816-0bfc-4f5f-8d30-2d932759af74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:14.318320 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c7d45816-0bfc-4f5f-8d30-2d932759af74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:14.324303 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c7d45816-0bfc-4f5f-8d30-2d932759af74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:14.324752 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c7d45816-0bfc-4f5f-8d30-2d932759af74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:14.325552 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c7d45816-0bfc-4f5f-8d30-2d932759af74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:14.325991 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c7d45816-0bfc-4f5f-8d30-2d932759af74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:14.474219 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c7d45816-0bfc-4f5f-8d30-2d932759af74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:14.482852 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c7d45816-0bfc-4f5f-8d30-2d932759af74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18" status: 200 len: 1318 microversion: 2.1 time: 0.169737 Dec 15 12:41:14.483438 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 140/290] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:14 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:14.521184 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e2c325db-dee7-4857-a144-cf35fb77fdc9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:14.522278 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e2c325db-dee7-4857-a144-cf35fb77fdc9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:14.530399 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e2c325db-dee7-4857-a144-cf35fb77fdc9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:14.530912 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e2c325db-dee7-4857-a144-cf35fb77fdc9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:14.531802 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e2c325db-dee7-4857-a144-cf35fb77fdc9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:14.532412 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e2c325db-dee7-4857-a144-cf35fb77fdc9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:14.674780 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e2c325db-dee7-4857-a144-cf35fb77fdc9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:14.683184 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e2c325db-dee7-4857-a144-cf35fb77fdc9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1520 microversion: 2.1 time: 0.165999 Dec 15 12:41:14.690265 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 151/291] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:14 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:14.789130 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1b46de25-77c1-47e4-ab43-6d0993b27681 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:14.789981 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1b46de25-77c1-47e4-ab43-6d0993b27681 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:14.796430 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1b46de25-77c1-47e4-ab43-6d0993b27681 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:14.796913 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1b46de25-77c1-47e4-ab43-6d0993b27681 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:14.797726 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1b46de25-77c1-47e4-ab43-6d0993b27681 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:14.798156 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1b46de25-77c1-47e4-ab43-6d0993b27681 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:14.953744 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1b46de25-77c1-47e4-ab43-6d0993b27681 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:14.961043 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1b46de25-77c1-47e4-ab43-6d0993b27681 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1318 microversion: 2.1 time: 0.175480 Dec 15 12:41:14.961626 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 141/292] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:14 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:15.133065 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b9fad8c1-89bb-45f4-97cd-81070fc9a081 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:15.134147 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b9fad8c1-89bb-45f4-97cd-81070fc9a081 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:15.141075 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b9fad8c1-89bb-45f4-97cd-81070fc9a081 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:15.141534 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b9fad8c1-89bb-45f4-97cd-81070fc9a081 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:15.142325 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b9fad8c1-89bb-45f4-97cd-81070fc9a081 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:15.142749 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b9fad8c1-89bb-45f4-97cd-81070fc9a081 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:15.213453 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b9fad8c1-89bb-45f4-97cd-81070fc9a081 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 28630 microversion: 2.20 time: 0.083844 Dec 15 12:41:15.214100 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 152/293] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:41:15 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 28630 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:41:15.499758 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d85a0756-10fa-423b-8483-9070ce54dd54 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:15.500371 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d85a0756-10fa-423b-8483-9070ce54dd54 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:15.506830 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d85a0756-10fa-423b-8483-9070ce54dd54 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:15.507273 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d85a0756-10fa-423b-8483-9070ce54dd54 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:15.508057 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d85a0756-10fa-423b-8483-9070ce54dd54 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:15.508489 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d85a0756-10fa-423b-8483-9070ce54dd54 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:15.644120 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d85a0756-10fa-423b-8483-9070ce54dd54 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:15.652314 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d85a0756-10fa-423b-8483-9070ce54dd54 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18" status: 200 len: 1318 microversion: 2.1 time: 0.156500 Dec 15 12:41:15.653667 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 142/294] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:15 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:15.701529 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8b085e58-ec74-4f7a-a566-bcba1598ff5d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:15.702226 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8b085e58-ec74-4f7a-a566-bcba1598ff5d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:15.709299 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8b085e58-ec74-4f7a-a566-bcba1598ff5d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:15.709802 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8b085e58-ec74-4f7a-a566-bcba1598ff5d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:15.710582 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8b085e58-ec74-4f7a-a566-bcba1598ff5d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:15.711007 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8b085e58-ec74-4f7a-a566-bcba1598ff5d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:15.845576 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8b085e58-ec74-4f7a-a566-bcba1598ff5d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:15.852963 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8b085e58-ec74-4f7a-a566-bcba1598ff5d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1520 microversion: 2.1 time: 0.156326 Dec 15 12:41:15.853555 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 153/295] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:15 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:41:15.978962 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-851b6d5f-a1bb-444d-bed9-6d71aaacf614 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:15.979613 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-851b6d5f-a1bb-444d-bed9-6d71aaacf614 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:15.986570 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-851b6d5f-a1bb-444d-bed9-6d71aaacf614 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:15.987018 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-851b6d5f-a1bb-444d-bed9-6d71aaacf614 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:15.987803 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-851b6d5f-a1bb-444d-bed9-6d71aaacf614 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:15.988244 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-851b6d5f-a1bb-444d-bed9-6d71aaacf614 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:16.225542 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-78ad5e73-1845-46b3-8069-c319833787cb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:16.226825 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-78ad5e73-1845-46b3-8069-c319833787cb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:16.235192 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-78ad5e73-1845-46b3-8069-c319833787cb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:16.235990 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-78ad5e73-1845-46b3-8069-c319833787cb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:16.238093 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-78ad5e73-1845-46b3-8069-c319833787cb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:16.238093 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-78ad5e73-1845-46b3-8069-c319833787cb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:16.314567 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-851b6d5f-a1bb-444d-bed9-6d71aaacf614 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:16.322143 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-851b6d5f-a1bb-444d-bed9-6d71aaacf614 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1318 microversion: 2.1 time: 0.346847 Dec 15 12:41:16.322826 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 143/296] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:15 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:16.670236 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f6db0ce2-5035-4ac1-85ea-afaf66b73c80 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:16.670859 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f6db0ce2-5035-4ac1-85ea-afaf66b73c80 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:16.676658 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f6db0ce2-5035-4ac1-85ea-afaf66b73c80 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:16.677091 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f6db0ce2-5035-4ac1-85ea-afaf66b73c80 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:16.677881 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f6db0ce2-5035-4ac1-85ea-afaf66b73c80 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:16.678306 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f6db0ce2-5035-4ac1-85ea-afaf66b73c80 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:16.815839 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f6db0ce2-5035-4ac1-85ea-afaf66b73c80 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:16.823156 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f6db0ce2-5035-4ac1-85ea-afaf66b73c80 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18" status: 200 len: 1318 microversion: 2.1 time: 0.156788 Dec 15 12:41:16.823713 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 144/297] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:16 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:41:16.869938 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bdb5b670-d651-4c54-8318-55de9b1af9eb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:16.870594 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bdb5b670-d651-4c54-8318-55de9b1af9eb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:16.877111 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bdb5b670-d651-4c54-8318-55de9b1af9eb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:16.877584 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bdb5b670-d651-4c54-8318-55de9b1af9eb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:16.878604 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bdb5b670-d651-4c54-8318-55de9b1af9eb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:16.879034 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bdb5b670-d651-4c54-8318-55de9b1af9eb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:17.034187 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-bdb5b670-d651-4c54-8318-55de9b1af9eb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:17.042032 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bdb5b670-d651-4c54-8318-55de9b1af9eb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1520 microversion: 2.1 time: 0.175689 Dec 15 12:41:17.042613 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 145/298] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:16 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:41:17.338607 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1beb7d6e-349c-413c-a389-2ba4cc552c7d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:17.339213 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1beb7d6e-349c-413c-a389-2ba4cc552c7d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:17.346045 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1beb7d6e-349c-413c-a389-2ba4cc552c7d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:17.346487 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1beb7d6e-349c-413c-a389-2ba4cc552c7d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:17.347268 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1beb7d6e-349c-413c-a389-2ba4cc552c7d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:17.347778 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1beb7d6e-349c-413c-a389-2ba4cc552c7d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:17.492322 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1beb7d6e-349c-413c-a389-2ba4cc552c7d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:17.500840 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1beb7d6e-349c-413c-a389-2ba4cc552c7d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1318 microversion: 2.1 time: 0.165870 Dec 15 12:41:17.501449 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 146/299] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:17 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:41:17.840757 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f17e9b6a-b7ca-4339-b908-c7cedccb16d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:17.841377 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f17e9b6a-b7ca-4339-b908-c7cedccb16d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:17.847532 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f17e9b6a-b7ca-4339-b908-c7cedccb16d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:17.847978 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f17e9b6a-b7ca-4339-b908-c7cedccb16d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:17.848769 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f17e9b6a-b7ca-4339-b908-c7cedccb16d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:17.849208 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f17e9b6a-b7ca-4339-b908-c7cedccb16d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:17.982825 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f17e9b6a-b7ca-4339-b908-c7cedccb16d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:17.990850 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f17e9b6a-b7ca-4339-b908-c7cedccb16d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18" status: 200 len: 1318 microversion: 2.1 time: 0.154327 Dec 15 12:41:17.991430 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 147/300] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:17 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:41:18.060176 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-df776e87-7c1a-4b86-a8c0-a97d1e3e3972 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:18.060959 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-df776e87-7c1a-4b86-a8c0-a97d1e3e3972 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:18.066822 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df776e87-7c1a-4b86-a8c0-a97d1e3e3972 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:18.067261 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df776e87-7c1a-4b86-a8c0-a97d1e3e3972 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:18.068044 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df776e87-7c1a-4b86-a8c0-a97d1e3e3972 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:18.068474 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df776e87-7c1a-4b86-a8c0-a97d1e3e3972 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:18.205363 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-df776e87-7c1a-4b86-a8c0-a97d1e3e3972 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:18.220947 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-df776e87-7c1a-4b86-a8c0-a97d1e3e3972 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1520 microversion: 2.1 time: 0.165116 Dec 15 12:41:18.221555 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 148/301] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:18 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:41:18.329677 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-78ad5e73-1845-46b3-8069-c319833787cb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 28630 microversion: 2.20 time: 2.107695 Dec 15 12:41:18.330591 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 154/302] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:41:16 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 28630 bytes in 2110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 12:41:18.521773 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-05bb04cd-cc31-45de-88c5-3d3831e14d88 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:18.522406 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-05bb04cd-cc31-45de-88c5-3d3831e14d88 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:18.529680 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-05bb04cd-cc31-45de-88c5-3d3831e14d88 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:18.530132 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-05bb04cd-cc31-45de-88c5-3d3831e14d88 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:18.530939 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-05bb04cd-cc31-45de-88c5-3d3831e14d88 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:18.531390 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-05bb04cd-cc31-45de-88c5-3d3831e14d88 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:18.669456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-05bb04cd-cc31-45de-88c5-3d3831e14d88 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:18.676763 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-05bb04cd-cc31-45de-88c5-3d3831e14d88 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1318 microversion: 2.1 time: 0.161211 Dec 15 12:41:18.677351 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 149/303] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:18 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:19.015142 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fac4642b-1c53-49a6-a958-532825182c88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:19.015742 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fac4642b-1c53-49a6-a958-532825182c88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:19.022778 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fac4642b-1c53-49a6-a958-532825182c88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:19.023229 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fac4642b-1c53-49a6-a958-532825182c88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:19.024006 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fac4642b-1c53-49a6-a958-532825182c88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:19.024440 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fac4642b-1c53-49a6-a958-532825182c88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:19.182965 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fac4642b-1c53-49a6-a958-532825182c88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:19.189269 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fac4642b-1c53-49a6-a958-532825182c88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18" status: 200 len: 1318 microversion: 2.1 time: 0.178364 Dec 15 12:41:19.189904 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 155/304] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:19 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:19.239443 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7b73d84b-6f32-431f-bf58-d563fa202791 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:19.240600 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7b73d84b-6f32-431f-bf58-d563fa202791 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:19.249435 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b73d84b-6f32-431f-bf58-d563fa202791 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:19.250001 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b73d84b-6f32-431f-bf58-d563fa202791 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:19.250911 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b73d84b-6f32-431f-bf58-d563fa202791 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:19.251423 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b73d84b-6f32-431f-bf58-d563fa202791 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:19.348653 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3f7537b0-f7e2-4d75-a5a0-814c238c9719 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:19.348653 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3f7537b0-f7e2-4d75-a5a0-814c238c9719 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:19.360837 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3f7537b0-f7e2-4d75-a5a0-814c238c9719 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:19.361955 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3f7537b0-f7e2-4d75-a5a0-814c238c9719 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:19.364203 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3f7537b0-f7e2-4d75-a5a0-814c238c9719 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:19.364985 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3f7537b0-f7e2-4d75-a5a0-814c238c9719 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:19.398272 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7b73d84b-6f32-431f-bf58-d563fa202791 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:19.406578 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7b73d84b-6f32-431f-bf58-d563fa202791 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1520 microversion: 2.1 time: 0.171956 Dec 15 12:41:19.407160 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 150/305] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:19 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:19.458835 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3f7537b0-f7e2-4d75-a5a0-814c238c9719 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 28630 microversion: 2.20 time: 0.121321 Dec 15 12:41:19.462940 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 156/306] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:41:19 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 28630 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 12:41:19.694840 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d4a05725-dde4-4a02-9bb7-31a3363dfd32 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:19.695448 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d4a05725-dde4-4a02-9bb7-31a3363dfd32 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:19.702508 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d4a05725-dde4-4a02-9bb7-31a3363dfd32 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:19.702957 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d4a05725-dde4-4a02-9bb7-31a3363dfd32 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:19.703743 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d4a05725-dde4-4a02-9bb7-31a3363dfd32 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:19.704174 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d4a05725-dde4-4a02-9bb7-31a3363dfd32 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:19.853356 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d4a05725-dde4-4a02-9bb7-31a3363dfd32 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:19.861018 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d4a05725-dde4-4a02-9bb7-31a3363dfd32 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1507 microversion: 2.1 time: 0.169849 Dec 15 12:41:19.861612 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 151/307] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:19 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:20.207607 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1ff7ef47-3360-46d5-8003-85350559e3a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:20.208702 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1ff7ef47-3360-46d5-8003-85350559e3a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:20.217474 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1ff7ef47-3360-46d5-8003-85350559e3a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:20.218217 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1ff7ef47-3360-46d5-8003-85350559e3a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:20.222425 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1ff7ef47-3360-46d5-8003-85350559e3a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:20.223099 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1ff7ef47-3360-46d5-8003-85350559e3a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:20.383432 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1ff7ef47-3360-46d5-8003-85350559e3a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:20.391683 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1ff7ef47-3360-46d5-8003-85350559e3a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18" status: 200 len: 1318 microversion: 2.1 time: 0.188262 Dec 15 12:41:20.392503 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 157/308] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:20 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:20.423834 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c2bcea8e-13bc-4c0f-a6c4-3d3946091660 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:20.424445 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c2bcea8e-13bc-4c0f-a6c4-3d3946091660 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:20.431719 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c2bcea8e-13bc-4c0f-a6c4-3d3946091660 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:20.432176 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c2bcea8e-13bc-4c0f-a6c4-3d3946091660 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:20.433020 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c2bcea8e-13bc-4c0f-a6c4-3d3946091660 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:20.433461 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c2bcea8e-13bc-4c0f-a6c4-3d3946091660 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:20.471230 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5d5ea72a-2516-4c13-a94b-d568abcc2142 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:20.472145 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5d5ea72a-2516-4c13-a94b-d568abcc2142 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:20.478375 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5d5ea72a-2516-4c13-a94b-d568abcc2142 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:20.478813 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5d5ea72a-2516-4c13-a94b-d568abcc2142 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:20.479588 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5d5ea72a-2516-4c13-a94b-d568abcc2142 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:20.480009 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5d5ea72a-2516-4c13-a94b-d568abcc2142 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:20.566354 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5d5ea72a-2516-4c13-a94b-d568abcc2142 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 28630 microversion: 2.20 time: 0.098401 Dec 15 12:41:20.567597 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 158/309] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:41:20 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 28630 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:41:20.589338 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c2bcea8e-13bc-4c0f-a6c4-3d3946091660 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:20.597773 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c2bcea8e-13bc-4c0f-a6c4-3d3946091660 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1520 microversion: 2.1 time: 0.177673 Dec 15 12:41:20.598433 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 152/310] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:20 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:21.411704 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-13240e0c-21bb-48c0-83af-7eb92cd449c5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:21.413030 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-13240e0c-21bb-48c0-83af-7eb92cd449c5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:21.423452 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-13240e0c-21bb-48c0-83af-7eb92cd449c5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:21.423907 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-13240e0c-21bb-48c0-83af-7eb92cd449c5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:21.424720 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-13240e0c-21bb-48c0-83af-7eb92cd449c5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:21.425179 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-13240e0c-21bb-48c0-83af-7eb92cd449c5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:21.579002 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7a58c041-c126-476f-91f8-64fd67b0f403 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:21.580033 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7a58c041-c126-476f-91f8-64fd67b0f403 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:21.586658 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7a58c041-c126-476f-91f8-64fd67b0f403 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:21.587329 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7a58c041-c126-476f-91f8-64fd67b0f403 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:21.588633 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7a58c041-c126-476f-91f8-64fd67b0f403 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:21.589531 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7a58c041-c126-476f-91f8-64fd67b0f403 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:21.589713 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-13240e0c-21bb-48c0-83af-7eb92cd449c5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:21.598682 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-13240e0c-21bb-48c0-83af-7eb92cd449c5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18" status: 200 len: 1318 microversion: 2.1 time: 0.191402 Dec 15 12:41:21.599360 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 159/311] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:21 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:21.616760 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2f1fd6da-8574-46a4-aea8-2ada216679d3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:21.618318 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2f1fd6da-8574-46a4-aea8-2ada216679d3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:21.624722 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2f1fd6da-8574-46a4-aea8-2ada216679d3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:21.626407 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2f1fd6da-8574-46a4-aea8-2ada216679d3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:21.627877 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2f1fd6da-8574-46a4-aea8-2ada216679d3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:21.628722 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2f1fd6da-8574-46a4-aea8-2ada216679d3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:21.692052 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7a58c041-c126-476f-91f8-64fd67b0f403 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 28630 microversion: 2.20 time: 0.117006 Dec 15 12:41:21.693694 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 153/312] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:41:21 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 28630 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:41:21.798194 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2f1fd6da-8574-46a4-aea8-2ada216679d3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:21.806659 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2f1fd6da-8574-46a4-aea8-2ada216679d3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1500 microversion: 2.1 time: 0.194473 Dec 15 12:41:21.807536 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 160/313] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:21 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1500 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:41:21.833590 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-86a091b0-86ec-4b2f-911f-f2e240456141 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "649a75dd-4f47-4df1-89e1-1317e8826cd2"}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:21.835230 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-86a091b0-86ec-4b2f-911f-f2e240456141 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:21.845056 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-86a091b0-86ec-4b2f-911f-f2e240456141 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:21.845983 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-86a091b0-86ec-4b2f-911f-f2e240456141 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:21.847014 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-86a091b0-86ec-4b2f-911f-f2e240456141 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:21.847730 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-86a091b0-86ec-4b2f-911f-f2e240456141 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:21.895695 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.wsgi [None req-86a091b0-86ec-4b2f-911f-f2e240456141 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] HTTP exception thrown: Cannot 'attach_volume' instance 2824788a-14d6-488d-8af1-2df6b3de771a while it is in vm_state rescued Dec 15 12:41:21.896581 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-86a091b0-86ec-4b2f-911f-f2e240456141 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Returning 409 to user: Cannot 'attach_volume' instance 2824788a-14d6-488d-8af1-2df6b3de771a while it is in vm_state rescued {{(pid=122614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:41:21.898251 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-86a091b0-86ec-4b2f-911f-f2e240456141 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "POST /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.070904 Dec 15 12:41:21.899279 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 154/314] 10.222.0.76 () {60 vars in 1322 bytes} [Wed Dec 15 12:41:21 2021] POST /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 152 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Dec 15 12:41:21.908751 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-89707e39-c561-4531-952f-a15d683a7f5a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:21.909564 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-89707e39-c561-4531-952f-a15d683a7f5a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:21.920266 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-89707e39-c561-4531-952f-a15d683a7f5a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:21.921045 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-89707e39-c561-4531-952f-a15d683a7f5a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:21.921917 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-89707e39-c561-4531-952f-a15d683a7f5a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:21.922495 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-89707e39-c561-4531-952f-a15d683a7f5a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:22.018480 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-89707e39-c561-4531-952f-a15d683a7f5a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "POST /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/action" status: 202 len: 0 microversion: 2.1 time: 0.113027 Dec 15 12:41:22.019852 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 161/315] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 12:41:21 2021] POST /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:41:22.024106 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-89c8bf67-265a-4a49-9fac-ce8ec5111453 req-f4e6d409-21e6-4940-892d-3630e25e30b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83492504-2fc0-4ea0-adeb-387ceb971a18", "name": "network-vif-plugged", "status": "completed", "tag": "a2b23d25-387c-46a4-a653-a1777ac34527"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:22.026450 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:41:22.026450 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 12:41:22.029371 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ad5dd029-dbbe-46ef-9eb9-d1c82ef4e5e7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:22.030560 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ad5dd029-dbbe-46ef-9eb9-d1c82ef4e5e7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:22.040033 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad5dd029-dbbe-46ef-9eb9-d1c82ef4e5e7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:22.040793 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad5dd029-dbbe-46ef-9eb9-d1c82ef4e5e7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:22.041770 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-89c8bf67-265a-4a49-9fac-ce8ec5111453 req-f4e6d409-21e6-4940-892d-3630e25e30b8 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:22.042128 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad5dd029-dbbe-46ef-9eb9-d1c82ef4e5e7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:22.042258 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-89c8bf67-265a-4a49-9fac-ce8ec5111453 req-f4e6d409-21e6-4940-892d-3630e25e30b8 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:22.042838 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad5dd029-dbbe-46ef-9eb9-d1c82ef4e5e7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:22.076947 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-89c8bf67-265a-4a49-9fac-ce8ec5111453 req-f4e6d409-21e6-4940-892d-3630e25e30b8 service nova] Creating event network-vif-plugged:a2b23d25-387c-46a4-a653-a1777ac34527 for instance 83492504-2fc0-4ea0-adeb-387ceb971a18 on hv-cinder-81322 Dec 15 12:41:22.092158 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-89c8bf67-265a-4a49-9fac-ce8ec5111453 req-f4e6d409-21e6-4940-892d-3630e25e30b8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069609 Dec 15 12:41:22.093405 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 155/316] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 12:41:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:41:22.270498 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ad5dd029-dbbe-46ef-9eb9-d1c82ef4e5e7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:22.280193 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ad5dd029-dbbe-46ef-9eb9-d1c82ef4e5e7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1508 microversion: 2.1 time: 0.255354 Dec 15 12:41:22.281697 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 162/317] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:22 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1508 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:41:22.616554 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-492300d6-7fcf-47e9-a2f8-4cd0177da573 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:22.617144 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-492300d6-7fcf-47e9-a2f8-4cd0177da573 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:22.623858 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-492300d6-7fcf-47e9-a2f8-4cd0177da573 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:22.624612 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-492300d6-7fcf-47e9-a2f8-4cd0177da573 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:22.625396 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-492300d6-7fcf-47e9-a2f8-4cd0177da573 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:22.625851 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-492300d6-7fcf-47e9-a2f8-4cd0177da573 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:22.705902 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c566c5e8-5b36-4a24-990b-61be9b1396a3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:22.707815 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c566c5e8-5b36-4a24-990b-61be9b1396a3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:22.714299 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c566c5e8-5b36-4a24-990b-61be9b1396a3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:22.714744 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c566c5e8-5b36-4a24-990b-61be9b1396a3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:22.715642 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c566c5e8-5b36-4a24-990b-61be9b1396a3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:22.717090 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c566c5e8-5b36-4a24-990b-61be9b1396a3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:22.838668 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-492300d6-7fcf-47e9-a2f8-4cd0177da573 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:22.855156 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-492300d6-7fcf-47e9-a2f8-4cd0177da573 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18" status: 200 len: 1318 microversion: 2.1 time: 0.242702 Dec 15 12:41:22.855748 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 156/318] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:22 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:22.857956 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c566c5e8-5b36-4a24-990b-61be9b1396a3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 29435 microversion: 2.20 time: 0.155905 Dec 15 12:41:22.863326 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 163/319] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:41:22 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 29435 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:41:23.298578 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c725fcef-55ef-47f4-9274-5724fd72403e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:23.299461 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c725fcef-55ef-47f4-9274-5724fd72403e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:23.306277 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c725fcef-55ef-47f4-9274-5724fd72403e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:23.306718 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c725fcef-55ef-47f4-9274-5724fd72403e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:23.307665 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c725fcef-55ef-47f4-9274-5724fd72403e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:23.308099 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c725fcef-55ef-47f4-9274-5724fd72403e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:23.510175 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c725fcef-55ef-47f4-9274-5724fd72403e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:23.517668 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c725fcef-55ef-47f4-9274-5724fd72403e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1508 microversion: 2.1 time: 0.222666 Dec 15 12:41:23.519714 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 157/320] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:23 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1508 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:23.875988 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1a5b57d9-023a-4aeb-9457-9286f1ac991b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:23.877256 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ba5558ff-0283-4f8c-b26f-30d675fd0052 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:23.878044 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1a5b57d9-023a-4aeb-9457-9286f1ac991b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:23.881782 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ba5558ff-0283-4f8c-b26f-30d675fd0052 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:23.890720 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ba5558ff-0283-4f8c-b26f-30d675fd0052 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:23.892365 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1a5b57d9-023a-4aeb-9457-9286f1ac991b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:23.892825 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1a5b57d9-023a-4aeb-9457-9286f1ac991b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:23.893704 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1a5b57d9-023a-4aeb-9457-9286f1ac991b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:23.894155 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1a5b57d9-023a-4aeb-9457-9286f1ac991b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:23.897237 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ba5558ff-0283-4f8c-b26f-30d675fd0052 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:23.898164 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ba5558ff-0283-4f8c-b26f-30d675fd0052 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:23.898629 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ba5558ff-0283-4f8c-b26f-30d675fd0052 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:24.032900 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ba5558ff-0283-4f8c-b26f-30d675fd0052 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 30223 microversion: 2.20 time: 0.165726 Dec 15 12:41:24.033744 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 164/321] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:41:23 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 30223 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:41:24.065455 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1a5b57d9-023a-4aeb-9457-9286f1ac991b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:24.074066 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1a5b57d9-023a-4aeb-9457-9286f1ac991b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18" status: 200 len: 1318 microversion: 2.1 time: 0.203068 Dec 15 12:41:24.074638 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 158/322] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:23 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:24.536705 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7ca7732a-aa29-4f5f-b0bd-b27e0572b30f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:24.537734 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7ca7732a-aa29-4f5f-b0bd-b27e0572b30f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:24.545308 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7ca7732a-aa29-4f5f-b0bd-b27e0572b30f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:24.545852 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7ca7732a-aa29-4f5f-b0bd-b27e0572b30f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:24.546676 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7ca7732a-aa29-4f5f-b0bd-b27e0572b30f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:24.547112 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7ca7732a-aa29-4f5f-b0bd-b27e0572b30f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:24.717050 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7ca7732a-aa29-4f5f-b0bd-b27e0572b30f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:24.725081 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7ca7732a-aa29-4f5f-b0bd-b27e0572b30f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1508 microversion: 2.1 time: 0.192263 Dec 15 12:41:24.725800 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 165/323] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:24 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1508 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:25.045483 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f614920e-d90d-4964-8a9e-3925bb5f7c94 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:25.046450 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f614920e-d90d-4964-8a9e-3925bb5f7c94 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:25.057976 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f614920e-d90d-4964-8a9e-3925bb5f7c94 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:25.058630 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f614920e-d90d-4964-8a9e-3925bb5f7c94 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:25.060858 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f614920e-d90d-4964-8a9e-3925bb5f7c94 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:25.061525 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f614920e-d90d-4964-8a9e-3925bb5f7c94 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:25.092772 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e99dbe65-2a20-444a-af14-ddf4740fded7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:25.093674 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e99dbe65-2a20-444a-af14-ddf4740fded7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:25.100566 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e99dbe65-2a20-444a-af14-ddf4740fded7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:25.101247 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e99dbe65-2a20-444a-af14-ddf4740fded7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:25.102271 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e99dbe65-2a20-444a-af14-ddf4740fded7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:25.102872 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e99dbe65-2a20-444a-af14-ddf4740fded7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:25.176657 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f614920e-d90d-4964-8a9e-3925bb5f7c94 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 33005 microversion: 2.20 time: 0.135454 Dec 15 12:41:25.180633 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 159/324] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:41:25 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 33005 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:41:25.259193 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e99dbe65-2a20-444a-af14-ddf4740fded7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:25.268562 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e99dbe65-2a20-444a-af14-ddf4740fded7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18" status: 200 len: 1508 microversion: 2.1 time: 0.180582 Dec 15 12:41:25.269461 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 166/325] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:25 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18 => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:41:25.743998 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-005341ac-e4f3-4e92-9c94-84bff2850d6a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:25.744843 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-005341ac-e4f3-4e92-9c94-84bff2850d6a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:25.753538 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-005341ac-e4f3-4e92-9c94-84bff2850d6a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:25.753987 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-005341ac-e4f3-4e92-9c94-84bff2850d6a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:25.754771 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-005341ac-e4f3-4e92-9c94-84bff2850d6a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:25.755198 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-005341ac-e4f3-4e92-9c94-84bff2850d6a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:25.895603 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-005341ac-e4f3-4e92-9c94-84bff2850d6a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:25.903167 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-005341ac-e4f3-4e92-9c94-84bff2850d6a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1508 microversion: 2.1 time: 0.163434 Dec 15 12:41:25.903922 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 160/326] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:25 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:26.189242 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f676c42a-3396-46b8-9306-59f9beea96a9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:26.190192 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f676c42a-3396-46b8-9306-59f9beea96a9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:26.196630 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f676c42a-3396-46b8-9306-59f9beea96a9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:26.197164 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f676c42a-3396-46b8-9306-59f9beea96a9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:26.198064 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f676c42a-3396-46b8-9306-59f9beea96a9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:26.198563 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f676c42a-3396-46b8-9306-59f9beea96a9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:26.296961 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f676c42a-3396-46b8-9306-59f9beea96a9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 33492 microversion: 2.20 time: 0.112182 Dec 15 12:41:26.298187 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 167/327] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:41:26 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 33492 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:41:26.663484 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5cb4cbe6-8083-4a08-a1fc-ea899c9a1b33 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c8ff92d-9bcb-46c3-8597-aaf207555945"}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:26.664567 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5cb4cbe6-8083-4a08-a1fc-ea899c9a1b33 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:26.675764 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5cb4cbe6-8083-4a08-a1fc-ea899c9a1b33 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:26.676452 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5cb4cbe6-8083-4a08-a1fc-ea899c9a1b33 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:26.678695 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5cb4cbe6-8083-4a08-a1fc-ea899c9a1b33 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:26.680435 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5cb4cbe6-8083-4a08-a1fc-ea899c9a1b33 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:26.926965 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-683ce019-4209-4d2e-a9a4-0a01adfdc071 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:26.927724 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-683ce019-4209-4d2e-a9a4-0a01adfdc071 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:26.938311 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-683ce019-4209-4d2e-a9a4-0a01adfdc071 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:26.938760 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-683ce019-4209-4d2e-a9a4-0a01adfdc071 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:26.939938 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-683ce019-4209-4d2e-a9a4-0a01adfdc071 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:26.940497 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-683ce019-4209-4d2e-a9a4-0a01adfdc071 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:27.099847 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-683ce019-4209-4d2e-a9a4-0a01adfdc071 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:27.107536 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-683ce019-4209-4d2e-a9a4-0a01adfdc071 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1514 microversion: 2.1 time: 0.188810 Dec 15 12:41:27.108206 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 168/328] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:26 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1514 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:41:27.311015 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c2c5bd29-af9b-4d5d-a2ed-a974c7917cd3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:27.311857 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c2c5bd29-af9b-4d5d-a2ed-a974c7917cd3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:27.318448 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2c5bd29-af9b-4d5d-a2ed-a974c7917cd3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:27.318978 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2c5bd29-af9b-4d5d-a2ed-a974c7917cd3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:27.319967 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2c5bd29-af9b-4d5d-a2ed-a974c7917cd3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:27.320806 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2c5bd29-af9b-4d5d-a2ed-a974c7917cd3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:30.067020 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c2c5bd29-af9b-4d5d-a2ed-a974c7917cd3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 35372 microversion: 2.20 time: 2.761268 Dec 15 12:41:30.071239 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 169/329] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:41:27 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 35372 bytes in 2763 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 12:41:30.172151 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5cb4cbe6-8083-4a08-a1fc-ea899c9a1b33 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "POST /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.512445 Dec 15 12:41:30.172922 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 161/330] 10.222.0.76 () {60 vars in 1322 bytes} [Wed Dec 15 12:41:26 2021] POST /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments => generated 194 bytes in 3514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:41:31.079953 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-41118548-b081-4728-aca3-34dd37914096 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:31.080942 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-41118548-b081-4728-aca3-34dd37914096 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:31.088521 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-41118548-b081-4728-aca3-34dd37914096 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:31.088965 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-41118548-b081-4728-aca3-34dd37914096 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:31.089805 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-41118548-b081-4728-aca3-34dd37914096 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:31.090236 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-41118548-b081-4728-aca3-34dd37914096 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:31.678665 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-07edddcb-ab69-4e2b-9098-a465bf1d8dca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:31.679440 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-07edddcb-ab69-4e2b-9098-a465bf1d8dca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:31.686542 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-07edddcb-ab69-4e2b-9098-a465bf1d8dca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:31.686991 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-07edddcb-ab69-4e2b-9098-a465bf1d8dca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:31.687817 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-07edddcb-ab69-4e2b-9098-a465bf1d8dca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:31.688253 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-07edddcb-ab69-4e2b-9098-a465bf1d8dca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:31.831570 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-07edddcb-ab69-4e2b-9098-a465bf1d8dca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:31.839121 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-07edddcb-ab69-4e2b-9098-a465bf1d8dca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1514 microversion: 2.1 time: 0.165345 Dec 15 12:41:31.839758 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 162/331] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:31 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:31.854700 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-cf39251e-a4b8-4a6f-b368-fe65782d8c61 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fc8320b-d8ff-463d-9969-2fcff08ee555"}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:31.855791 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-cf39251e-a4b8-4a6f-b368-fe65782d8c61 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:31.861937 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cf39251e-a4b8-4a6f-b368-fe65782d8c61 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:31.862379 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cf39251e-a4b8-4a6f-b368-fe65782d8c61 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:31.863166 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cf39251e-a4b8-4a6f-b368-fe65782d8c61 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:31.863595 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cf39251e-a4b8-4a6f-b368-fe65782d8c61 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:34.431099 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-41118548-b081-4728-aca3-34dd37914096 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 37361 microversion: 2.20 time: 3.355132 Dec 15 12:41:34.431915 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 170/332] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:41:31 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 37361 bytes in 3357 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:41:34.549845 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-cf39251e-a4b8-4a6f-b368-fe65782d8c61 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "POST /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.698424 Dec 15 12:41:34.550507 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 163/333] 10.222.0.76 () {60 vars in 1322 bytes} [Wed Dec 15 12:41:31 2021] POST /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 194 bytes in 2700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:41:35.443763 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a1350c1a-5fc8-4d94-86df-7fd0941e0052 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:35.444752 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a1350c1a-5fc8-4d94-86df-7fd0941e0052 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:35.452418 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1350c1a-5fc8-4d94-86df-7fd0941e0052 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:35.453082 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1350c1a-5fc8-4d94-86df-7fd0941e0052 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:35.454032 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1350c1a-5fc8-4d94-86df-7fd0941e0052 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:35.454437 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1350c1a-5fc8-4d94-86df-7fd0941e0052 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:35.628056 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a1350c1a-5fc8-4d94-86df-7fd0941e0052 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 37761 microversion: 2.20 time: 0.187878 Dec 15 12:41:35.628652 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 171/334] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:41:35 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 37761 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:41:36.683127 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-80ee9f60-b321-4c7b-b10c-773f1bc15794 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:36.684177 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-80ee9f60-b321-4c7b-b10c-773f1bc15794 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:36.691363 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-80ee9f60-b321-4c7b-b10c-773f1bc15794 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:36.691820 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-80ee9f60-b321-4c7b-b10c-773f1bc15794 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:36.692619 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-80ee9f60-b321-4c7b-b10c-773f1bc15794 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:36.693049 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-80ee9f60-b321-4c7b-b10c-773f1bc15794 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:39.412240 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-80ee9f60-b321-4c7b-b10c-773f1bc15794 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 38105 microversion: 2.20 time: 2.733444 Dec 15 12:41:39.416584 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 164/335] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:41:36 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 38105 bytes in 2735 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:41:40.425778 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-62172206-f60d-4e6b-b6e2-5e4ca9d0493a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:40.426802 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-62172206-f60d-4e6b-b6e2-5e4ca9d0493a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:40.433964 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-62172206-f60d-4e6b-b6e2-5e4ca9d0493a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:40.434414 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-62172206-f60d-4e6b-b6e2-5e4ca9d0493a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:40.435206 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-62172206-f60d-4e6b-b6e2-5e4ca9d0493a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:40.435640 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-62172206-f60d-4e6b-b6e2-5e4ca9d0493a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:40.532330 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-62172206-f60d-4e6b-b6e2-5e4ca9d0493a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 38105 microversion: 2.20 time: 0.111349 Dec 15 12:41:40.533625 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 172/336] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:41:40 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 38105 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:41:41.545534 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-946136b5-589f-450d-a84d-d2b0ffffd4d5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:41.546568 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-946136b5-589f-450d-a84d-d2b0ffffd4d5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:41.557140 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-946136b5-589f-450d-a84d-d2b0ffffd4d5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:41.557680 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-946136b5-589f-450d-a84d-d2b0ffffd4d5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:41.558500 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-946136b5-589f-450d-a84d-d2b0ffffd4d5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:41.559186 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-946136b5-589f-450d-a84d-d2b0ffffd4d5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:41.649425 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-946136b5-589f-450d-a84d-d2b0ffffd4d5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 200 len: 38247 microversion: 2.20 time: 0.108116 Dec 15 12:41:41.650132 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 165/337] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:41:41 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 38247 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:41:41.663667 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4ce91863-af60-4622-9473-1c44fbb65c6d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:41.664643 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4ce91863-af60-4622-9473-1c44fbb65c6d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:41.673755 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4ce91863-af60-4622-9473-1c44fbb65c6d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:41.674952 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4ce91863-af60-4622-9473-1c44fbb65c6d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:41.675859 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4ce91863-af60-4622-9473-1c44fbb65c6d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:41.676407 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4ce91863-af60-4622-9473-1c44fbb65c6d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:41.704072 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4ce91863-af60-4622-9473-1c44fbb65c6d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/ips" status: 200 len: 152 microversion: 2.20 time: 0.047039 Dec 15 12:41:41.705022 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 173/338] 10.222.0.76 () {60 vars in 1288 bytes} [Wed Dec 15 12:41:41 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/ips => generated 152 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:41:42.233127 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-05e12332-6137-4677-9b5a-0962ff98bb48 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c8ff92d-9bcb-46c3-8597-aaf207555945"}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:42.234560 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-05e12332-6137-4677-9b5a-0962ff98bb48 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:42.242416 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-05e12332-6137-4677-9b5a-0962ff98bb48 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:42.242927 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-05e12332-6137-4677-9b5a-0962ff98bb48 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:42.243818 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-05e12332-6137-4677-9b5a-0962ff98bb48 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:42.244276 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-05e12332-6137-4677-9b5a-0962ff98bb48 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:42.351813 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.wsgi [None req-05e12332-6137-4677-9b5a-0962ff98bb48 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] HTTP exception thrown: Invalid volume: volume 0c8ff92d-9bcb-46c3-8597-aaf207555945 is already attached to instances: 83492504-2fc0-4ea0-adeb-387ceb971a18 Dec 15 12:41:42.352413 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-05e12332-6137-4677-9b5a-0962ff98bb48 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Returning 400 to user: Invalid volume: volume 0c8ff92d-9bcb-46c3-8597-aaf207555945 is already attached to instances: 83492504-2fc0-4ea0-adeb-387ceb971a18 {{(pid=122614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:41:42.353378 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-05e12332-6137-4677-9b5a-0962ff98bb48 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "POST /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.124768 Dec 15 12:41:42.354043 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 166/339] 10.222.0.76 () {60 vars in 1322 bytes} [Wed Dec 15 12:41:42 2021] POST /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments => generated 174 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 12:41:42.440433 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5e171a1a-0dd2-474d-a060-3759cd214adb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:42.441014 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5e171a1a-0dd2-474d-a060-3759cd214adb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:42.447666 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5e171a1a-0dd2-474d-a060-3759cd214adb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:42.448103 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5e171a1a-0dd2-474d-a060-3759cd214adb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:42.448885 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5e171a1a-0dd2-474d-a060-3759cd214adb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:42.449464 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5e171a1a-0dd2-474d-a060-3759cd214adb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:42.581541 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.objects.instance [None req-5e171a1a-0dd2-474d-a060-3759cd214adb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lazy-loading 'services' on Instance uuid 83492504-2fc0-4ea0-adeb-387ceb971a18 {{(pid=122615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 12:41:42.698693 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5e171a1a-0dd2-474d-a060-3759cd214adb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "DELETE /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments/0c8ff92d-9bcb-46c3-8597-aaf207555945" status: 202 len: 0 microversion: 2.1 time: 0.262890 Dec 15 12:41:42.699685 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 174/340] 10.222.0.76 () {58 vars in 1415 bytes} [Wed Dec 15 12:41:42 2021] DELETE /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments/0c8ff92d-9bcb-46c3-8597-aaf207555945 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:41:42.709170 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0f9dd678-0732-440a-a707-9e299d9da204 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:42.710438 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0f9dd678-0732-440a-a707-9e299d9da204 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:42.718564 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0f9dd678-0732-440a-a707-9e299d9da204 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:42.718956 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0f9dd678-0732-440a-a707-9e299d9da204 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:42.719780 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0f9dd678-0732-440a-a707-9e299d9da204 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:42.720193 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0f9dd678-0732-440a-a707-9e299d9da204 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:42.753345 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0f9dd678-0732-440a-a707-9e299d9da204 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048578 Dec 15 12:41:42.753960 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 167/341] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:41:42 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:41:43.766071 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-846dabe5-d713-4740-9845-5200a7ce75ab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:43.767087 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-846dabe5-d713-4740-9845-5200a7ce75ab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:43.774892 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-846dabe5-d713-4740-9845-5200a7ce75ab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:43.775345 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-846dabe5-d713-4740-9845-5200a7ce75ab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:43.776191 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-846dabe5-d713-4740-9845-5200a7ce75ab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:43.776774 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-846dabe5-d713-4740-9845-5200a7ce75ab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:43.815146 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-846dabe5-d713-4740-9845-5200a7ce75ab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054331 Dec 15 12:41:43.815714 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 175/342] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:41:43 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:41:44.712691 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-cff2e5bd-84d2-4f8a-9d56-73762853563f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:44.713301 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-cff2e5bd-84d2-4f8a-9d56-73762853563f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:44.723378 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cff2e5bd-84d2-4f8a-9d56-73762853563f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:44.723832 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cff2e5bd-84d2-4f8a-9d56-73762853563f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:44.724628 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cff2e5bd-84d2-4f8a-9d56-73762853563f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:44.725057 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cff2e5bd-84d2-4f8a-9d56-73762853563f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:44.751683 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.objects.instance [None req-cff2e5bd-84d2-4f8a-9d56-73762853563f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lazy-loading 'flavor' on Instance uuid ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 {{(pid=122614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 12:41:44.826435 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-684ba627-d3ca-44c6-b2e5-da9f851fadc2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:44.827370 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-684ba627-d3ca-44c6-b2e5-da9f851fadc2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:44.834552 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-684ba627-d3ca-44c6-b2e5-da9f851fadc2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:44.835007 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-684ba627-d3ca-44c6-b2e5-da9f851fadc2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:44.835773 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-684ba627-d3ca-44c6-b2e5-da9f851fadc2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:44.836199 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-684ba627-d3ca-44c6-b2e5-da9f851fadc2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:44.868281 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-684ba627-d3ca-44c6-b2e5-da9f851fadc2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045490 Dec 15 12:41:44.869064 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 176/343] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:41:44 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:41:45.500416 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-cff2e5bd-84d2-4f8a-9d56-73762853563f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 202 len: 0 microversion: 2.20 time: 0.791491 Dec 15 12:41:45.504737 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 168/344] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:41:44 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 0 bytes in 793 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 15 12:41:45.509903 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-54a14861-52cb-4871-b358-caea0ca76999 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:45.510995 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-54a14861-52cb-4871-b358-caea0ca76999 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:45.517818 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-54a14861-52cb-4871-b358-caea0ca76999 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:45.518274 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-54a14861-52cb-4871-b358-caea0ca76999 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:45.519108 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-54a14861-52cb-4871-b358-caea0ca76999 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:45.520145 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-54a14861-52cb-4871-b358-caea0ca76999 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:45.694276 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-54a14861-52cb-4871-b358-caea0ca76999 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:45.703151 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-54a14861-52cb-4871-b358-caea0ca76999 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:45.706648 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-54a14861-52cb-4871-b358-caea0ca76999 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:45.706648 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-54a14861-52cb-4871-b358-caea0ca76999 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1724 microversion: 2.20 time: 0.199901 Dec 15 12:41:45.706985 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 177/345] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:41:45 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:41:45.881666 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e15c87d4-c5b2-4cf3-9644-6a41146bcc70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:45.883449 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e15c87d4-c5b2-4cf3-9644-6a41146bcc70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:45.890585 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e15c87d4-c5b2-4cf3-9644-6a41146bcc70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:45.891356 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e15c87d4-c5b2-4cf3-9644-6a41146bcc70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:45.892398 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e15c87d4-c5b2-4cf3-9644-6a41146bcc70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:45.893171 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e15c87d4-c5b2-4cf3-9644-6a41146bcc70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:45.939841 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e15c87d4-c5b2-4cf3-9644-6a41146bcc70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062929 Dec 15 12:41:45.940872 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 169/346] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:41:45 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:41:46.724565 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-61ff72fd-2ad1-4fac-b0a3-0d7d83cacb76 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:46.725342 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-61ff72fd-2ad1-4fac-b0a3-0d7d83cacb76 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:46.731606 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-61ff72fd-2ad1-4fac-b0a3-0d7d83cacb76 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:46.732049 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-61ff72fd-2ad1-4fac-b0a3-0d7d83cacb76 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:46.732824 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-61ff72fd-2ad1-4fac-b0a3-0d7d83cacb76 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:46.733252 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-61ff72fd-2ad1-4fac-b0a3-0d7d83cacb76 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:46.863476 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-61ff72fd-2ad1-4fac-b0a3-0d7d83cacb76 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:46.871843 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-61ff72fd-2ad1-4fac-b0a3-0d7d83cacb76 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:46.873257 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-61ff72fd-2ad1-4fac-b0a3-0d7d83cacb76 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:46.874461 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-61ff72fd-2ad1-4fac-b0a3-0d7d83cacb76 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1724 microversion: 2.20 time: 0.153553 Dec 15 12:41:46.875028 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 178/347] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:41:46 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:41:46.951733 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1abf27a6-a226-411f-b5e9-c80be8fac8e8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:46.952793 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1abf27a6-a226-411f-b5e9-c80be8fac8e8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:46.959148 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1abf27a6-a226-411f-b5e9-c80be8fac8e8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:46.959585 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1abf27a6-a226-411f-b5e9-c80be8fac8e8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:46.960345 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1abf27a6-a226-411f-b5e9-c80be8fac8e8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:46.960772 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1abf27a6-a226-411f-b5e9-c80be8fac8e8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:46.993742 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1abf27a6-a226-411f-b5e9-c80be8fac8e8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045500 Dec 15 12:41:46.994329 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 170/348] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:41:46 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:41:47.892636 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b34f4312-81b0-4ea4-b1c6-b34f5d86c678 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:47.893279 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b34f4312-81b0-4ea4-b1c6-b34f5d86c678 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:47.899631 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b34f4312-81b0-4ea4-b1c6-b34f5d86c678 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:47.900076 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b34f4312-81b0-4ea4-b1c6-b34f5d86c678 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:47.900856 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b34f4312-81b0-4ea4-b1c6-b34f5d86c678 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:47.901289 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b34f4312-81b0-4ea4-b1c6-b34f5d86c678 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:48.005343 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3efb6a36-54b2-412c-85d3-a4d65d0b2e06 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:48.006284 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3efb6a36-54b2-412c-85d3-a4d65d0b2e06 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:48.012449 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3efb6a36-54b2-412c-85d3-a4d65d0b2e06 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:48.012907 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3efb6a36-54b2-412c-85d3-a4d65d0b2e06 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:48.013753 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3efb6a36-54b2-412c-85d3-a4d65d0b2e06 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:48.014190 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3efb6a36-54b2-412c-85d3-a4d65d0b2e06 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:48.043866 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3efb6a36-54b2-412c-85d3-a4d65d0b2e06 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042552 Dec 15 12:41:48.044026 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b34f4312-81b0-4ea4-b1c6-b34f5d86c678 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:48.044438 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 171/349] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:41:47 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:41:48.052431 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b34f4312-81b0-4ea4-b1c6-b34f5d86c678 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:48.053961 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b34f4312-81b0-4ea4-b1c6-b34f5d86c678 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:48.055128 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b34f4312-81b0-4ea4-b1c6-b34f5d86c678 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1724 microversion: 2.20 time: 0.166980 Dec 15 12:41:48.055746 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 179/350] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:41:47 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:41:49.056106 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0b27c100-2035-465d-ad15-73d8701d6a91 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:49.056927 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0b27c100-2035-465d-ad15-73d8701d6a91 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:49.064162 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0b27c100-2035-465d-ad15-73d8701d6a91 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:49.064608 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0b27c100-2035-465d-ad15-73d8701d6a91 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:49.065412 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0b27c100-2035-465d-ad15-73d8701d6a91 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:49.065882 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0b27c100-2035-465d-ad15-73d8701d6a91 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:49.073571 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5296d4a9-2a24-4933-9726-38f83884e35d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:49.074183 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5296d4a9-2a24-4933-9726-38f83884e35d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:49.081125 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5296d4a9-2a24-4933-9726-38f83884e35d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:49.081586 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5296d4a9-2a24-4933-9726-38f83884e35d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:49.082364 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5296d4a9-2a24-4933-9726-38f83884e35d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:49.082788 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5296d4a9-2a24-4933-9726-38f83884e35d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:49.095915 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0b27c100-2035-465d-ad15-73d8701d6a91 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043636 Dec 15 12:41:49.096721 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 172/351] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:41:49 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:41:49.221279 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5296d4a9-2a24-4933-9726-38f83884e35d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:49.231196 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5296d4a9-2a24-4933-9726-38f83884e35d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:49.232766 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5296d4a9-2a24-4933-9726-38f83884e35d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:49.233939 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5296d4a9-2a24-4933-9726-38f83884e35d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1724 microversion: 2.20 time: 0.163947 Dec 15 12:41:49.234509 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 180/352] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:41:49 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:41:50.108396 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fe3b26a1-6985-4983-999b-f701807f8eca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:50.109813 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fe3b26a1-6985-4983-999b-f701807f8eca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:50.116178 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe3b26a1-6985-4983-999b-f701807f8eca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:50.116625 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe3b26a1-6985-4983-999b-f701807f8eca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:50.117415 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe3b26a1-6985-4983-999b-f701807f8eca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:50.117875 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe3b26a1-6985-4983-999b-f701807f8eca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:50.148105 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fe3b26a1-6985-4983-999b-f701807f8eca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043633 Dec 15 12:41:50.148670 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 173/353] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:41:50 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:41:50.252345 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bd01aac0-3971-4f93-9f4c-9d806173494c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:50.253210 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bd01aac0-3971-4f93-9f4c-9d806173494c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:50.268686 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd01aac0-3971-4f93-9f4c-9d806173494c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:50.269354 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd01aac0-3971-4f93-9f4c-9d806173494c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:50.270472 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd01aac0-3971-4f93-9f4c-9d806173494c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:50.270922 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd01aac0-3971-4f93-9f4c-9d806173494c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:50.409847 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bd01aac0-3971-4f93-9f4c-9d806173494c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:50.418446 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bd01aac0-3971-4f93-9f4c-9d806173494c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:50.420003 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bd01aac0-3971-4f93-9f4c-9d806173494c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:50.421254 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bd01aac0-3971-4f93-9f4c-9d806173494c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1724 microversion: 2.20 time: 0.172705 Dec 15 12:41:50.421887 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 181/354] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:41:50 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:41:51.160234 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ce4da977-9327-4c30-97f5-2832fbd66819 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:51.161155 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ce4da977-9327-4c30-97f5-2832fbd66819 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:51.167400 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce4da977-9327-4c30-97f5-2832fbd66819 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:51.167839 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce4da977-9327-4c30-97f5-2832fbd66819 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:51.168605 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce4da977-9327-4c30-97f5-2832fbd66819 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:51.169043 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce4da977-9327-4c30-97f5-2832fbd66819 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:51.198109 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ce4da977-9327-4c30-97f5-2832fbd66819 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042215 Dec 15 12:41:51.198698 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 174/355] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:41:51 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:41:51.439461 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-215f9200-8982-4ce5-973a-2eef485eab49 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:51.440060 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-215f9200-8982-4ce5-973a-2eef485eab49 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:51.446264 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-215f9200-8982-4ce5-973a-2eef485eab49 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:51.446710 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-215f9200-8982-4ce5-973a-2eef485eab49 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:51.447468 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-215f9200-8982-4ce5-973a-2eef485eab49 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:51.447892 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-215f9200-8982-4ce5-973a-2eef485eab49 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:51.599850 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-215f9200-8982-4ce5-973a-2eef485eab49 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:51.607802 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-215f9200-8982-4ce5-973a-2eef485eab49 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:51.610032 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-215f9200-8982-4ce5-973a-2eef485eab49 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:51.611256 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-215f9200-8982-4ce5-973a-2eef485eab49 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1724 microversion: 2.20 time: 0.175907 Dec 15 12:41:51.611849 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 182/356] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:41:51 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:41:52.209888 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ea153576-bb2c-46cb-96e5-afded7ddafac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:52.211472 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ea153576-bb2c-46cb-96e5-afded7ddafac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:52.219114 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea153576-bb2c-46cb-96e5-afded7ddafac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:52.219564 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea153576-bb2c-46cb-96e5-afded7ddafac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:52.220363 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea153576-bb2c-46cb-96e5-afded7ddafac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:52.220795 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea153576-bb2c-46cb-96e5-afded7ddafac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:52.257968 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ea153576-bb2c-46cb-96e5-afded7ddafac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051885 Dec 15 12:41:52.258749 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 175/357] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:41:52 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:41:52.630932 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-53f835cc-8a55-410a-8c45-abea5a4dbaf5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:52.631552 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-53f835cc-8a55-410a-8c45-abea5a4dbaf5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:52.638010 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-53f835cc-8a55-410a-8c45-abea5a4dbaf5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:52.638450 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-53f835cc-8a55-410a-8c45-abea5a4dbaf5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:52.639229 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-53f835cc-8a55-410a-8c45-abea5a4dbaf5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:52.639654 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-53f835cc-8a55-410a-8c45-abea5a4dbaf5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:52.765885 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9e65485d-11b2-46ac-8130-0aef95de2c52 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:52.767290 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9e65485d-11b2-46ac-8130-0aef95de2c52 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:52.773823 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9e65485d-11b2-46ac-8130-0aef95de2c52 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:52.774262 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9e65485d-11b2-46ac-8130-0aef95de2c52 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:52.775278 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9e65485d-11b2-46ac-8130-0aef95de2c52 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:52.775705 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9e65485d-11b2-46ac-8130-0aef95de2c52 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:52.787133 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-53f835cc-8a55-410a-8c45-abea5a4dbaf5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:52.795200 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-53f835cc-8a55-410a-8c45-abea5a4dbaf5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:52.796880 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-53f835cc-8a55-410a-8c45-abea5a4dbaf5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:52.798177 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-53f835cc-8a55-410a-8c45-abea5a4dbaf5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1724 microversion: 2.20 time: 0.172173 Dec 15 12:41:52.798746 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 183/358] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:41:52 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:41:52.801396 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.objects.instance [None req-9e65485d-11b2-46ac-8130-0aef95de2c52 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lazy-loading 'flavor' on Instance uuid 2824788a-14d6-488d-8af1-2df6b3de771a {{(pid=122614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 12:41:52.940032 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9e65485d-11b2-46ac-8130-0aef95de2c52 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "POST /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/action" status: 200 len: 32 microversion: 2.1 time: 0.181074 Dec 15 12:41:52.941307 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 176/359] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 12:41:52 2021] POST /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/action => generated 32 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 12:41:52.950499 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d9cafe1c-ccc2-4785-9da2-95240e67cc6b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:52.951110 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d9cafe1c-ccc2-4785-9da2-95240e67cc6b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:52.957945 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d9cafe1c-ccc2-4785-9da2-95240e67cc6b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:52.958437 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d9cafe1c-ccc2-4785-9da2-95240e67cc6b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:52.959175 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d9cafe1c-ccc2-4785-9da2-95240e67cc6b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:52.959635 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d9cafe1c-ccc2-4785-9da2-95240e67cc6b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:53.128162 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d9cafe1c-ccc2-4785-9da2-95240e67cc6b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:53.136198 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d9cafe1c-ccc2-4785-9da2-95240e67cc6b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1566 microversion: 2.1 time: 0.189549 Dec 15 12:41:53.136772 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 184/360] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:52 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1566 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:53.270946 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d8c6ee52-2996-4a65-af81-523794f105a3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:53.271899 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d8c6ee52-2996-4a65-af81-523794f105a3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:53.279081 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d8c6ee52-2996-4a65-af81-523794f105a3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:53.279702 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d8c6ee52-2996-4a65-af81-523794f105a3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:53.281276 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d8c6ee52-2996-4a65-af81-523794f105a3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:53.281958 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d8c6ee52-2996-4a65-af81-523794f105a3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:53.314745 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d8c6ee52-2996-4a65-af81-523794f105a3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048397 Dec 15 12:41:53.315306 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 177/361] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:41:53 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 12:41:53.482113 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3165d336-4387-44b8-947f-3d6bb574f724 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1568825759", "imageRef": "d302555e-2bff-4492-b57d-d59c0097a278", "flavorRef": "452", "networks": [{"uuid": "9067fc36-c028-414f-82b9-4a3d3b202a5f"}]}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:53.544643 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.network.neutron [None req-3165d336-4387-44b8-947f-3d6bb574f724 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] validate_networks() for [('9067fc36-c028-414f-82b9-4a3d3b202a5f', None, None, None, None, None)] {{(pid=122615) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 12:41:53.818725 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2be5ab40-53f0-446f-a5db-52f85358b99c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:53.819337 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2be5ab40-53f0-446f-a5db-52f85358b99c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:53.825407 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2be5ab40-53f0-446f-a5db-52f85358b99c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:53.825877 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2be5ab40-53f0-446f-a5db-52f85358b99c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:53.826657 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2be5ab40-53f0-446f-a5db-52f85358b99c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:53.827087 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2be5ab40-53f0-446f-a5db-52f85358b99c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:54.001871 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-3165d336-4387-44b8-947f-3d6bb574f724 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Flavor limits 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 12:41:54.002378 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-3165d336-4387-44b8-947f-3d6bb574f724 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Image limits 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 12:41:54.003114 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-3165d336-4387-44b8-947f-3d6bb574f724 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Flavor pref 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 12:41:54.003594 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-3165d336-4387-44b8-947f-3d6bb574f724 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Image pref 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 12:41:54.004069 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-3165d336-4387-44b8-947f-3d6bb574f724 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 12:41:54.016116 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3165d336-4387-44b8-947f-3d6bb574f724 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:54.016721 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3165d336-4387-44b8-947f-3d6bb574f724 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:54.017387 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3165d336-4387-44b8-947f-3d6bb574f724 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:54.017850 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3165d336-4387-44b8-947f-3d6bb574f724 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:54.033666 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2be5ab40-53f0-446f-a5db-52f85358b99c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:54.035271 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-3165d336-4387-44b8-947f-3d6bb574f724 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Getting quotas for project c4b04b03b8f94235be29043cfb8198ce. Resources: {'instances', 'cores', 'ram'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 12:41:54.039589 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-3165d336-4387-44b8-947f-3d6bb574f724 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Getting quotas for user 20aef34cb7444687acf501f6aedca443 and project c4b04b03b8f94235be29043cfb8198ce. Resources: {'instances', 'cores', 'ram'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 12:41:54.044361 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2be5ab40-53f0-446f-a5db-52f85358b99c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:54.046301 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2be5ab40-53f0-446f-a5db-52f85358b99c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:54.052086 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3165d336-4387-44b8-947f-3d6bb574f724 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Going to run 1 instances... {{(pid=122615) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 12:41:54.052894 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2be5ab40-53f0-446f-a5db-52f85358b99c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1724 microversion: 2.20 time: 0.238094 Dec 15 12:41:54.054466 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3165d336-4387-44b8-947f-3d6bb574f724 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d302555e-2bff-4492-b57d-d59c0097a278',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 12:41:54.063781 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 178/362] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:41:53 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:41:54.106083 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3165d336-4387-44b8-947f-3d6bb574f724 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.627112 Dec 15 12:41:54.112092 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 185/363] 10.222.0.76 () {60 vars in 1146 bytes} [Wed Dec 15 12:41:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 12:41:54.117923 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a97b630d-e3f5-4c92-93c2-48ae1e9dba9a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:54.118889 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a97b630d-e3f5-4c92-93c2-48ae1e9dba9a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:54.154562 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ff1ff67c-dd14-4c32-803e-64098bca1c67 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:54.155267 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ff1ff67c-dd14-4c32-803e-64098bca1c67 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:54.168051 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ff1ff67c-dd14-4c32-803e-64098bca1c67 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:54.168900 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ff1ff67c-dd14-4c32-803e-64098bca1c67 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:54.170503 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ff1ff67c-dd14-4c32-803e-64098bca1c67 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:54.171103 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ff1ff67c-dd14-4c32-803e-64098bca1c67 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:54.193107 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a97b630d-e3f5-4c92-93c2-48ae1e9dba9a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:54.200351 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a97b630d-e3f5-4c92-93c2-48ae1e9dba9a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1218 microversion: 2.1 time: 0.086107 Dec 15 12:41:54.200941 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 179/364] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:54 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:54.331476 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ff1ff67c-dd14-4c32-803e-64098bca1c67 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:54.340245 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ff1ff67c-dd14-4c32-803e-64098bca1c67 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1566 microversion: 2.1 time: 0.190247 Dec 15 12:41:54.341143 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 186/365] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:54 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1566 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:41:55.071553 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2e9ca00a-a912-4623-87be-a9b918c1787d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:55.072104 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2e9ca00a-a912-4623-87be-a9b918c1787d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:55.079521 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2e9ca00a-a912-4623-87be-a9b918c1787d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:55.079992 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2e9ca00a-a912-4623-87be-a9b918c1787d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:55.080777 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2e9ca00a-a912-4623-87be-a9b918c1787d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:55.081307 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2e9ca00a-a912-4623-87be-a9b918c1787d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:55.219811 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7ff44c0e-28c0-4da8-a7f9-a6da447de6e2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:55.220714 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7ff44c0e-28c0-4da8-a7f9-a6da447de6e2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:55.227326 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7ff44c0e-28c0-4da8-a7f9-a6da447de6e2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:55.227788 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7ff44c0e-28c0-4da8-a7f9-a6da447de6e2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:55.228563 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7ff44c0e-28c0-4da8-a7f9-a6da447de6e2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:55.229252 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7ff44c0e-28c0-4da8-a7f9-a6da447de6e2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:55.332279 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2e9ca00a-a912-4623-87be-a9b918c1787d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:55.336714 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7ff44c0e-28c0-4da8-a7f9-a6da447de6e2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:55.347615 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7ff44c0e-28c0-4da8-a7f9-a6da447de6e2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1278 microversion: 2.1 time: 0.131920 Dec 15 12:41:55.349185 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 187/366] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:55 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1278 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:41:55.358886 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2e9ca00a-a912-4623-87be-a9b918c1787d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:55.358886 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2e9ca00a-a912-4623-87be-a9b918c1787d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:55.359816 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2e9ca00a-a912-4623-87be-a9b918c1787d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1724 microversion: 2.20 time: 0.292346 Dec 15 12:41:55.360770 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 180/367] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:41:55 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1724 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:41:55.368149 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-78528102-5e70-4a28-b651-2582579ee875 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:55.369199 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-78528102-5e70-4a28-b651-2582579ee875 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:55.377664 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-78528102-5e70-4a28-b651-2582579ee875 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:55.379260 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-78528102-5e70-4a28-b651-2582579ee875 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:55.380485 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-78528102-5e70-4a28-b651-2582579ee875 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:55.380920 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-78528102-5e70-4a28-b651-2582579ee875 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:55.565579 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-78528102-5e70-4a28-b651-2582579ee875 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:55.577871 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-78528102-5e70-4a28-b651-2582579ee875 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1566 microversion: 2.1 time: 0.213848 Dec 15 12:41:55.579314 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 188/368] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:55 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1566 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:56.365350 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-df535196-890a-46eb-9d43-769eabaa690d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:56.365953 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-df535196-890a-46eb-9d43-769eabaa690d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:56.373061 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df535196-890a-46eb-9d43-769eabaa690d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:56.373884 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df535196-890a-46eb-9d43-769eabaa690d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:56.375480 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df535196-890a-46eb-9d43-769eabaa690d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:56.376116 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df535196-890a-46eb-9d43-769eabaa690d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:56.379302 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6589cb0c-5c92-4a8b-91c1-3afc9e62b42d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:56.380525 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6589cb0c-5c92-4a8b-91c1-3afc9e62b42d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:56.390806 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6589cb0c-5c92-4a8b-91c1-3afc9e62b42d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:56.391546 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6589cb0c-5c92-4a8b-91c1-3afc9e62b42d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:56.392679 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6589cb0c-5c92-4a8b-91c1-3afc9e62b42d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:56.393346 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6589cb0c-5c92-4a8b-91c1-3afc9e62b42d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:56.679087 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6589cb0c-5c92-4a8b-91c1-3afc9e62b42d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:56.687764 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-df535196-890a-46eb-9d43-769eabaa690d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:56.690047 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6589cb0c-5c92-4a8b-91c1-3afc9e62b42d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:56.691842 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6589cb0c-5c92-4a8b-91c1-3afc9e62b42d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:56.693767 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6589cb0c-5c92-4a8b-91c1-3afc9e62b42d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1724 microversion: 2.20 time: 0.318602 Dec 15 12:41:56.705068 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-df535196-890a-46eb-9d43-769eabaa690d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1318 microversion: 2.1 time: 0.334356 Dec 15 12:41:56.706904 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 181/370] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:56 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:56.707147 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 189/370] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:41:56 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1724 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:41:56.713185 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e5590cbe-1aff-48aa-b775-c728349867d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:56.714084 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e5590cbe-1aff-48aa-b775-c728349867d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:56.724058 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e5590cbe-1aff-48aa-b775-c728349867d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:56.724698 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e5590cbe-1aff-48aa-b775-c728349867d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:56.725764 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e5590cbe-1aff-48aa-b775-c728349867d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:56.726230 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e5590cbe-1aff-48aa-b775-c728349867d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:57.006820 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e5590cbe-1aff-48aa-b775-c728349867d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:57.016844 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e5590cbe-1aff-48aa-b775-c728349867d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1566 microversion: 2.1 time: 0.307877 Dec 15 12:41:57.018181 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 182/371] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:56 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1566 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:57.101976 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [req-a380228e-4bee-4a09-8638-39fd6fc5d12f req-a6e8ef46-efde-4978-af9c-257e43ab3fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af14627f-65d9-46ce-9fea-d9c7c74c0ef3", "tag": "bae2a0c5-6d9c-4f3c-b012-5872c7deaeb1"}]} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:57.103761 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:41:57.103761 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: warnings.warn(msg) Dec 15 12:41:57.112717 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-a380228e-4bee-4a09-8638-39fd6fc5d12f req-a6e8ef46-efde-4978-af9c-257e43ab3fc2 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:57.113273 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-a380228e-4bee-4a09-8638-39fd6fc5d12f req-a6e8ef46-efde-4978-af9c-257e43ab3fc2 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:57.128405 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.compute.server_external_events [req-a380228e-4bee-4a09-8638-39fd6fc5d12f req-a6e8ef46-efde-4978-af9c-257e43ab3fc2 service nova] Creating event network-changed:bae2a0c5-6d9c-4f3c-b012-5872c7deaeb1 for instance af14627f-65d9-46ce-9fea-d9c7c74c0ef3 on hv-cinder-81322 Dec 15 12:41:57.133673 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [req-a380228e-4bee-4a09-8638-39fd6fc5d12f req-a6e8ef46-efde-4978-af9c-257e43ab3fc2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035556 Dec 15 12:41:57.134837 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 190/372] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 12:41:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:41:57.722175 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f3ff0fca-56ac-4300-b5e3-ddc1fe679b52 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:57.722864 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f3ff0fca-56ac-4300-b5e3-ddc1fe679b52 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:57.736330 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5809a0b4-3352-4024-8b0d-aba8eaa9c012 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:57.738315 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f3ff0fca-56ac-4300-b5e3-ddc1fe679b52 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:57.739300 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f3ff0fca-56ac-4300-b5e3-ddc1fe679b52 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:57.740371 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f3ff0fca-56ac-4300-b5e3-ddc1fe679b52 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:57.741044 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f3ff0fca-56ac-4300-b5e3-ddc1fe679b52 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:57.752765 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5809a0b4-3352-4024-8b0d-aba8eaa9c012 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:57.777613 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5809a0b4-3352-4024-8b0d-aba8eaa9c012 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:57.779005 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5809a0b4-3352-4024-8b0d-aba8eaa9c012 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:57.782735 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5809a0b4-3352-4024-8b0d-aba8eaa9c012 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:57.783182 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5809a0b4-3352-4024-8b0d-aba8eaa9c012 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:58.059936 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5809a0b4-3352-4024-8b0d-aba8eaa9c012 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:58.068699 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5809a0b4-3352-4024-8b0d-aba8eaa9c012 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1318 microversion: 2.1 time: 0.342998 Dec 15 12:41:58.071141 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 183/373] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:57 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:58.077258 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-eff05526-e6da-4c65-ada5-57914902e942 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:58.078255 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-eff05526-e6da-4c65-ada5-57914902e942 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:58.084545 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eff05526-e6da-4c65-ada5-57914902e942 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:58.085401 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eff05526-e6da-4c65-ada5-57914902e942 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:58.086467 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eff05526-e6da-4c65-ada5-57914902e942 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:58.087127 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eff05526-e6da-4c65-ada5-57914902e942 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:58.092504 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-f3ff0fca-56ac-4300-b5e3-ddc1fe679b52 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:58.129839 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-f3ff0fca-56ac-4300-b5e3-ddc1fe679b52 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:58.140178 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-f3ff0fca-56ac-4300-b5e3-ddc1fe679b52 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:58.144200 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f3ff0fca-56ac-4300-b5e3-ddc1fe679b52 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1724 microversion: 2.20 time: 0.425582 Dec 15 12:41:58.154806 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 191/374] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:41:57 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1724 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:41:58.290563 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-eff05526-e6da-4c65-ada5-57914902e942 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:58.302376 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-eff05526-e6da-4c65-ada5-57914902e942 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1566 microversion: 2.1 time: 0.229518 Dec 15 12:41:58.303944 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 184/375] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:58 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1566 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:59.087986 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8c9b0937-205f-475a-9a09-1eaa5c333bbf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:59.088600 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8c9b0937-205f-475a-9a09-1eaa5c333bbf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:59.095125 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c9b0937-205f-475a-9a09-1eaa5c333bbf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:59.095571 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c9b0937-205f-475a-9a09-1eaa5c333bbf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:59.096349 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c9b0937-205f-475a-9a09-1eaa5c333bbf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:59.096796 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c9b0937-205f-475a-9a09-1eaa5c333bbf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:59.165586 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-921c5d00-e674-4468-b9a8-01593f0d68ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:59.166601 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-921c5d00-e674-4468-b9a8-01593f0d68ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:59.174989 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-921c5d00-e674-4468-b9a8-01593f0d68ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:59.174989 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-921c5d00-e674-4468-b9a8-01593f0d68ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:59.175497 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-921c5d00-e674-4468-b9a8-01593f0d68ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:59.175928 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-921c5d00-e674-4468-b9a8-01593f0d68ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:59.269673 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8c9b0937-205f-475a-9a09-1eaa5c333bbf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:59.278365 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8c9b0937-205f-475a-9a09-1eaa5c333bbf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1318 microversion: 2.1 time: 0.193924 Dec 15 12:41:59.288077 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 192/376] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:59 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:41:59.319747 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-53cb3d4c-fa1d-4180-9641-8f1fd78aa4bf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:41:59.320334 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-53cb3d4c-fa1d-4180-9641-8f1fd78aa4bf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:41:59.327084 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-53cb3d4c-fa1d-4180-9641-8f1fd78aa4bf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:59.327535 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-53cb3d4c-fa1d-4180-9641-8f1fd78aa4bf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:59.328352 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-53cb3d4c-fa1d-4180-9641-8f1fd78aa4bf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:41:59.328789 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-53cb3d4c-fa1d-4180-9641-8f1fd78aa4bf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:41:59.345484 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-921c5d00-e674-4468-b9a8-01593f0d68ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:59.353093 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-921c5d00-e674-4468-b9a8-01593f0d68ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:59.354674 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-921c5d00-e674-4468-b9a8-01593f0d68ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:59.355833 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-921c5d00-e674-4468-b9a8-01593f0d68ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1724 microversion: 2.20 time: 0.194082 Dec 15 12:41:59.356393 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 185/377] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:41:59 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:41:59.471650 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-53cb3d4c-fa1d-4180-9641-8f1fd78aa4bf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:41:59.479574 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-53cb3d4c-fa1d-4180-9641-8f1fd78aa4bf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1566 microversion: 2.1 time: 0.163293 Dec 15 12:41:59.480169 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 193/378] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:41:59 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:41:59.654231 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-437593e2-064d-4b89-9521-aac2fe7fee34 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1938532306", "imageRef": "d302555e-2bff-4492-b57d-d59c0097a278", "flavorRef": "452", "networks": [{"uuid": "09867c92-35d2-4901-9521-87067935a7a9"}]}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:41:59.708003 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.network.neutron [None req-437593e2-064d-4b89-9521-aac2fe7fee34 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] validate_networks() for [('09867c92-35d2-4901-9521-87067935a7a9', None, None, None, None, None)] {{(pid=122614) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 12:42:00.136762 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-437593e2-064d-4b89-9521-aac2fe7fee34 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Flavor limits 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 12:42:00.137092 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-437593e2-064d-4b89-9521-aac2fe7fee34 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Image limits 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 12:42:00.137586 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-437593e2-064d-4b89-9521-aac2fe7fee34 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Flavor pref 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 12:42:00.138180 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-437593e2-064d-4b89-9521-aac2fe7fee34 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Image pref 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 12:42:00.138586 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-437593e2-064d-4b89-9521-aac2fe7fee34 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 12:42:00.148925 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-437593e2-064d-4b89-9521-aac2fe7fee34 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:00.149378 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-437593e2-064d-4b89-9521-aac2fe7fee34 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:00.150290 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-437593e2-064d-4b89-9521-aac2fe7fee34 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:00.150936 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-437593e2-064d-4b89-9521-aac2fe7fee34 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:00.172482 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-437593e2-064d-4b89-9521-aac2fe7fee34 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Getting quotas for project 473ac1badd984fbeb2e27b1ac44b3d51. Resources: {'instances', 'cores', 'ram'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 12:42:00.177199 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-437593e2-064d-4b89-9521-aac2fe7fee34 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Getting quotas for user c13d2fbbad43428b8e5637e6d86d93fe and project 473ac1badd984fbeb2e27b1ac44b3d51. Resources: {'instances', 'cores', 'ram'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 12:42:00.190911 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-437593e2-064d-4b89-9521-aac2fe7fee34 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Going to run 1 instances... {{(pid=122614) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 12:42:00.193348 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-437593e2-064d-4b89-9521-aac2fe7fee34 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: d2617ab9-727c-4fdc-8c26-1c46312c89ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d302555e-2bff-4492-b57d-d59c0097a278',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 12:42:00.255149 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-437593e2-064d-4b89-9521-aac2fe7fee34 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607460 Dec 15 12:42:00.256038 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 186/379] 10.222.0.76 () {60 vars in 1146 bytes} [Wed Dec 15 12:41:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 12:42:00.266233 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3f637912-290c-415d-b571-00eeaa1395ce tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:00.267386 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3f637912-290c-415d-b571-00eeaa1395ce tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: d2617ab9-727c-4fdc-8c26-1c46312c89ca] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:00.302594 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0fb06ccc-ca81-4b79-9302-14122cadaedb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:00.303282 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0fb06ccc-ca81-4b79-9302-14122cadaedb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:00.317127 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0fb06ccc-ca81-4b79-9302-14122cadaedb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:00.317621 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0fb06ccc-ca81-4b79-9302-14122cadaedb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:00.318644 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0fb06ccc-ca81-4b79-9302-14122cadaedb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:00.319284 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0fb06ccc-ca81-4b79-9302-14122cadaedb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:00.341866 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3f637912-290c-415d-b571-00eeaa1395ce tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13d2fbbad43428b8e5637e6d86d93fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473ac1badd984fbeb2e27b1ac44b3d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:00.349231 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3f637912-290c-415d-b571-00eeaa1395ce tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca" status: 200 len: 1214 microversion: 2.1 time: 0.086791 Dec 15 12:42:00.350030 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 194/380] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:00 2021] GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:42:00.374936 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-05328f12-97c2-4e69-ac2e-fdfb7dc36f42 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:00.375890 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-05328f12-97c2-4e69-ac2e-fdfb7dc36f42 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:00.382474 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-05328f12-97c2-4e69-ac2e-fdfb7dc36f42 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:00.383228 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-05328f12-97c2-4e69-ac2e-fdfb7dc36f42 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:00.384177 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-05328f12-97c2-4e69-ac2e-fdfb7dc36f42 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:00.384823 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-05328f12-97c2-4e69-ac2e-fdfb7dc36f42 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:00.530682 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0fb06ccc-ca81-4b79-9302-14122cadaedb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:00.552904 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0fb06ccc-ca81-4b79-9302-14122cadaedb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1318 microversion: 2.1 time: 0.255786 Dec 15 12:42:00.553485 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 187/381] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:00 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:42:00.573554 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a97da12a-b343-40b9-b5b8-fa1479e7784f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:00.574184 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a97da12a-b343-40b9-b5b8-fa1479e7784f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:00.595840 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a97da12a-b343-40b9-b5b8-fa1479e7784f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:00.596297 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a97da12a-b343-40b9-b5b8-fa1479e7784f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:00.597105 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a97da12a-b343-40b9-b5b8-fa1479e7784f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:00.597560 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a97da12a-b343-40b9-b5b8-fa1479e7784f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:00.636553 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-05328f12-97c2-4e69-ac2e-fdfb7dc36f42 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:00.651296 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-05328f12-97c2-4e69-ac2e-fdfb7dc36f42 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:00.653474 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-05328f12-97c2-4e69-ac2e-fdfb7dc36f42 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:00.654833 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-05328f12-97c2-4e69-ac2e-fdfb7dc36f42 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1724 microversion: 2.20 time: 0.284196 Dec 15 12:42:00.655503 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 195/382] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:00 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1724 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:42:00.775301 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a97da12a-b343-40b9-b5b8-fa1479e7784f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:00.786334 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a97da12a-b343-40b9-b5b8-fa1479e7784f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1566 microversion: 2.1 time: 0.223666 Dec 15 12:42:00.786782 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 188/383] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:00 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1566 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:42:01.367254 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b1d68481-6c0c-4da7-9445-da5046d3a104 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:01.367874 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b1d68481-6c0c-4da7-9445-da5046d3a104 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: d2617ab9-727c-4fdc-8c26-1c46312c89ca] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:01.374388 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1d68481-6c0c-4da7-9445-da5046d3a104 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:01.374863 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1d68481-6c0c-4da7-9445-da5046d3a104 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:01.375648 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1d68481-6c0c-4da7-9445-da5046d3a104 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:01.376076 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1d68481-6c0c-4da7-9445-da5046d3a104 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:01.443518 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b1d68481-6c0c-4da7-9445-da5046d3a104 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13d2fbbad43428b8e5637e6d86d93fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473ac1badd984fbeb2e27b1ac44b3d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:01.451115 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b1d68481-6c0c-4da7-9445-da5046d3a104 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca" status: 200 len: 1266 microversion: 2.1 time: 0.087655 Dec 15 12:42:01.451686 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 196/384] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:01 2021] GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:42:01.572523 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-061086ef-bf97-49fc-9d19-429e00f889ad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:01.573135 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-061086ef-bf97-49fc-9d19-429e00f889ad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:01.581154 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-061086ef-bf97-49fc-9d19-429e00f889ad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:01.581847 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-061086ef-bf97-49fc-9d19-429e00f889ad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:01.582780 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-061086ef-bf97-49fc-9d19-429e00f889ad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:01.583351 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-061086ef-bf97-49fc-9d19-429e00f889ad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:01.615331 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ca474b6d-6151-432b-922c-f56acf9e26bb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbea2541-839d-464e-a72c-8c95c98d43e8", "device": "/dev/sdb"}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:42:01.617389 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ca474b6d-6151-432b-922c-f56acf9e26bb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:01.635792 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ca474b6d-6151-432b-922c-f56acf9e26bb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:01.636281 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ca474b6d-6151-432b-922c-f56acf9e26bb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:01.637421 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ca474b6d-6151-432b-922c-f56acf9e26bb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:01.637992 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ca474b6d-6151-432b-922c-f56acf9e26bb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:01.745284 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-061086ef-bf97-49fc-9d19-429e00f889ad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:01.754558 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-061086ef-bf97-49fc-9d19-429e00f889ad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1318 microversion: 2.1 time: 0.187028 Dec 15 12:42:01.755143 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 189/385] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:01 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:42:01.759716 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ae015bc7-96f5-42b6-90bb-8e048d6b18fe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:01.761660 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ae015bc7-96f5-42b6-90bb-8e048d6b18fe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:01.768543 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ae015bc7-96f5-42b6-90bb-8e048d6b18fe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:01.768988 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ae015bc7-96f5-42b6-90bb-8e048d6b18fe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:01.769830 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ae015bc7-96f5-42b6-90bb-8e048d6b18fe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:01.770285 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ae015bc7-96f5-42b6-90bb-8e048d6b18fe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:01.919939 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ae015bc7-96f5-42b6-90bb-8e048d6b18fe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:01.929153 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ae015bc7-96f5-42b6-90bb-8e048d6b18fe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:01.929688 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ca474b6d-6151-432b-922c-f56acf9e26bb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "POST /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318011 Dec 15 12:42:01.935723 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 197/386] 10.222.0.76 () {60 vars in 1322 bytes} [Wed Dec 15 12:42:01 2021] POST /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:01.935867 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ae015bc7-96f5-42b6-90bb-8e048d6b18fe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:01.935867 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ae015bc7-96f5-42b6-90bb-8e048d6b18fe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1724 microversion: 2.20 time: 0.175447 Dec 15 12:42:01.935867 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 190/387] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:01 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:01.936104 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ad73b0aa-7e5a-4bbb-845d-123b82f65a2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:01.936177 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ad73b0aa-7e5a-4bbb-845d-123b82f65a2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:01.943626 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad73b0aa-7e5a-4bbb-845d-123b82f65a2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:01.944149 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad73b0aa-7e5a-4bbb-845d-123b82f65a2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:01.944949 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad73b0aa-7e5a-4bbb-845d-123b82f65a2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:01.945380 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad73b0aa-7e5a-4bbb-845d-123b82f65a2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:02.110345 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ad73b0aa-7e5a-4bbb-845d-123b82f65a2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:02.120690 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ad73b0aa-7e5a-4bbb-845d-123b82f65a2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1566 microversion: 2.1 time: 0.189077 Dec 15 12:42:02.121288 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 198/388] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:01 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1566 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:42:02.189022 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-85afe122-db25-46d0-8586-7c5e878f618c req-6274a573-db31-4fb6-a7a4-da719793bec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af14627f-65d9-46ce-9fea-d9c7c74c0ef3", "name": "network-vif-plugged", "status": "completed", "tag": "bae2a0c5-6d9c-4f3c-b012-5872c7deaeb1"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:42:02.191583 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:42:02.191583 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 12:42:02.199011 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-85afe122-db25-46d0-8586-7c5e878f618c req-6274a573-db31-4fb6-a7a4-da719793bec0 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:02.199477 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-85afe122-db25-46d0-8586-7c5e878f618c req-6274a573-db31-4fb6-a7a4-da719793bec0 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:02.210857 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-85afe122-db25-46d0-8586-7c5e878f618c req-6274a573-db31-4fb6-a7a4-da719793bec0 service nova] Creating event network-vif-plugged:bae2a0c5-6d9c-4f3c-b012-5872c7deaeb1 for instance af14627f-65d9-46ce-9fea-d9c7c74c0ef3 on hv-cinder-81322 Dec 15 12:42:02.215645 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-85afe122-db25-46d0-8586-7c5e878f618c req-6274a573-db31-4fb6-a7a4-da719793bec0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031811 Dec 15 12:42:02.216239 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 191/389] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 12:42:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:02.469621 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b7a5f31e-a91e-4535-821f-a3213b8076a5 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:02.470822 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b7a5f31e-a91e-4535-821f-a3213b8076a5 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: d2617ab9-727c-4fdc-8c26-1c46312c89ca] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:02.480597 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b7a5f31e-a91e-4535-821f-a3213b8076a5 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:02.481321 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b7a5f31e-a91e-4535-821f-a3213b8076a5 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:02.482172 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b7a5f31e-a91e-4535-821f-a3213b8076a5 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:02.482608 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b7a5f31e-a91e-4535-821f-a3213b8076a5 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:02.649992 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b7a5f31e-a91e-4535-821f-a3213b8076a5 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13d2fbbad43428b8e5637e6d86d93fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473ac1badd984fbeb2e27b1ac44b3d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:02.660943 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b7a5f31e-a91e-4535-821f-a3213b8076a5 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca" status: 200 len: 1314 microversion: 2.1 time: 0.196400 Dec 15 12:42:02.662362 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 199/390] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:02 2021] GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:42:02.772896 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-386e02a4-1d17-4987-953c-3909d25a5abf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:02.773938 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-386e02a4-1d17-4987-953c-3909d25a5abf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:02.779958 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-386e02a4-1d17-4987-953c-3909d25a5abf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:02.780976 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-386e02a4-1d17-4987-953c-3909d25a5abf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:02.781804 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-386e02a4-1d17-4987-953c-3909d25a5abf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:02.782240 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-386e02a4-1d17-4987-953c-3909d25a5abf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:02.918665 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-386e02a4-1d17-4987-953c-3909d25a5abf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:02.926370 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-386e02a4-1d17-4987-953c-3909d25a5abf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1318 microversion: 2.1 time: 0.158790 Dec 15 12:42:02.926947 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 192/391] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:02 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:42:02.950359 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b9ceb213-bb32-4e25-b224-896092527af4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:02.950891 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b9ceb213-bb32-4e25-b224-896092527af4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:02.957182 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b9ceb213-bb32-4e25-b224-896092527af4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:02.957666 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b9ceb213-bb32-4e25-b224-896092527af4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:02.958449 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b9ceb213-bb32-4e25-b224-896092527af4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:02.958879 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b9ceb213-bb32-4e25-b224-896092527af4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:03.109840 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b9ceb213-bb32-4e25-b224-896092527af4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:03.118828 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-16c30c14-b386-4504-839c-0a681c594bec req-120eff76-de79-47fd-a6a1-d08274d6e2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2617ab9-727c-4fdc-8c26-1c46312c89ca", "tag": "0bb97ec6-500a-4062-bdaa-84dd4b6d7435"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:42:03.120862 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:42:03.120862 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 12:42:03.129486 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b9ceb213-bb32-4e25-b224-896092527af4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:03.133709 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b9ceb213-bb32-4e25-b224-896092527af4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:03.133709 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b9ceb213-bb32-4e25-b224-896092527af4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1724 microversion: 2.20 time: 0.186858 Dec 15 12:42:03.134158 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 200/392] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:02 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:03.136323 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-16c30c14-b386-4504-839c-0a681c594bec req-120eff76-de79-47fd-a6a1-d08274d6e2e2 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:03.136774 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-16c30c14-b386-4504-839c-0a681c594bec req-120eff76-de79-47fd-a6a1-d08274d6e2e2 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:03.138910 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-99a71de9-3bcd-40e0-a879-3870f43613a4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:03.139730 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-99a71de9-3bcd-40e0-a879-3870f43613a4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:03.145888 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-99a71de9-3bcd-40e0-a879-3870f43613a4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:03.146574 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-99a71de9-3bcd-40e0-a879-3870f43613a4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:03.147839 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-99a71de9-3bcd-40e0-a879-3870f43613a4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:03.148280 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-99a71de9-3bcd-40e0-a879-3870f43613a4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:03.149084 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-16c30c14-b386-4504-839c-0a681c594bec req-120eff76-de79-47fd-a6a1-d08274d6e2e2 service nova] Creating event network-changed:0bb97ec6-500a-4062-bdaa-84dd4b6d7435 for instance d2617ab9-727c-4fdc-8c26-1c46312c89ca on hv-cinder-81322 Dec 15 12:42:03.156119 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-16c30c14-b386-4504-839c-0a681c594bec req-120eff76-de79-47fd-a6a1-d08274d6e2e2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040334 Dec 15 12:42:03.157344 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 193/393] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 12:42:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:42:03.298888 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-99a71de9-3bcd-40e0-a879-3870f43613a4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:03.305314 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-99a71de9-3bcd-40e0-a879-3870f43613a4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1566 microversion: 2.1 time: 0.169973 Dec 15 12:42:03.305913 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 201/394] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:03 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:42:03.679075 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4fa1b238-1da9-4b6a-838d-d10fe5ffa003 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:03.679793 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4fa1b238-1da9-4b6a-838d-d10fe5ffa003 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: d2617ab9-727c-4fdc-8c26-1c46312c89ca] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:03.686215 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4fa1b238-1da9-4b6a-838d-d10fe5ffa003 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:03.686707 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4fa1b238-1da9-4b6a-838d-d10fe5ffa003 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:03.687678 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4fa1b238-1da9-4b6a-838d-d10fe5ffa003 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:03.688104 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4fa1b238-1da9-4b6a-838d-d10fe5ffa003 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:03.943900 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e0e023a2-2c88-42fb-8fbc-17e563e20d85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:03.944768 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e0e023a2-2c88-42fb-8fbc-17e563e20d85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:03.960150 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0e023a2-2c88-42fb-8fbc-17e563e20d85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:03.961101 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0e023a2-2c88-42fb-8fbc-17e563e20d85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:03.963669 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0e023a2-2c88-42fb-8fbc-17e563e20d85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:03.964398 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0e023a2-2c88-42fb-8fbc-17e563e20d85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:04.110288 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4fa1b238-1da9-4b6a-838d-d10fe5ffa003 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13d2fbbad43428b8e5637e6d86d93fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473ac1badd984fbeb2e27b1ac44b3d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:04.124845 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4fa1b238-1da9-4b6a-838d-d10fe5ffa003 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca" status: 200 len: 1314 microversion: 2.1 time: 0.445722 Dec 15 12:42:04.126972 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 194/395] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:03 2021] GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:42:04.153724 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ca453cbe-143f-4fd1-bd48-508f6ffd6b21 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:04.155556 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ca453cbe-143f-4fd1-bd48-508f6ffd6b21 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:04.169565 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ca453cbe-143f-4fd1-bd48-508f6ffd6b21 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:04.172018 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ca453cbe-143f-4fd1-bd48-508f6ffd6b21 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:04.175923 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ca453cbe-143f-4fd1-bd48-508f6ffd6b21 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:04.178880 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ca453cbe-143f-4fd1-bd48-508f6ffd6b21 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:04.246825 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e0e023a2-2c88-42fb-8fbc-17e563e20d85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:04.265480 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e0e023a2-2c88-42fb-8fbc-17e563e20d85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1318 microversion: 2.1 time: 0.324866 Dec 15 12:42:04.267550 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 202/396] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:03 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:42:04.322808 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-916c1eca-3ad2-40de-8c05-ce80a7a12a08 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:04.323421 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-916c1eca-3ad2-40de-8c05-ce80a7a12a08 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:04.329625 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-916c1eca-3ad2-40de-8c05-ce80a7a12a08 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:04.330072 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-916c1eca-3ad2-40de-8c05-ce80a7a12a08 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:04.330862 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-916c1eca-3ad2-40de-8c05-ce80a7a12a08 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:04.331287 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-916c1eca-3ad2-40de-8c05-ce80a7a12a08 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:04.353890 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ca453cbe-143f-4fd1-bd48-508f6ffd6b21 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:04.362449 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ca453cbe-143f-4fd1-bd48-508f6ffd6b21 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:04.363941 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ca453cbe-143f-4fd1-bd48-508f6ffd6b21 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:04.365167 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ca453cbe-143f-4fd1-bd48-508f6ffd6b21 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1724 microversion: 2.20 time: 0.216560 Dec 15 12:42:04.365785 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 195/397] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:04 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:42:04.461767 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-916c1eca-3ad2-40de-8c05-ce80a7a12a08 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:04.469644 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-916c1eca-3ad2-40de-8c05-ce80a7a12a08 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1566 microversion: 2.1 time: 0.150601 Dec 15 12:42:04.470243 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 203/398] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:04 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:42:05.144113 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4b460286-4a00-4e8e-aafc-353c7e72e594 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:05.144743 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4b460286-4a00-4e8e-aafc-353c7e72e594 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: d2617ab9-727c-4fdc-8c26-1c46312c89ca] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:05.151509 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4b460286-4a00-4e8e-aafc-353c7e72e594 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:05.151957 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4b460286-4a00-4e8e-aafc-353c7e72e594 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:05.152815 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4b460286-4a00-4e8e-aafc-353c7e72e594 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:05.153253 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4b460286-4a00-4e8e-aafc-353c7e72e594 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:05.284369 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9e5ad4dd-4e97-49cd-9b3e-0656652892cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:05.285002 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9e5ad4dd-4e97-49cd-9b3e-0656652892cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:05.291711 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9e5ad4dd-4e97-49cd-9b3e-0656652892cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:05.292163 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9e5ad4dd-4e97-49cd-9b3e-0656652892cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:05.293549 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9e5ad4dd-4e97-49cd-9b3e-0656652892cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:05.293679 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9e5ad4dd-4e97-49cd-9b3e-0656652892cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:05.308401 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4b460286-4a00-4e8e-aafc-353c7e72e594 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13d2fbbad43428b8e5637e6d86d93fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473ac1badd984fbeb2e27b1ac44b3d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:05.318902 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4b460286-4a00-4e8e-aafc-353c7e72e594 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca" status: 200 len: 1314 microversion: 2.1 time: 0.178647 Dec 15 12:42:05.319494 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 196/399] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:05 2021] GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:42:05.384472 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-91e68d1e-83fa-4725-8749-f8110a050c16 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:05.385144 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-91e68d1e-83fa-4725-8749-f8110a050c16 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:05.392841 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-91e68d1e-83fa-4725-8749-f8110a050c16 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:05.393411 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-91e68d1e-83fa-4725-8749-f8110a050c16 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:05.394328 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-91e68d1e-83fa-4725-8749-f8110a050c16 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:05.394688 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-91e68d1e-83fa-4725-8749-f8110a050c16 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:05.479354 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9e5ad4dd-4e97-49cd-9b3e-0656652892cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:05.489173 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9e5ad4dd-4e97-49cd-9b3e-0656652892cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1508 microversion: 2.1 time: 0.209103 Dec 15 12:42:05.489897 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 204/400] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:05 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1508 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:42:05.494375 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f69873b4-2ef8-4b49-9c35-607cf4c5bb3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:05.495069 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f69873b4-2ef8-4b49-9c35-607cf4c5bb3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:05.501873 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f69873b4-2ef8-4b49-9c35-607cf4c5bb3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:05.502417 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f69873b4-2ef8-4b49-9c35-607cf4c5bb3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:05.503549 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f69873b4-2ef8-4b49-9c35-607cf4c5bb3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:05.504056 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f69873b4-2ef8-4b49-9c35-607cf4c5bb3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:05.646803 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-91e68d1e-83fa-4725-8749-f8110a050c16 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:05.668137 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-91e68d1e-83fa-4725-8749-f8110a050c16 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:05.672124 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-91e68d1e-83fa-4725-8749-f8110a050c16 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:05.674485 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-91e68d1e-83fa-4725-8749-f8110a050c16 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1724 microversion: 2.20 time: 0.293463 Dec 15 12:42:05.675582 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 197/401] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:05 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:42:05.739379 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-f69873b4-2ef8-4b49-9c35-607cf4c5bb3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:05.751195 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f69873b4-2ef8-4b49-9c35-607cf4c5bb3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1566 microversion: 2.1 time: 0.259123 Dec 15 12:42:05.757655 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 205/402] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:05 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1566 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:42:06.336110 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3e1c2c16-01bb-414a-86d9-9d8bb5b85e5b tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:06.336722 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3e1c2c16-01bb-414a-86d9-9d8bb5b85e5b tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: d2617ab9-727c-4fdc-8c26-1c46312c89ca] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:06.343676 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3e1c2c16-01bb-414a-86d9-9d8bb5b85e5b tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:06.344150 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3e1c2c16-01bb-414a-86d9-9d8bb5b85e5b tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:06.344917 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3e1c2c16-01bb-414a-86d9-9d8bb5b85e5b tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:06.345340 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3e1c2c16-01bb-414a-86d9-9d8bb5b85e5b tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:06.486350 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3e1c2c16-01bb-414a-86d9-9d8bb5b85e5b tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13d2fbbad43428b8e5637e6d86d93fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473ac1badd984fbeb2e27b1ac44b3d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:06.494692 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3e1c2c16-01bb-414a-86d9-9d8bb5b85e5b tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca" status: 200 len: 1314 microversion: 2.1 time: 0.162194 Dec 15 12:42:06.495271 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 198/403] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:06 2021] GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:42:06.701410 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-42b0223e-87d4-476c-9ac8-c13a9e567019 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:06.702388 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-42b0223e-87d4-476c-9ac8-c13a9e567019 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:06.709483 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-42b0223e-87d4-476c-9ac8-c13a9e567019 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:06.709950 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-42b0223e-87d4-476c-9ac8-c13a9e567019 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:06.710732 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-42b0223e-87d4-476c-9ac8-c13a9e567019 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:06.711340 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-42b0223e-87d4-476c-9ac8-c13a9e567019 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:06.768767 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e4d4f751-031a-4b79-82d9-d9e291736350 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:06.769368 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e4d4f751-031a-4b79-82d9-d9e291736350 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:06.781848 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e4d4f751-031a-4b79-82d9-d9e291736350 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:06.782746 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e4d4f751-031a-4b79-82d9-d9e291736350 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:06.783976 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e4d4f751-031a-4b79-82d9-d9e291736350 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:06.784581 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e4d4f751-031a-4b79-82d9-d9e291736350 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:06.920950 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-42b0223e-87d4-476c-9ac8-c13a9e567019 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:06.930452 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-42b0223e-87d4-476c-9ac8-c13a9e567019 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:06.932120 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-42b0223e-87d4-476c-9ac8-c13a9e567019 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:06.933323 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-42b0223e-87d4-476c-9ac8-c13a9e567019 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1745 microversion: 2.20 time: 0.236648 Dec 15 12:42:06.934328 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 206/404] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:06 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1745 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:06.940118 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5f154b39-6fab-4079-837f-d159ef5fff2b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee0b2570-eef1-4bfc-af8f-6c7ed6bfbacb"}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:42:06.941635 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5f154b39-6fab-4079-837f-d159ef5fff2b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:06.949134 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5f154b39-6fab-4079-837f-d159ef5fff2b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:06.950541 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5f154b39-6fab-4079-837f-d159ef5fff2b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:06.951713 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5f154b39-6fab-4079-837f-d159ef5fff2b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:06.952256 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5f154b39-6fab-4079-837f-d159ef5fff2b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:06.997631 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e4d4f751-031a-4b79-82d9-d9e291736350 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:07.006498 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e4d4f751-031a-4b79-82d9-d9e291736350 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1566 microversion: 2.1 time: 0.241762 Dec 15 12:42:07.009577 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 199/405] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:06 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1566 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:42:07.230926 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5f154b39-6fab-4079-837f-d159ef5fff2b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "POST /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295348 Dec 15 12:42:07.231609 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 207/406] 10.222.0.76 () {60 vars in 1322 bytes} [Wed Dec 15 12:42:06 2021] POST /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:07.512432 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7b77c2ee-a4e1-47cd-af1e-f89e44bb8997 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:07.513047 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7b77c2ee-a4e1-47cd-af1e-f89e44bb8997 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: d2617ab9-727c-4fdc-8c26-1c46312c89ca] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:07.520134 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b77c2ee-a4e1-47cd-af1e-f89e44bb8997 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:07.520581 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b77c2ee-a4e1-47cd-af1e-f89e44bb8997 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:07.521369 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b77c2ee-a4e1-47cd-af1e-f89e44bb8997 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:07.521840 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b77c2ee-a4e1-47cd-af1e-f89e44bb8997 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:07.668990 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7b77c2ee-a4e1-47cd-af1e-f89e44bb8997 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13d2fbbad43428b8e5637e6d86d93fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473ac1badd984fbeb2e27b1ac44b3d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:07.676710 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7b77c2ee-a4e1-47cd-af1e-f89e44bb8997 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca" status: 200 len: 1314 microversion: 2.1 time: 0.167916 Dec 15 12:42:07.677280 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 200/407] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:07 2021] GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:42:07.955723 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9aa18106-ae41-4d12-ab97-c7ec0c17b221 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:07.956414 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9aa18106-ae41-4d12-ab97-c7ec0c17b221 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:07.962385 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9aa18106-ae41-4d12-ab97-c7ec0c17b221 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:07.962838 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9aa18106-ae41-4d12-ab97-c7ec0c17b221 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:07.963621 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9aa18106-ae41-4d12-ab97-c7ec0c17b221 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:07.964025 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9aa18106-ae41-4d12-ab97-c7ec0c17b221 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:08.027450 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7e25b7f6-d018-422b-a720-4fc6dbd88c7d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:08.028068 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7e25b7f6-d018-422b-a720-4fc6dbd88c7d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:08.037706 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7e25b7f6-d018-422b-a720-4fc6dbd88c7d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:08.038081 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7e25b7f6-d018-422b-a720-4fc6dbd88c7d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:08.039134 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7e25b7f6-d018-422b-a720-4fc6dbd88c7d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:08.039617 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7e25b7f6-d018-422b-a720-4fc6dbd88c7d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:08.153235 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9aa18106-ae41-4d12-ab97-c7ec0c17b221 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:08.162659 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9aa18106-ae41-4d12-ab97-c7ec0c17b221 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:08.164416 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9aa18106-ae41-4d12-ab97-c7ec0c17b221 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:08.165639 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9aa18106-ae41-4d12-ab97-c7ec0c17b221 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1745 microversion: 2.20 time: 0.215914 Dec 15 12:42:08.166366 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 208/408] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:07 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1745 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:08.220533 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7e25b7f6-d018-422b-a720-4fc6dbd88c7d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:08.230564 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7e25b7f6-d018-422b-a720-4fc6dbd88c7d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1566 microversion: 2.1 time: 0.210387 Dec 15 12:42:08.231342 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 201/409] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:08 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1566 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:42:08.367414 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [req-8f50bafb-ee16-4695-9398-15729d3f6861 req-0c391f6d-f946-41b7-9cfd-1e730c0532bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2617ab9-727c-4fdc-8c26-1c46312c89ca", "name": "network-vif-plugged", "status": "completed", "tag": "0bb97ec6-500a-4062-bdaa-84dd4b6d7435"}]} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:42:08.369088 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:42:08.369088 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: warnings.warn(msg) Dec 15 12:42:08.376820 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-8f50bafb-ee16-4695-9398-15729d3f6861 req-0c391f6d-f946-41b7-9cfd-1e730c0532bf service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:08.377251 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-8f50bafb-ee16-4695-9398-15729d3f6861 req-0c391f6d-f946-41b7-9cfd-1e730c0532bf service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:08.388775 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.compute.server_external_events [req-8f50bafb-ee16-4695-9398-15729d3f6861 req-0c391f6d-f946-41b7-9cfd-1e730c0532bf service nova] Creating event network-vif-plugged:0bb97ec6-500a-4062-bdaa-84dd4b6d7435 for instance d2617ab9-727c-4fdc-8c26-1c46312c89ca on hv-cinder-81322 Dec 15 12:42:08.395690 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [req-8f50bafb-ee16-4695-9398-15729d3f6861 req-0c391f6d-f946-41b7-9cfd-1e730c0532bf service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031648 Dec 15 12:42:08.396679 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 209/410] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 12:42:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:08.693601 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-01a0b56d-5ea7-40b6-bdcd-dff51c27b3c0 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:08.694226 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-01a0b56d-5ea7-40b6-bdcd-dff51c27b3c0 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: d2617ab9-727c-4fdc-8c26-1c46312c89ca] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:08.701093 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-01a0b56d-5ea7-40b6-bdcd-dff51c27b3c0 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:08.701602 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-01a0b56d-5ea7-40b6-bdcd-dff51c27b3c0 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:08.702500 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-01a0b56d-5ea7-40b6-bdcd-dff51c27b3c0 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:08.702964 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-01a0b56d-5ea7-40b6-bdcd-dff51c27b3c0 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:08.863391 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-01a0b56d-5ea7-40b6-bdcd-dff51c27b3c0 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13d2fbbad43428b8e5637e6d86d93fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473ac1badd984fbeb2e27b1ac44b3d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:08.870756 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-01a0b56d-5ea7-40b6-bdcd-dff51c27b3c0 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca" status: 200 len: 1314 microversion: 2.1 time: 0.180781 Dec 15 12:42:08.871319 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 202/411] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:08 2021] GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:42:09.185007 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4fbc3733-c5a6-4660-b8f9-f404d046bf96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:09.185754 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4fbc3733-c5a6-4660-b8f9-f404d046bf96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:09.192672 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4fbc3733-c5a6-4660-b8f9-f404d046bf96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:09.193124 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4fbc3733-c5a6-4660-b8f9-f404d046bf96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:09.193935 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4fbc3733-c5a6-4660-b8f9-f404d046bf96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:09.194371 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4fbc3733-c5a6-4660-b8f9-f404d046bf96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:09.250914 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-229662f0-0547-4f62-b4c5-2179e8ce49b8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:09.251915 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-229662f0-0547-4f62-b4c5-2179e8ce49b8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:09.262496 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-229662f0-0547-4f62-b4c5-2179e8ce49b8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:09.263566 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-229662f0-0547-4f62-b4c5-2179e8ce49b8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:09.264375 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-229662f0-0547-4f62-b4c5-2179e8ce49b8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:09.264803 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-229662f0-0547-4f62-b4c5-2179e8ce49b8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:09.396870 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4fbc3733-c5a6-4660-b8f9-f404d046bf96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:09.412472 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4fbc3733-c5a6-4660-b8f9-f404d046bf96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:09.414154 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4fbc3733-c5a6-4660-b8f9-f404d046bf96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:09.415522 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4fbc3733-c5a6-4660-b8f9-f404d046bf96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1745 microversion: 2.20 time: 0.234873 Dec 15 12:42:09.416116 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 210/412] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:09 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1745 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:09.479561 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-229662f0-0547-4f62-b4c5-2179e8ce49b8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:09.488564 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-229662f0-0547-4f62-b4c5-2179e8ce49b8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1566 microversion: 2.1 time: 0.242576 Dec 15 12:42:09.489834 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 203/413] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:09 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1566 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:42:09.887612 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-eb2cdc29-7700-452b-99d7-fd52f46a703f tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:09.888245 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-eb2cdc29-7700-452b-99d7-fd52f46a703f tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: d2617ab9-727c-4fdc-8c26-1c46312c89ca] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:09.898256 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eb2cdc29-7700-452b-99d7-fd52f46a703f tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:09.898256 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eb2cdc29-7700-452b-99d7-fd52f46a703f tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:09.898256 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eb2cdc29-7700-452b-99d7-fd52f46a703f tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:09.898256 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eb2cdc29-7700-452b-99d7-fd52f46a703f tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:10.044480 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-eb2cdc29-7700-452b-99d7-fd52f46a703f tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13d2fbbad43428b8e5637e6d86d93fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473ac1badd984fbeb2e27b1ac44b3d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:10.061178 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-eb2cdc29-7700-452b-99d7-fd52f46a703f tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca" status: 200 len: 1314 microversion: 2.1 time: 0.176929 Dec 15 12:42:10.062732 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 211/414] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:09 2021] GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:42:10.415757 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-89bcc227-21b2-440f-aecb-df9399e9cb8c req-cec64f45-674f-430e-99bb-1fb7e8505310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2", "name": "network-vif-plugged", "status": "completed", "tag": "67d867cb-3a0f-4a77-8182-0e96b6df907f"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:42:10.418321 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:42:10.418321 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 12:42:10.434752 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-89bcc227-21b2-440f-aecb-df9399e9cb8c req-cec64f45-674f-430e-99bb-1fb7e8505310 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:10.435177 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-89bcc227-21b2-440f-aecb-df9399e9cb8c req-cec64f45-674f-430e-99bb-1fb7e8505310 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:10.440979 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0777caf1-0269-4b89-81f0-4d42b1d2b880 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:10.442610 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0777caf1-0269-4b89-81f0-4d42b1d2b880 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:10.456198 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-89bcc227-21b2-440f-aecb-df9399e9cb8c req-cec64f45-674f-430e-99bb-1fb7e8505310 service nova] Creating event network-vif-plugged:67d867cb-3a0f-4a77-8182-0e96b6df907f for instance ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 on hv-cinder-81322 Dec 15 12:42:10.458045 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0777caf1-0269-4b89-81f0-4d42b1d2b880 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:10.459267 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0777caf1-0269-4b89-81f0-4d42b1d2b880 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:10.461639 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-89bcc227-21b2-440f-aecb-df9399e9cb8c req-cec64f45-674f-430e-99bb-1fb7e8505310 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049404 Dec 15 12:42:10.462483 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 204/415] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 12:42:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:10.462764 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0777caf1-0269-4b89-81f0-4d42b1d2b880 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:10.463405 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0777caf1-0269-4b89-81f0-4d42b1d2b880 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:10.506173 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-13805297-f091-4e04-b94c-8fed588572be tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:10.507091 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-13805297-f091-4e04-b94c-8fed588572be tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:10.523476 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-13805297-f091-4e04-b94c-8fed588572be tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:10.523928 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-13805297-f091-4e04-b94c-8fed588572be tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:10.524738 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-13805297-f091-4e04-b94c-8fed588572be tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:10.525305 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-13805297-f091-4e04-b94c-8fed588572be tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:10.718505 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0777caf1-0269-4b89-81f0-4d42b1d2b880 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:10.730051 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0777caf1-0269-4b89-81f0-4d42b1d2b880 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:10.732159 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0777caf1-0269-4b89-81f0-4d42b1d2b880 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:10.733775 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0777caf1-0269-4b89-81f0-4d42b1d2b880 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1740 microversion: 2.20 time: 0.300199 Dec 15 12:42:10.738421 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 212/416] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:10 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1740 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:10.751012 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-13805297-f091-4e04-b94c-8fed588572be tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:10.760380 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-13805297-f091-4e04-b94c-8fed588572be tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1566 microversion: 2.1 time: 0.258451 Dec 15 12:42:10.760909 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 205/417] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:10 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1566 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:42:11.078814 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e34ae294-bf03-484a-8324-08449ffce05d tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:11.080147 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e34ae294-bf03-484a-8324-08449ffce05d tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: d2617ab9-727c-4fdc-8c26-1c46312c89ca] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:11.086409 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e34ae294-bf03-484a-8324-08449ffce05d tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:11.087097 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e34ae294-bf03-484a-8324-08449ffce05d tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:11.088080 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e34ae294-bf03-484a-8324-08449ffce05d tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:11.088664 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e34ae294-bf03-484a-8324-08449ffce05d tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:11.269156 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e34ae294-bf03-484a-8324-08449ffce05d tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13d2fbbad43428b8e5637e6d86d93fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473ac1badd984fbeb2e27b1ac44b3d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:11.277949 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e34ae294-bf03-484a-8324-08449ffce05d tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca" status: 200 len: 1499 microversion: 2.1 time: 0.203008 Dec 15 12:42:11.279690 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 213/418] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:11 2021] GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca => generated 1499 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:42:11.758273 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e4466e97-99e4-4a75-9a07-a9b10d6ccba9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:11.758904 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e4466e97-99e4-4a75-9a07-a9b10d6ccba9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:11.766259 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e4466e97-99e4-4a75-9a07-a9b10d6ccba9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:11.766788 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e4466e97-99e4-4a75-9a07-a9b10d6ccba9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:11.767919 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e4466e97-99e4-4a75-9a07-a9b10d6ccba9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:11.768523 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e4466e97-99e4-4a75-9a07-a9b10d6ccba9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:11.789550 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-36472185-1137-4f51-a7fc-d666401a09c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:11.789550 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-36472185-1137-4f51-a7fc-d666401a09c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:11.789550 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-36472185-1137-4f51-a7fc-d666401a09c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:11.790304 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-36472185-1137-4f51-a7fc-d666401a09c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:11.790650 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-36472185-1137-4f51-a7fc-d666401a09c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:11.791295 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-36472185-1137-4f51-a7fc-d666401a09c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:12.048050 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e4466e97-99e4-4a75-9a07-a9b10d6ccba9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:12.055029 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e4466e97-99e4-4a75-9a07-a9b10d6ccba9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:12.056903 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-36472185-1137-4f51-a7fc-d666401a09c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:12.057071 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e4466e97-99e4-4a75-9a07-a9b10d6ccba9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:12.058588 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e4466e97-99e4-4a75-9a07-a9b10d6ccba9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1740 microversion: 2.20 time: 0.304121 Dec 15 12:42:12.060134 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 206/419] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:11 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1740 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:12.066648 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-36472185-1137-4f51-a7fc-d666401a09c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1566 microversion: 2.1 time: 0.291933 Dec 15 12:42:12.072248 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 214/420] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:11 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1566 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:42:13.082271 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2a509a0b-1796-48f3-ac5f-6fe6522b6586 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:13.084477 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2a509a0b-1796-48f3-ac5f-6fe6522b6586 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:13.091334 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1a3f2692-ba8f-472e-9c3f-813edd31fe02 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:13.092212 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2a509a0b-1796-48f3-ac5f-6fe6522b6586 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:13.092212 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2a509a0b-1796-48f3-ac5f-6fe6522b6586 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:13.092524 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1a3f2692-ba8f-472e-9c3f-813edd31fe02 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:13.092669 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2a509a0b-1796-48f3-ac5f-6fe6522b6586 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:13.093275 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2a509a0b-1796-48f3-ac5f-6fe6522b6586 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:13.105323 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1a3f2692-ba8f-472e-9c3f-813edd31fe02 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:13.106242 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1a3f2692-ba8f-472e-9c3f-813edd31fe02 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:13.107250 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1a3f2692-ba8f-472e-9c3f-813edd31fe02 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:13.107850 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1a3f2692-ba8f-472e-9c3f-813edd31fe02 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:13.328251 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2a509a0b-1796-48f3-ac5f-6fe6522b6586 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:13.336858 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2a509a0b-1796-48f3-ac5f-6fe6522b6586 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:13.338507 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2a509a0b-1796-48f3-ac5f-6fe6522b6586 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:13.339658 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2a509a0b-1796-48f3-ac5f-6fe6522b6586 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1740 microversion: 2.20 time: 0.265691 Dec 15 12:42:13.350794 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 207/421] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:13 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1740 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:13.351152 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1a3f2692-ba8f-472e-9c3f-813edd31fe02 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:13.358188 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1a3f2692-ba8f-472e-9c3f-813edd31fe02 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1546 microversion: 2.1 time: 0.272875 Dec 15 12:42:13.358693 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 215/422] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:13 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1546 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:42:13.376254 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0b786bf3-ab51-46cd-922b-9b4bd5063716 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:13.376835 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0b786bf3-ab51-46cd-922b-9b4bd5063716 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:13.384194 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0b786bf3-ab51-46cd-922b-9b4bd5063716 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:13.384750 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0b786bf3-ab51-46cd-922b-9b4bd5063716 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:13.385816 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0b786bf3-ab51-46cd-922b-9b4bd5063716 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:13.386137 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0b786bf3-ab51-46cd-922b-9b4bd5063716 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:13.503405 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.wsgi [None req-0b786bf3-ab51-46cd-922b-9b4bd5063716 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] HTTP exception thrown: Cannot 'detach_volume' instance 2824788a-14d6-488d-8af1-2df6b3de771a while it is in vm_state rescued Dec 15 12:42:13.504517 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0b786bf3-ab51-46cd-922b-9b4bd5063716 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Returning 409 to user: Cannot 'detach_volume' instance 2824788a-14d6-488d-8af1-2df6b3de771a while it is in vm_state rescued {{(pid=122614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:42:13.506074 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0b786bf3-ab51-46cd-922b-9b4bd5063716 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "DELETE /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments/2fc8320b-d8ff-463d-9969-2fcff08ee555" status: 409 len: 152 microversion: 2.1 time: 0.133944 Dec 15 12:42:13.507041 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 208/423] 10.222.0.76 () {58 vars in 1415 bytes} [Wed Dec 15 12:42:13 2021] DELETE /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments/2fc8320b-d8ff-463d-9969-2fcff08ee555 => generated 152 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Dec 15 12:42:13.516752 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fa9f161f-b9db-4612-b8ce-dc4cb96bc41c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:42:13.517275 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fa9f161f-b9db-4612-b8ce-dc4cb96bc41c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:13.523844 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fa9f161f-b9db-4612-b8ce-dc4cb96bc41c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:13.524287 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fa9f161f-b9db-4612-b8ce-dc4cb96bc41c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:13.525080 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fa9f161f-b9db-4612-b8ce-dc4cb96bc41c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:13.525500 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fa9f161f-b9db-4612-b8ce-dc4cb96bc41c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:13.605810 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fa9f161f-b9db-4612-b8ce-dc4cb96bc41c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "POST /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/action" status: 202 len: 0 microversion: 2.1 time: 0.092209 Dec 15 12:42:13.607416 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 216/424] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 12:42:13 2021] POST /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:42:13.616683 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2c4e7a08-8437-46e7-9851-31df327a50a0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:13.617342 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2c4e7a08-8437-46e7-9851-31df327a50a0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:13.623609 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2c4e7a08-8437-46e7-9851-31df327a50a0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:13.624225 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2c4e7a08-8437-46e7-9851-31df327a50a0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:13.625919 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2c4e7a08-8437-46e7-9851-31df327a50a0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:13.626587 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2c4e7a08-8437-46e7-9851-31df327a50a0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:13.793373 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2c4e7a08-8437-46e7-9851-31df327a50a0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:13.802190 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2c4e7a08-8437-46e7-9851-31df327a50a0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1554 microversion: 2.1 time: 0.189169 Dec 15 12:42:13.803354 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 209/425] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:13 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1554 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:42:14.359844 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2f84e0da-b130-450e-870d-78f89ab1464a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:14.361306 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2f84e0da-b130-450e-870d-78f89ab1464a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:14.368294 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2f84e0da-b130-450e-870d-78f89ab1464a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:14.368950 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2f84e0da-b130-450e-870d-78f89ab1464a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:14.370064 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2f84e0da-b130-450e-870d-78f89ab1464a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:14.370790 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2f84e0da-b130-450e-870d-78f89ab1464a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:14.604166 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2f84e0da-b130-450e-870d-78f89ab1464a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:14.614627 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2f84e0da-b130-450e-870d-78f89ab1464a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:14.618746 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2f84e0da-b130-450e-870d-78f89ab1464a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:14.620106 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2f84e0da-b130-450e-870d-78f89ab1464a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1740 microversion: 2.20 time: 0.265254 Dec 15 12:42:14.620760 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 217/426] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:14 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1740 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:42:14.825044 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2e3db780-f964-47ed-98f9-9f918b0e01d3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:14.826344 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2e3db780-f964-47ed-98f9-9f918b0e01d3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:14.835054 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2e3db780-f964-47ed-98f9-9f918b0e01d3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:14.835519 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2e3db780-f964-47ed-98f9-9f918b0e01d3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:14.836342 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2e3db780-f964-47ed-98f9-9f918b0e01d3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:14.836782 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2e3db780-f964-47ed-98f9-9f918b0e01d3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:14.999355 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2e3db780-f964-47ed-98f9-9f918b0e01d3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:15.008178 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2e3db780-f964-47ed-98f9-9f918b0e01d3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1554 microversion: 2.1 time: 0.189345 Dec 15 12:42:15.008751 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 210/427] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:14 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1554 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:42:15.639442 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5ceee3fc-3501-4ed4-a81d-1ad43d61d1bc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:15.640056 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5ceee3fc-3501-4ed4-a81d-1ad43d61d1bc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:15.648672 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ceee3fc-3501-4ed4-a81d-1ad43d61d1bc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:15.649138 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ceee3fc-3501-4ed4-a81d-1ad43d61d1bc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:15.650029 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ceee3fc-3501-4ed4-a81d-1ad43d61d1bc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:15.650474 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ceee3fc-3501-4ed4-a81d-1ad43d61d1bc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:15.821465 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5ceee3fc-3501-4ed4-a81d-1ad43d61d1bc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:15.830408 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5ceee3fc-3501-4ed4-a81d-1ad43d61d1bc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:15.832148 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5ceee3fc-3501-4ed4-a81d-1ad43d61d1bc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:15.833581 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5ceee3fc-3501-4ed4-a81d-1ad43d61d1bc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1740 microversion: 2.20 time: 0.197924 Dec 15 12:42:15.834145 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 218/428] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:15 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:16.034447 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3bdddcdc-7092-408c-b065-5d6557777390 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:16.039539 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3bdddcdc-7092-408c-b065-5d6557777390 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:16.046912 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3bdddcdc-7092-408c-b065-5d6557777390 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:16.047670 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3bdddcdc-7092-408c-b065-5d6557777390 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:16.048761 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3bdddcdc-7092-408c-b065-5d6557777390 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:16.049413 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3bdddcdc-7092-408c-b065-5d6557777390 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:16.212900 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3bdddcdc-7092-408c-b065-5d6557777390 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:16.221866 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3bdddcdc-7092-408c-b065-5d6557777390 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1554 microversion: 2.1 time: 0.190791 Dec 15 12:42:16.231294 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 211/429] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:16 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1554 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:42:16.852162 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-acfc90a1-c6b8-4676-91d8-32bf0dc54364 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:16.853536 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-acfc90a1-c6b8-4676-91d8-32bf0dc54364 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:16.860862 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-acfc90a1-c6b8-4676-91d8-32bf0dc54364 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:16.861733 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-acfc90a1-c6b8-4676-91d8-32bf0dc54364 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:16.862750 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-acfc90a1-c6b8-4676-91d8-32bf0dc54364 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:16.863251 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-acfc90a1-c6b8-4676-91d8-32bf0dc54364 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:17.016286 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-acfc90a1-c6b8-4676-91d8-32bf0dc54364 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:17.024687 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-acfc90a1-c6b8-4676-91d8-32bf0dc54364 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:17.026293 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-acfc90a1-c6b8-4676-91d8-32bf0dc54364 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:17.027461 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-acfc90a1-c6b8-4676-91d8-32bf0dc54364 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1740 microversion: 2.20 time: 0.179118 Dec 15 12:42:17.028191 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 219/430] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:16 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:17.238898 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-53dfa740-ddee-4fb6-8d17-84e7da7c0b33 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:17.239506 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-53dfa740-ddee-4fb6-8d17-84e7da7c0b33 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:17.246841 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-53dfa740-ddee-4fb6-8d17-84e7da7c0b33 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:17.247577 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-53dfa740-ddee-4fb6-8d17-84e7da7c0b33 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:17.248791 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-53dfa740-ddee-4fb6-8d17-84e7da7c0b33 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:17.250243 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-53dfa740-ddee-4fb6-8d17-84e7da7c0b33 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:17.402975 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-53dfa740-ddee-4fb6-8d17-84e7da7c0b33 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:17.412920 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-53dfa740-ddee-4fb6-8d17-84e7da7c0b33 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1560 microversion: 2.1 time: 0.177574 Dec 15 12:42:17.431890 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 212/431] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:42:17 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1560 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:42:17.503591 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-82d031d7-163e-412f-8f24-87dd98c58b2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:17.505158 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-82d031d7-163e-412f-8f24-87dd98c58b2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:17.514147 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-82d031d7-163e-412f-8f24-87dd98c58b2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:17.514599 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-82d031d7-163e-412f-8f24-87dd98c58b2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:17.515945 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-82d031d7-163e-412f-8f24-87dd98c58b2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:17.516382 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-82d031d7-163e-412f-8f24-87dd98c58b2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:17.614745 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.objects.instance [None req-82d031d7-163e-412f-8f24-87dd98c58b2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lazy-loading 'services' on Instance uuid 2824788a-14d6-488d-8af1-2df6b3de771a {{(pid=122615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 12:42:17.734603 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-82d031d7-163e-412f-8f24-87dd98c58b2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "DELETE /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments/2fc8320b-d8ff-463d-9969-2fcff08ee555" status: 202 len: 0 microversion: 2.1 time: 0.234349 Dec 15 12:42:17.735543 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 220/432] 10.222.0.76 () {58 vars in 1415 bytes} [Wed Dec 15 12:42:17 2021] DELETE /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments/2fc8320b-d8ff-463d-9969-2fcff08ee555 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:42:17.743787 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f6508071-6414-4803-b27e-8afb7540a06e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:17.744956 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f6508071-6414-4803-b27e-8afb7540a06e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:17.760217 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f6508071-6414-4803-b27e-8afb7540a06e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:17.760781 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f6508071-6414-4803-b27e-8afb7540a06e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:17.761698 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f6508071-6414-4803-b27e-8afb7540a06e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:17.762199 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f6508071-6414-4803-b27e-8afb7540a06e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:17.807533 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f6508071-6414-4803-b27e-8afb7540a06e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066171 Dec 15 12:42:17.810681 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 213/433] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:17 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:18.050298 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-38c46c70-ff4d-496a-a63e-025598548939 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:18.052036 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-38c46c70-ff4d-496a-a63e-025598548939 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:18.061452 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-38c46c70-ff4d-496a-a63e-025598548939 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:18.062376 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-38c46c70-ff4d-496a-a63e-025598548939 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:18.063256 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-38c46c70-ff4d-496a-a63e-025598548939 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:18.063768 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-38c46c70-ff4d-496a-a63e-025598548939 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:18.230520 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-38c46c70-ff4d-496a-a63e-025598548939 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:18.239416 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-38c46c70-ff4d-496a-a63e-025598548939 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:18.241987 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-38c46c70-ff4d-496a-a63e-025598548939 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:18.244146 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-38c46c70-ff4d-496a-a63e-025598548939 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1740 microversion: 2.20 time: 0.201146 Dec 15 12:42:18.247047 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 221/434] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:18 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:18.821391 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0615b276-acaa-4438-9f0c-ffc683a53572 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:18.823671 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0615b276-acaa-4438-9f0c-ffc683a53572 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:18.832451 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0615b276-acaa-4438-9f0c-ffc683a53572 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:18.833108 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0615b276-acaa-4438-9f0c-ffc683a53572 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:18.834401 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0615b276-acaa-4438-9f0c-ffc683a53572 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:18.835438 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0615b276-acaa-4438-9f0c-ffc683a53572 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:18.870316 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0615b276-acaa-4438-9f0c-ffc683a53572 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054955 Dec 15 12:42:18.871532 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 214/435] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:18 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:19.266181 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-cadbee69-3636-403e-aff8-c3346eda8214 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:19.267084 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-cadbee69-3636-403e-aff8-c3346eda8214 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:19.273276 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cadbee69-3636-403e-aff8-c3346eda8214 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:19.273747 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cadbee69-3636-403e-aff8-c3346eda8214 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:19.274524 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cadbee69-3636-403e-aff8-c3346eda8214 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:19.274948 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cadbee69-3636-403e-aff8-c3346eda8214 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:19.427364 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-cadbee69-3636-403e-aff8-c3346eda8214 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:19.435258 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-cadbee69-3636-403e-aff8-c3346eda8214 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:19.436792 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-cadbee69-3636-403e-aff8-c3346eda8214 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:19.439009 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cadbee69-3636-403e-aff8-c3346eda8214 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1740 microversion: 2.20 time: 0.177072 Dec 15 12:42:19.440045 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 222/436] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:19 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:19.883608 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c8b596c1-36d2-411e-b9bc-704009d9b531 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:19.884524 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c8b596c1-36d2-411e-b9bc-704009d9b531 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:19.890960 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c8b596c1-36d2-411e-b9bc-704009d9b531 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:19.891414 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c8b596c1-36d2-411e-b9bc-704009d9b531 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:19.892200 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c8b596c1-36d2-411e-b9bc-704009d9b531 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:19.892633 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c8b596c1-36d2-411e-b9bc-704009d9b531 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:19.924990 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c8b596c1-36d2-411e-b9bc-704009d9b531 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045209 Dec 15 12:42:19.925564 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 215/437] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:19 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:20.457805 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-14677c12-3312-484d-b988-cdfb1eee93c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:20.458416 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-14677c12-3312-484d-b988-cdfb1eee93c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:20.464345 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-14677c12-3312-484d-b988-cdfb1eee93c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:20.464791 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-14677c12-3312-484d-b988-cdfb1eee93c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:20.465643 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-14677c12-3312-484d-b988-cdfb1eee93c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:20.466017 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-14677c12-3312-484d-b988-cdfb1eee93c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:20.615074 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-14677c12-3312-484d-b988-cdfb1eee93c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:20.622831 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-14677c12-3312-484d-b988-cdfb1eee93c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:20.624342 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-14677c12-3312-484d-b988-cdfb1eee93c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:20.625783 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-14677c12-3312-484d-b988-cdfb1eee93c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1722 microversion: 2.20 time: 0.171527 Dec 15 12:42:20.626351 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 223/438] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:20 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:20.936180 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b2b554c1-fa4c-4ad7-b1c2-cf5a97d970de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:20.937665 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b2b554c1-fa4c-4ad7-b1c2-cf5a97d970de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:20.943894 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b2b554c1-fa4c-4ad7-b1c2-cf5a97d970de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:20.944337 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b2b554c1-fa4c-4ad7-b1c2-cf5a97d970de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:20.948474 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b2b554c1-fa4c-4ad7-b1c2-cf5a97d970de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:20.948913 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b2b554c1-fa4c-4ad7-b1c2-cf5a97d970de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:20.979623 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b2b554c1-fa4c-4ad7-b1c2-cf5a97d970de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047134 Dec 15 12:42:20.980180 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 216/439] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:20 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:21.644488 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-97c9cdbf-49da-4723-bdb3-194e3f06fb4c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:21.645096 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-97c9cdbf-49da-4723-bdb3-194e3f06fb4c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:21.651414 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-97c9cdbf-49da-4723-bdb3-194e3f06fb4c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:21.651858 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-97c9cdbf-49da-4723-bdb3-194e3f06fb4c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:21.652630 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-97c9cdbf-49da-4723-bdb3-194e3f06fb4c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:21.653060 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-97c9cdbf-49da-4723-bdb3-194e3f06fb4c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:21.792699 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-97c9cdbf-49da-4723-bdb3-194e3f06fb4c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:21.801149 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-97c9cdbf-49da-4723-bdb3-194e3f06fb4c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:21.802666 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-97c9cdbf-49da-4723-bdb3-194e3f06fb4c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:21.803806 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-97c9cdbf-49da-4723-bdb3-194e3f06fb4c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1722 microversion: 2.20 time: 0.163110 Dec 15 12:42:21.804355 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 224/440] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:21 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:21.991790 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-121d887e-3c2c-4d06-a9f7-172520fc9f56 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:21.992690 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-121d887e-3c2c-4d06-a9f7-172520fc9f56 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:21.999044 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-121d887e-3c2c-4d06-a9f7-172520fc9f56 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:22.000046 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-121d887e-3c2c-4d06-a9f7-172520fc9f56 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:22.000849 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-121d887e-3c2c-4d06-a9f7-172520fc9f56 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:22.001280 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-121d887e-3c2c-4d06-a9f7-172520fc9f56 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:22.029396 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-121d887e-3c2c-4d06-a9f7-172520fc9f56 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041499 Dec 15 12:42:22.029979 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 217/441] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:21 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:22.197061 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [req-8df6a659-e8c6-4350-a735-425db2676077 req-efea8594-8c6a-434f-9024-92be8b008268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2", "name": "network-vif-unplugged", "status": "completed", "tag": "67d867cb-3a0f-4a77-8182-0e96b6df907f"}]} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:42:22.198786 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:42:22.198786 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: warnings.warn(msg) Dec 15 12:42:22.206922 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-8df6a659-e8c6-4350-a735-425db2676077 req-efea8594-8c6a-434f-9024-92be8b008268 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:22.207441 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-8df6a659-e8c6-4350-a735-425db2676077 req-efea8594-8c6a-434f-9024-92be8b008268 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:22.227343 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.compute.server_external_events [req-8df6a659-e8c6-4350-a735-425db2676077 req-efea8594-8c6a-434f-9024-92be8b008268 service nova] Creating event network-vif-unplugged:67d867cb-3a0f-4a77-8182-0e96b6df907f for instance ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 on hv-cinder-81322 Dec 15 12:42:22.232198 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [req-8df6a659-e8c6-4350-a735-425db2676077 req-efea8594-8c6a-434f-9024-92be8b008268 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039072 Dec 15 12:42:22.232789 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 225/442] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 12:42:22 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:22.821345 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f23699a3-1cb4-40f8-af78-f98841470577 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:22.822008 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f23699a3-1cb4-40f8-af78-f98841470577 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:22.828747 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f23699a3-1cb4-40f8-af78-f98841470577 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:22.829192 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f23699a3-1cb4-40f8-af78-f98841470577 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:22.830001 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f23699a3-1cb4-40f8-af78-f98841470577 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:22.830494 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f23699a3-1cb4-40f8-af78-f98841470577 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:22.976648 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f23699a3-1cb4-40f8-af78-f98841470577 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:22.985242 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f23699a3-1cb4-40f8-af78-f98841470577 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:22.986777 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f23699a3-1cb4-40f8-af78-f98841470577 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:22.987924 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f23699a3-1cb4-40f8-af78-f98841470577 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1725 microversion: 2.20 time: 0.170336 Dec 15 12:42:22.988479 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 218/443] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:22 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:42:23.006638 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-299f1368-e88b-4e40-bd22-b61f13e98967 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "576fc6de-ae11-4b3b-ba2c-44c2f85edfd6"}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:42:23.007851 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-299f1368-e88b-4e40-bd22-b61f13e98967 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:23.013957 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-299f1368-e88b-4e40-bd22-b61f13e98967 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:23.014394 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-299f1368-e88b-4e40-bd22-b61f13e98967 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:23.015828 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-299f1368-e88b-4e40-bd22-b61f13e98967 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:23.016322 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-299f1368-e88b-4e40-bd22-b61f13e98967 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:23.040744 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-548aedab-42bb-402b-a158-8ff3d7144600 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:23.041778 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-548aedab-42bb-402b-a158-8ff3d7144600 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:23.048315 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-548aedab-42bb-402b-a158-8ff3d7144600 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:23.048838 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-548aedab-42bb-402b-a158-8ff3d7144600 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:23.049727 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-548aedab-42bb-402b-a158-8ff3d7144600 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:23.050161 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-548aedab-42bb-402b-a158-8ff3d7144600 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:23.081368 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-548aedab-42bb-402b-a158-8ff3d7144600 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044162 Dec 15 12:42:23.082032 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 219/444] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:23 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:23.337625 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-299f1368-e88b-4e40-bd22-b61f13e98967 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.335794 Dec 15 12:42:23.338250 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 226/445] 10.222.0.76 () {62 vars in 1363 bytes} [Wed Dec 15 12:42:23 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 188 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:42:23.448207 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d8cacf6f-a0fc-4b4f-bf56-e74055909d87 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:42:23.448773 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d8cacf6f-a0fc-4b4f-bf56-e74055909d87 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:23.456180 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d8cacf6f-a0fc-4b4f-bf56-e74055909d87 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:23.456618 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d8cacf6f-a0fc-4b4f-bf56-e74055909d87 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:23.457413 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d8cacf6f-a0fc-4b4f-bf56-e74055909d87 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:23.457884 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d8cacf6f-a0fc-4b4f-bf56-e74055909d87 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:23.551023 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d8cacf6f-a0fc-4b4f-bf56-e74055909d87 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 202 len: 0 microversion: 2.20 time: 0.106364 Dec 15 12:42:23.551958 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 220/446] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:42:23 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 12:42:23.560820 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d09d33af-4e68-49c8-91d4-f81820bcb53c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:23.561882 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d09d33af-4e68-49c8-91d4-f81820bcb53c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:23.568136 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d09d33af-4e68-49c8-91d4-f81820bcb53c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:23.568581 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d09d33af-4e68-49c8-91d4-f81820bcb53c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:23.569368 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d09d33af-4e68-49c8-91d4-f81820bcb53c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:23.569836 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d09d33af-4e68-49c8-91d4-f81820bcb53c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:23.707012 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d09d33af-4e68-49c8-91d4-f81820bcb53c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:23.716765 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d09d33af-4e68-49c8-91d4-f81820bcb53c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:23.718493 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d09d33af-4e68-49c8-91d4-f81820bcb53c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:23.719763 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d09d33af-4e68-49c8-91d4-f81820bcb53c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1751 microversion: 2.20 time: 0.163160 Dec 15 12:42:23.720361 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 227/447] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:23 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:24.092606 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fd86ea67-b81d-40db-a9c5-39e77d5cb0dc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:24.094078 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fd86ea67-b81d-40db-a9c5-39e77d5cb0dc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:24.099702 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fd86ea67-b81d-40db-a9c5-39e77d5cb0dc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:24.100157 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fd86ea67-b81d-40db-a9c5-39e77d5cb0dc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:24.100950 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fd86ea67-b81d-40db-a9c5-39e77d5cb0dc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:24.101391 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fd86ea67-b81d-40db-a9c5-39e77d5cb0dc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:24.139735 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fd86ea67-b81d-40db-a9c5-39e77d5cb0dc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051306 Dec 15 12:42:24.141023 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 221/448] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:24 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:24.738406 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3647e4fb-a3f7-4ca9-8001-88e61c177141 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:24.738997 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3647e4fb-a3f7-4ca9-8001-88e61c177141 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:24.745186 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3647e4fb-a3f7-4ca9-8001-88e61c177141 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:24.745665 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3647e4fb-a3f7-4ca9-8001-88e61c177141 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:24.746425 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3647e4fb-a3f7-4ca9-8001-88e61c177141 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:24.746849 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3647e4fb-a3f7-4ca9-8001-88e61c177141 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:24.884571 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3647e4fb-a3f7-4ca9-8001-88e61c177141 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:24.893485 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3647e4fb-a3f7-4ca9-8001-88e61c177141 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:24.894996 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3647e4fb-a3f7-4ca9-8001-88e61c177141 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:24.896136 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3647e4fb-a3f7-4ca9-8001-88e61c177141 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.161441 Dec 15 12:42:24.896694 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 228/449] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:24 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:25.152013 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-010588c1-6bfa-4164-b156-61f82096fd71 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:25.152925 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-010588c1-6bfa-4164-b156-61f82096fd71 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:25.160068 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-010588c1-6bfa-4164-b156-61f82096fd71 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:25.160518 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-010588c1-6bfa-4164-b156-61f82096fd71 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:25.161305 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-010588c1-6bfa-4164-b156-61f82096fd71 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:25.161778 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-010588c1-6bfa-4164-b156-61f82096fd71 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:25.195297 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-010588c1-6bfa-4164-b156-61f82096fd71 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046965 Dec 15 12:42:25.195860 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 222/450] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:25 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:25.914865 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4602184d-754f-4208-93e7-3803f2adf6d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:25.915472 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4602184d-754f-4208-93e7-3803f2adf6d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:25.922296 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4602184d-754f-4208-93e7-3803f2adf6d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:25.922740 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4602184d-754f-4208-93e7-3803f2adf6d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:25.923517 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4602184d-754f-4208-93e7-3803f2adf6d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:25.923949 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4602184d-754f-4208-93e7-3803f2adf6d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:26.057128 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4602184d-754f-4208-93e7-3803f2adf6d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:26.066386 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4602184d-754f-4208-93e7-3803f2adf6d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:26.068172 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4602184d-754f-4208-93e7-3803f2adf6d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:26.069389 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4602184d-754f-4208-93e7-3803f2adf6d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.158209 Dec 15 12:42:26.070249 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 229/451] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:25 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:26.207403 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7a048a2f-87dc-482c-96f6-200dfe35a3e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:26.208223 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7a048a2f-87dc-482c-96f6-200dfe35a3e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:26.214936 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7a048a2f-87dc-482c-96f6-200dfe35a3e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:26.215389 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7a048a2f-87dc-482c-96f6-200dfe35a3e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:26.216189 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7a048a2f-87dc-482c-96f6-200dfe35a3e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:26.216621 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7a048a2f-87dc-482c-96f6-200dfe35a3e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:26.249795 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7a048a2f-87dc-482c-96f6-200dfe35a3e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046088 Dec 15 12:42:26.250359 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 223/452] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:26 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:27.090549 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e7aadf2b-c232-4571-9958-d14bad1a47cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:27.091088 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e7aadf2b-c232-4571-9958-d14bad1a47cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:27.098090 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e7aadf2b-c232-4571-9958-d14bad1a47cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:27.098538 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e7aadf2b-c232-4571-9958-d14bad1a47cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:27.099331 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e7aadf2b-c232-4571-9958-d14bad1a47cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:27.099763 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e7aadf2b-c232-4571-9958-d14bad1a47cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:27.244266 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e7aadf2b-c232-4571-9958-d14bad1a47cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:27.252367 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e7aadf2b-c232-4571-9958-d14bad1a47cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:27.254119 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e7aadf2b-c232-4571-9958-d14bad1a47cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:27.255255 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e7aadf2b-c232-4571-9958-d14bad1a47cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.168440 Dec 15 12:42:27.255814 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 230/453] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:27 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:27.261463 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-96a471cf-1865-469d-99e5-f0165d7212fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:27.262404 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-96a471cf-1865-469d-99e5-f0165d7212fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:27.270330 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-96a471cf-1865-469d-99e5-f0165d7212fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:27.270774 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-96a471cf-1865-469d-99e5-f0165d7212fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:27.271597 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-96a471cf-1865-469d-99e5-f0165d7212fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:27.272032 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-96a471cf-1865-469d-99e5-f0165d7212fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:27.302928 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-96a471cf-1865-469d-99e5-f0165d7212fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045087 Dec 15 12:42:27.303541 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 224/454] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:27 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:28.274706 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-66e31974-2796-47b1-a88c-80201e5ef564 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:28.275921 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-66e31974-2796-47b1-a88c-80201e5ef564 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:28.282062 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66e31974-2796-47b1-a88c-80201e5ef564 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:28.282496 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66e31974-2796-47b1-a88c-80201e5ef564 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:28.283255 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66e31974-2796-47b1-a88c-80201e5ef564 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:28.283679 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66e31974-2796-47b1-a88c-80201e5ef564 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:28.315126 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fa9e18cb-0ecf-4f36-abcc-0b2c6217ae11 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:28.316322 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fa9e18cb-0ecf-4f36-abcc-0b2c6217ae11 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:28.322749 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fa9e18cb-0ecf-4f36-abcc-0b2c6217ae11 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:28.323300 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fa9e18cb-0ecf-4f36-abcc-0b2c6217ae11 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:28.324168 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fa9e18cb-0ecf-4f36-abcc-0b2c6217ae11 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:28.324614 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fa9e18cb-0ecf-4f36-abcc-0b2c6217ae11 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:28.354449 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fa9e18cb-0ecf-4f36-abcc-0b2c6217ae11 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043799 Dec 15 12:42:28.355025 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 225/455] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:28 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:42:28.414561 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-66e31974-2796-47b1-a88c-80201e5ef564 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:28.423193 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-66e31974-2796-47b1-a88c-80201e5ef564 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:28.424672 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-66e31974-2796-47b1-a88c-80201e5ef564 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:28.425858 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-66e31974-2796-47b1-a88c-80201e5ef564 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.154879 Dec 15 12:42:28.426409 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 231/456] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:28 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:29.366790 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-647150ad-c1ae-4198-b477-b65ce3b16f54 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:29.367692 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-647150ad-c1ae-4198-b477-b65ce3b16f54 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:29.374088 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-647150ad-c1ae-4198-b477-b65ce3b16f54 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:29.375168 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-647150ad-c1ae-4198-b477-b65ce3b16f54 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:29.376024 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-647150ad-c1ae-4198-b477-b65ce3b16f54 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:29.376499 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-647150ad-c1ae-4198-b477-b65ce3b16f54 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:29.416952 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-647150ad-c1ae-4198-b477-b65ce3b16f54 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053864 Dec 15 12:42:29.417565 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 226/457] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:29 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:29.443967 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-44b9d42d-209e-413b-91fd-dee91cbd38d4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:29.444549 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-44b9d42d-209e-413b-91fd-dee91cbd38d4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:29.450797 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-44b9d42d-209e-413b-91fd-dee91cbd38d4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:29.451238 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-44b9d42d-209e-413b-91fd-dee91cbd38d4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:29.452010 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-44b9d42d-209e-413b-91fd-dee91cbd38d4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:29.453070 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-44b9d42d-209e-413b-91fd-dee91cbd38d4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:29.594771 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-44b9d42d-209e-413b-91fd-dee91cbd38d4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:29.603564 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-44b9d42d-209e-413b-91fd-dee91cbd38d4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:29.605198 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-44b9d42d-209e-413b-91fd-dee91cbd38d4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:29.606385 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-44b9d42d-209e-413b-91fd-dee91cbd38d4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.166094 Dec 15 12:42:29.606939 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 232/458] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:29 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:42:30.428876 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-22954f9c-c739-40cc-beae-4bdda4e598fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:30.429808 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-22954f9c-c739-40cc-beae-4bdda4e598fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:30.435821 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-22954f9c-c739-40cc-beae-4bdda4e598fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:30.436267 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-22954f9c-c739-40cc-beae-4bdda4e598fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:30.437703 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-22954f9c-c739-40cc-beae-4bdda4e598fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:30.438336 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-22954f9c-c739-40cc-beae-4bdda4e598fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:30.475117 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-22954f9c-c739-40cc-beae-4bdda4e598fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049921 Dec 15 12:42:30.475680 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 227/459] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:30 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:30.629351 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a21fa25e-f88d-4c39-bd1e-6a7ec881c52f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:30.630067 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a21fa25e-f88d-4c39-bd1e-6a7ec881c52f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:30.635822 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a21fa25e-f88d-4c39-bd1e-6a7ec881c52f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:30.636258 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a21fa25e-f88d-4c39-bd1e-6a7ec881c52f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:30.637023 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a21fa25e-f88d-4c39-bd1e-6a7ec881c52f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:30.637449 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a21fa25e-f88d-4c39-bd1e-6a7ec881c52f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:30.782805 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a21fa25e-f88d-4c39-bd1e-6a7ec881c52f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:30.790888 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a21fa25e-f88d-4c39-bd1e-6a7ec881c52f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:30.792358 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a21fa25e-f88d-4c39-bd1e-6a7ec881c52f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:30.793547 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a21fa25e-f88d-4c39-bd1e-6a7ec881c52f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.168944 Dec 15 12:42:30.794102 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 233/460] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:30 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:31.487760 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6c6e3ce4-8e2c-43ee-8f66-999958685adf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:31.489111 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6c6e3ce4-8e2c-43ee-8f66-999958685adf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:31.497417 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c6e3ce4-8e2c-43ee-8f66-999958685adf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:31.497925 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c6e3ce4-8e2c-43ee-8f66-999958685adf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:31.498754 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c6e3ce4-8e2c-43ee-8f66-999958685adf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:31.499689 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c6e3ce4-8e2c-43ee-8f66-999958685adf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:31.529405 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6c6e3ce4-8e2c-43ee-8f66-999958685adf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046694 Dec 15 12:42:31.530001 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 228/461] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:31 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:31.811573 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-97b76e4d-3512-4279-8228-f2ee204a9cf9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:31.812884 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-97b76e4d-3512-4279-8228-f2ee204a9cf9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:31.819231 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-97b76e4d-3512-4279-8228-f2ee204a9cf9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:31.819678 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-97b76e4d-3512-4279-8228-f2ee204a9cf9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:31.820458 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-97b76e4d-3512-4279-8228-f2ee204a9cf9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:31.820969 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-97b76e4d-3512-4279-8228-f2ee204a9cf9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:31.955791 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-97b76e4d-3512-4279-8228-f2ee204a9cf9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:31.964714 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-97b76e4d-3512-4279-8228-f2ee204a9cf9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:31.966246 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-97b76e4d-3512-4279-8228-f2ee204a9cf9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:31.967459 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-97b76e4d-3512-4279-8228-f2ee204a9cf9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.159614 Dec 15 12:42:31.968127 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 234/462] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:31 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:32.541311 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ed745189-1797-461d-b965-7853666fef63 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:32.542337 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ed745189-1797-461d-b965-7853666fef63 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:32.548825 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ed745189-1797-461d-b965-7853666fef63 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:32.549275 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ed745189-1797-461d-b965-7853666fef63 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:32.550095 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ed745189-1797-461d-b965-7853666fef63 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:32.550527 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ed745189-1797-461d-b965-7853666fef63 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:32.579420 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ed745189-1797-461d-b965-7853666fef63 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041911 Dec 15 12:42:32.579896 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 229/463] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:32 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:32.985610 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-cabbed99-576f-48fd-b55c-23cd6f216507 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:32.986221 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-cabbed99-576f-48fd-b55c-23cd6f216507 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:32.992629 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cabbed99-576f-48fd-b55c-23cd6f216507 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:32.993080 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cabbed99-576f-48fd-b55c-23cd6f216507 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:32.993867 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cabbed99-576f-48fd-b55c-23cd6f216507 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:32.994293 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cabbed99-576f-48fd-b55c-23cd6f216507 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:33.136704 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-cabbed99-576f-48fd-b55c-23cd6f216507 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:33.145658 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-cabbed99-576f-48fd-b55c-23cd6f216507 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:33.147169 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-cabbed99-576f-48fd-b55c-23cd6f216507 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:33.148321 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cabbed99-576f-48fd-b55c-23cd6f216507 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.166667 Dec 15 12:42:33.148879 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 235/464] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:32 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:33.590921 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8c476fcc-3a4e-4846-91ef-82cfbf8f14ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:33.591752 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8c476fcc-3a4e-4846-91ef-82cfbf8f14ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:33.598704 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8c476fcc-3a4e-4846-91ef-82cfbf8f14ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:33.599154 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8c476fcc-3a4e-4846-91ef-82cfbf8f14ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:33.599939 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8c476fcc-3a4e-4846-91ef-82cfbf8f14ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:33.600378 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8c476fcc-3a4e-4846-91ef-82cfbf8f14ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:33.629931 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8c476fcc-3a4e-4846-91ef-82cfbf8f14ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042724 Dec 15 12:42:33.630525 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 230/465] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:33 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:34.166333 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-51852818-3670-49e1-b926-5a3895380fe4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:34.166941 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-51852818-3670-49e1-b926-5a3895380fe4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:34.174146 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-51852818-3670-49e1-b926-5a3895380fe4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:34.174594 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-51852818-3670-49e1-b926-5a3895380fe4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:34.175374 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-51852818-3670-49e1-b926-5a3895380fe4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:34.175805 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-51852818-3670-49e1-b926-5a3895380fe4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:34.313996 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-51852818-3670-49e1-b926-5a3895380fe4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:34.322329 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-51852818-3670-49e1-b926-5a3895380fe4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:34.323814 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-51852818-3670-49e1-b926-5a3895380fe4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:34.324963 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-51852818-3670-49e1-b926-5a3895380fe4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.162340 Dec 15 12:42:34.325542 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 236/466] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:34 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:34.642252 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-20b916c4-3613-467f-9302-eb4170260e1e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:34.643081 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-20b916c4-3613-467f-9302-eb4170260e1e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:34.649327 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20b916c4-3613-467f-9302-eb4170260e1e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:34.649810 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20b916c4-3613-467f-9302-eb4170260e1e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:34.650609 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20b916c4-3613-467f-9302-eb4170260e1e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:34.651046 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20b916c4-3613-467f-9302-eb4170260e1e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:34.686736 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-20b916c4-3613-467f-9302-eb4170260e1e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048918 Dec 15 12:42:34.687718 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 231/467] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:34 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:35.342968 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9dd9882f-55ae-41ab-b40d-b8e93bea1d62 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:35.343570 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9dd9882f-55ae-41ab-b40d-b8e93bea1d62 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:35.350852 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9dd9882f-55ae-41ab-b40d-b8e93bea1d62 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:35.351298 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9dd9882f-55ae-41ab-b40d-b8e93bea1d62 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:35.352107 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9dd9882f-55ae-41ab-b40d-b8e93bea1d62 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:35.352533 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9dd9882f-55ae-41ab-b40d-b8e93bea1d62 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:35.491903 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9dd9882f-55ae-41ab-b40d-b8e93bea1d62 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:35.500378 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9dd9882f-55ae-41ab-b40d-b8e93bea1d62 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:35.502017 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9dd9882f-55ae-41ab-b40d-b8e93bea1d62 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:35.504187 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9dd9882f-55ae-41ab-b40d-b8e93bea1d62 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.163830 Dec 15 12:42:35.510172 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 237/468] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:35 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:35.698972 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d0fabb65-229f-4e35-bd49-9382c426aad2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:35.699917 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d0fabb65-229f-4e35-bd49-9382c426aad2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:35.707735 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d0fabb65-229f-4e35-bd49-9382c426aad2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:35.708185 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d0fabb65-229f-4e35-bd49-9382c426aad2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:35.708983 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d0fabb65-229f-4e35-bd49-9382c426aad2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:35.709415 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d0fabb65-229f-4e35-bd49-9382c426aad2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:35.740058 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d0fabb65-229f-4e35-bd49-9382c426aad2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044805 Dec 15 12:42:35.740608 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 232/469] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:35 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:36.523746 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-da2f9e4e-9d61-490c-a56d-60e3befb1a24 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:36.524535 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-da2f9e4e-9d61-490c-a56d-60e3befb1a24 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:36.532090 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-da2f9e4e-9d61-490c-a56d-60e3befb1a24 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:36.532726 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-da2f9e4e-9d61-490c-a56d-60e3befb1a24 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:36.533602 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-da2f9e4e-9d61-490c-a56d-60e3befb1a24 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:36.534047 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-da2f9e4e-9d61-490c-a56d-60e3befb1a24 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:36.668580 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-da2f9e4e-9d61-490c-a56d-60e3befb1a24 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:36.677674 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-da2f9e4e-9d61-490c-a56d-60e3befb1a24 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:36.679256 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-da2f9e4e-9d61-490c-a56d-60e3befb1a24 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:36.680424 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-da2f9e4e-9d61-490c-a56d-60e3befb1a24 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.161178 Dec 15 12:42:36.680981 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 238/470] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:36 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:42:36.750888 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-efab1005-5f12-43c0-8a78-59d10b3259c2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:36.751788 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-efab1005-5f12-43c0-8a78-59d10b3259c2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:36.759067 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-efab1005-5f12-43c0-8a78-59d10b3259c2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:36.759509 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-efab1005-5f12-43c0-8a78-59d10b3259c2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:36.760307 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-efab1005-5f12-43c0-8a78-59d10b3259c2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:36.760739 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-efab1005-5f12-43c0-8a78-59d10b3259c2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:36.792488 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-efab1005-5f12-43c0-8a78-59d10b3259c2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045299 Dec 15 12:42:36.793061 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 233/471] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:36 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:37.699203 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1e86bcf9-90b6-4773-9eee-7234f1143b64 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:37.699852 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1e86bcf9-90b6-4773-9eee-7234f1143b64 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:37.706722 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1e86bcf9-90b6-4773-9eee-7234f1143b64 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:37.707171 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1e86bcf9-90b6-4773-9eee-7234f1143b64 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:37.707977 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1e86bcf9-90b6-4773-9eee-7234f1143b64 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:37.708389 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1e86bcf9-90b6-4773-9eee-7234f1143b64 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:37.806605 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-03f64e61-d34c-4e88-9e58-a1de07beebf2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:37.807680 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-03f64e61-d34c-4e88-9e58-a1de07beebf2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:37.814622 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-03f64e61-d34c-4e88-9e58-a1de07beebf2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:37.815443 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-03f64e61-d34c-4e88-9e58-a1de07beebf2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:37.816260 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-03f64e61-d34c-4e88-9e58-a1de07beebf2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:37.816917 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-03f64e61-d34c-4e88-9e58-a1de07beebf2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:37.843564 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1e86bcf9-90b6-4773-9eee-7234f1143b64 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:37.848687 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-03f64e61-d34c-4e88-9e58-a1de07beebf2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046668 Dec 15 12:42:37.849337 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 234/472] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:37 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:42:37.852993 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1e86bcf9-90b6-4773-9eee-7234f1143b64 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:37.854499 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1e86bcf9-90b6-4773-9eee-7234f1143b64 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:37.855653 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1e86bcf9-90b6-4773-9eee-7234f1143b64 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.160373 Dec 15 12:42:37.856200 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 239/473] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:37 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:38.860193 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-17ddc14b-70ba-4255-a573-8b3c0645c88b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:38.861100 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-17ddc14b-70ba-4255-a573-8b3c0645c88b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:38.867360 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-17ddc14b-70ba-4255-a573-8b3c0645c88b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:38.867812 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-17ddc14b-70ba-4255-a573-8b3c0645c88b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:38.868630 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-17ddc14b-70ba-4255-a573-8b3c0645c88b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:38.869068 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-17ddc14b-70ba-4255-a573-8b3c0645c88b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:38.874224 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-509af30a-ae9d-49be-9139-f2d564866f0a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:38.875744 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-509af30a-ae9d-49be-9139-f2d564866f0a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:38.882080 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-509af30a-ae9d-49be-9139-f2d564866f0a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:38.882523 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-509af30a-ae9d-49be-9139-f2d564866f0a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:38.883290 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-509af30a-ae9d-49be-9139-f2d564866f0a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:38.883714 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-509af30a-ae9d-49be-9139-f2d564866f0a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:38.900324 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-17ddc14b-70ba-4255-a573-8b3c0645c88b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043810 Dec 15 12:42:38.900910 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 235/474] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:38 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:39.025915 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-509af30a-ae9d-49be-9139-f2d564866f0a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:39.038230 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-509af30a-ae9d-49be-9139-f2d564866f0a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:39.040501 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-509af30a-ae9d-49be-9139-f2d564866f0a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:39.042334 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-509af30a-ae9d-49be-9139-f2d564866f0a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.171466 Dec 15 12:42:39.042913 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 240/475] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:38 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:42:39.912994 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e4c60249-0907-472f-b92e-ee2105cbbb19 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:39.913931 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e4c60249-0907-472f-b92e-ee2105cbbb19 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:39.920118 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e4c60249-0907-472f-b92e-ee2105cbbb19 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:39.920568 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e4c60249-0907-472f-b92e-ee2105cbbb19 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:39.921353 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e4c60249-0907-472f-b92e-ee2105cbbb19 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:39.921827 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e4c60249-0907-472f-b92e-ee2105cbbb19 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:39.952483 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e4c60249-0907-472f-b92e-ee2105cbbb19 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042985 Dec 15 12:42:39.953692 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 236/476] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:39 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:40.064045 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6de1dc1b-149b-4033-9ebf-9a458b8f1d19 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:40.064658 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6de1dc1b-149b-4033-9ebf-9a458b8f1d19 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:40.071116 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6de1dc1b-149b-4033-9ebf-9a458b8f1d19 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:40.071557 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6de1dc1b-149b-4033-9ebf-9a458b8f1d19 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:40.072358 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6de1dc1b-149b-4033-9ebf-9a458b8f1d19 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:40.072784 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6de1dc1b-149b-4033-9ebf-9a458b8f1d19 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:40.212149 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6de1dc1b-149b-4033-9ebf-9a458b8f1d19 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:40.221209 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6de1dc1b-149b-4033-9ebf-9a458b8f1d19 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:40.222731 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6de1dc1b-149b-4033-9ebf-9a458b8f1d19 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:40.223878 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6de1dc1b-149b-4033-9ebf-9a458b8f1d19 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.163511 Dec 15 12:42:40.224437 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 241/477] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:40 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:40.964662 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2a45c7e8-18a3-4489-9d55-a385a03c7bc7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:40.965611 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2a45c7e8-18a3-4489-9d55-a385a03c7bc7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:40.972556 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2a45c7e8-18a3-4489-9d55-a385a03c7bc7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:40.980596 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2a45c7e8-18a3-4489-9d55-a385a03c7bc7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:40.980596 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2a45c7e8-18a3-4489-9d55-a385a03c7bc7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:40.980596 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2a45c7e8-18a3-4489-9d55-a385a03c7bc7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:41.004357 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2a45c7e8-18a3-4489-9d55-a385a03c7bc7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043452 Dec 15 12:42:41.004910 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 237/478] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:40 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:41.241715 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-561ca0f5-2103-460f-895d-fc5ee7ede5fa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:41.242254 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-561ca0f5-2103-460f-895d-fc5ee7ede5fa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:41.249130 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-561ca0f5-2103-460f-895d-fc5ee7ede5fa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:41.249601 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-561ca0f5-2103-460f-895d-fc5ee7ede5fa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:41.251112 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-561ca0f5-2103-460f-895d-fc5ee7ede5fa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:41.251725 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-561ca0f5-2103-460f-895d-fc5ee7ede5fa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:41.385803 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-561ca0f5-2103-460f-895d-fc5ee7ede5fa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:41.395135 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-561ca0f5-2103-460f-895d-fc5ee7ede5fa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:41.396619 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-561ca0f5-2103-460f-895d-fc5ee7ede5fa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:41.397879 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-561ca0f5-2103-460f-895d-fc5ee7ede5fa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.160011 Dec 15 12:42:41.398460 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 242/479] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:41 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:42.015867 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-29ef96b4-5e12-46db-b436-856ba34d129b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:42.016812 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-29ef96b4-5e12-46db-b436-856ba34d129b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:42.023711 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-29ef96b4-5e12-46db-b436-856ba34d129b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:42.024080 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-29ef96b4-5e12-46db-b436-856ba34d129b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:42.024908 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-29ef96b4-5e12-46db-b436-856ba34d129b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:42.025344 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-29ef96b4-5e12-46db-b436-856ba34d129b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:42.054931 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-29ef96b4-5e12-46db-b436-856ba34d129b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042835 Dec 15 12:42:42.055485 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 238/480] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:42 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:42.416000 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ed59cb9e-0f09-45da-8265-cf912c8b45f9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:42.416602 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ed59cb9e-0f09-45da-8265-cf912c8b45f9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:42.423070 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ed59cb9e-0f09-45da-8265-cf912c8b45f9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:42.423507 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ed59cb9e-0f09-45da-8265-cf912c8b45f9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:42.424273 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ed59cb9e-0f09-45da-8265-cf912c8b45f9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:42.424700 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ed59cb9e-0f09-45da-8265-cf912c8b45f9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:42.566267 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ed59cb9e-0f09-45da-8265-cf912c8b45f9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:42.575296 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ed59cb9e-0f09-45da-8265-cf912c8b45f9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:42.576828 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ed59cb9e-0f09-45da-8265-cf912c8b45f9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:42.578845 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ed59cb9e-0f09-45da-8265-cf912c8b45f9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.165816 Dec 15 12:42:42.579574 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 243/481] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:42 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:43.066579 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fe434133-2770-485b-900c-4a581278ab82 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:43.067496 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fe434133-2770-485b-900c-4a581278ab82 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:43.074015 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe434133-2770-485b-900c-4a581278ab82 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:43.074408 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe434133-2770-485b-900c-4a581278ab82 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:43.075199 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe434133-2770-485b-900c-4a581278ab82 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:43.075637 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe434133-2770-485b-900c-4a581278ab82 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:43.104946 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fe434133-2770-485b-900c-4a581278ab82 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042241 Dec 15 12:42:43.105554 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 239/482] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:43 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:43.606281 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3c48c328-45df-402f-a903-2581a126e833 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:43.606875 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3c48c328-45df-402f-a903-2581a126e833 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:43.613129 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c48c328-45df-402f-a903-2581a126e833 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:43.613600 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c48c328-45df-402f-a903-2581a126e833 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:43.614364 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c48c328-45df-402f-a903-2581a126e833 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:43.614784 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c48c328-45df-402f-a903-2581a126e833 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:43.761340 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3c48c328-45df-402f-a903-2581a126e833 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:43.769527 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3c48c328-45df-402f-a903-2581a126e833 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:43.778932 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3c48c328-45df-402f-a903-2581a126e833 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:43.778932 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3c48c328-45df-402f-a903-2581a126e833 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.169567 Dec 15 12:42:43.778932 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 244/483] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:43 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:44.116580 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-271ac728-3e6c-42aa-af4e-58043563c1d1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:44.117419 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-271ac728-3e6c-42aa-af4e-58043563c1d1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:44.123677 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-271ac728-3e6c-42aa-af4e-58043563c1d1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:44.124117 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-271ac728-3e6c-42aa-af4e-58043563c1d1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:44.124888 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-271ac728-3e6c-42aa-af4e-58043563c1d1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:44.126256 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-271ac728-3e6c-42aa-af4e-58043563c1d1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:44.157238 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-271ac728-3e6c-42aa-af4e-58043563c1d1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044289 Dec 15 12:42:44.157877 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 240/484] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:44 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:44.790577 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-234665ed-ca4c-43bf-9121-ddb1c003a074 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:44.791192 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-234665ed-ca4c-43bf-9121-ddb1c003a074 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:44.798214 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-234665ed-ca4c-43bf-9121-ddb1c003a074 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:44.798711 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-234665ed-ca4c-43bf-9121-ddb1c003a074 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:44.799496 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-234665ed-ca4c-43bf-9121-ddb1c003a074 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:44.799913 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-234665ed-ca4c-43bf-9121-ddb1c003a074 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:44.946590 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-234665ed-ca4c-43bf-9121-ddb1c003a074 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:44.956073 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-234665ed-ca4c-43bf-9121-ddb1c003a074 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:44.958146 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-234665ed-ca4c-43bf-9121-ddb1c003a074 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:44.959325 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-234665ed-ca4c-43bf-9121-ddb1c003a074 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.172446 Dec 15 12:42:44.959898 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 245/485] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:44 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:45.168789 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6f8c3f10-579b-43eb-9e5f-6e2850bdec59 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:45.169757 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6f8c3f10-579b-43eb-9e5f-6e2850bdec59 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:45.176987 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6f8c3f10-579b-43eb-9e5f-6e2850bdec59 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:45.177443 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6f8c3f10-579b-43eb-9e5f-6e2850bdec59 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:45.178279 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6f8c3f10-579b-43eb-9e5f-6e2850bdec59 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:45.178718 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6f8c3f10-579b-43eb-9e5f-6e2850bdec59 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:45.215231 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6f8c3f10-579b-43eb-9e5f-6e2850bdec59 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050134 Dec 15 12:42:45.215818 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 241/486] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:45 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:45.977982 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-03e91465-dacf-4280-9a42-9983076217bd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:45.978592 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-03e91465-dacf-4280-9a42-9983076217bd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:45.989760 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-03e91465-dacf-4280-9a42-9983076217bd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:45.989760 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-03e91465-dacf-4280-9a42-9983076217bd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:45.989760 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-03e91465-dacf-4280-9a42-9983076217bd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:45.989760 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-03e91465-dacf-4280-9a42-9983076217bd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:46.119669 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-03e91465-dacf-4280-9a42-9983076217bd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:46.129072 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-03e91465-dacf-4280-9a42-9983076217bd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:46.130587 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-03e91465-dacf-4280-9a42-9983076217bd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:46.131732 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-03e91465-dacf-4280-9a42-9983076217bd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.157362 Dec 15 12:42:46.132281 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 246/487] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:45 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:46.227633 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-20359713-3014-4412-924c-9785b1e2102a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:46.228448 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-20359713-3014-4412-924c-9785b1e2102a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:46.235158 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20359713-3014-4412-924c-9785b1e2102a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:46.235596 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20359713-3014-4412-924c-9785b1e2102a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:46.236362 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20359713-3014-4412-924c-9785b1e2102a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:46.236789 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20359713-3014-4412-924c-9785b1e2102a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:46.267571 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-20359713-3014-4412-924c-9785b1e2102a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043738 Dec 15 12:42:46.268133 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 242/488] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:46 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:47.150049 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b5087a14-9bf3-45ec-8747-760103f94a8c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:47.150650 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b5087a14-9bf3-45ec-8747-760103f94a8c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:47.156948 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b5087a14-9bf3-45ec-8747-760103f94a8c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:47.157385 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b5087a14-9bf3-45ec-8747-760103f94a8c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:47.158179 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b5087a14-9bf3-45ec-8747-760103f94a8c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:47.158606 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b5087a14-9bf3-45ec-8747-760103f94a8c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:47.278916 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9e5f8d20-bf4a-4359-a0be-c7dc0bc13ad2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:47.279897 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9e5f8d20-bf4a-4359-a0be-c7dc0bc13ad2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:47.286383 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9e5f8d20-bf4a-4359-a0be-c7dc0bc13ad2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:47.286837 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9e5f8d20-bf4a-4359-a0be-c7dc0bc13ad2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:47.287657 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9e5f8d20-bf4a-4359-a0be-c7dc0bc13ad2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:47.288090 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9e5f8d20-bf4a-4359-a0be-c7dc0bc13ad2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:47.293879 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b5087a14-9bf3-45ec-8747-760103f94a8c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:47.302456 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b5087a14-9bf3-45ec-8747-760103f94a8c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:47.303960 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b5087a14-9bf3-45ec-8747-760103f94a8c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:47.305115 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b5087a14-9bf3-45ec-8747-760103f94a8c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.158741 Dec 15 12:42:47.305896 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 247/489] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:47 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:47.319663 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9e5f8d20-bf4a-4359-a0be-c7dc0bc13ad2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044548 Dec 15 12:42:47.320228 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 243/490] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:47 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:42:48.323835 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-47908b84-884e-41b5-aaa7-370b27636237 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:48.325931 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-47908b84-884e-41b5-aaa7-370b27636237 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:48.331659 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d67819fb-9108-4a9b-bee4-c43e725e24f1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:48.332591 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d67819fb-9108-4a9b-bee4-c43e725e24f1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:48.338683 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-47908b84-884e-41b5-aaa7-370b27636237 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:48.338930 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d67819fb-9108-4a9b-bee4-c43e725e24f1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:48.339131 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-47908b84-884e-41b5-aaa7-370b27636237 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:48.339383 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d67819fb-9108-4a9b-bee4-c43e725e24f1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:48.339924 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-47908b84-884e-41b5-aaa7-370b27636237 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:48.340164 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d67819fb-9108-4a9b-bee4-c43e725e24f1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:48.340359 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-47908b84-884e-41b5-aaa7-370b27636237 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:48.340596 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d67819fb-9108-4a9b-bee4-c43e725e24f1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:48.371146 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d67819fb-9108-4a9b-bee4-c43e725e24f1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043843 Dec 15 12:42:48.371724 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 244/491] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:48 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:48.473787 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-47908b84-884e-41b5-aaa7-370b27636237 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:48.483154 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-47908b84-884e-41b5-aaa7-370b27636237 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:48.485524 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-47908b84-884e-41b5-aaa7-370b27636237 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:48.487567 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-47908b84-884e-41b5-aaa7-370b27636237 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.167037 Dec 15 12:42:48.488476 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 248/492] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:48 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:49.383056 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d4811142-6e93-4006-a879-3cd7e1892081 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:49.384006 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d4811142-6e93-4006-a879-3cd7e1892081 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:49.391520 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d4811142-6e93-4006-a879-3cd7e1892081 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:49.391978 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d4811142-6e93-4006-a879-3cd7e1892081 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:49.392777 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d4811142-6e93-4006-a879-3cd7e1892081 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:49.393217 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d4811142-6e93-4006-a879-3cd7e1892081 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:49.425727 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d4811142-6e93-4006-a879-3cd7e1892081 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046370 Dec 15 12:42:49.426307 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 245/493] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:49 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:49.506220 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9ec66445-50f1-4c11-9b41-58527c359580 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:49.506852 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9ec66445-50f1-4c11-9b41-58527c359580 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:49.513127 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9ec66445-50f1-4c11-9b41-58527c359580 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:49.513604 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9ec66445-50f1-4c11-9b41-58527c359580 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:49.514384 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9ec66445-50f1-4c11-9b41-58527c359580 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:49.514819 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9ec66445-50f1-4c11-9b41-58527c359580 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:49.657452 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9ec66445-50f1-4c11-9b41-58527c359580 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:49.665877 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9ec66445-50f1-4c11-9b41-58527c359580 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:49.667378 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9ec66445-50f1-4c11-9b41-58527c359580 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:49.668542 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9ec66445-50f1-4c11-9b41-58527c359580 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.166245 Dec 15 12:42:49.669102 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 249/494] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:49 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:50.437106 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0f150924-cf86-4541-991d-2b96080c0c53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:50.438587 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0f150924-cf86-4541-991d-2b96080c0c53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:50.444738 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0f150924-cf86-4541-991d-2b96080c0c53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:50.445179 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0f150924-cf86-4541-991d-2b96080c0c53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:50.445971 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0f150924-cf86-4541-991d-2b96080c0c53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:50.446402 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0f150924-cf86-4541-991d-2b96080c0c53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:50.475512 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0f150924-cf86-4541-991d-2b96080c0c53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042115 Dec 15 12:42:50.476088 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 246/495] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:50 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:50.687550 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7028af8c-4442-4517-b13b-3c8d06c28a95 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:50.688717 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7028af8c-4442-4517-b13b-3c8d06c28a95 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:50.695062 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7028af8c-4442-4517-b13b-3c8d06c28a95 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:50.695504 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7028af8c-4442-4517-b13b-3c8d06c28a95 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:50.696281 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7028af8c-4442-4517-b13b-3c8d06c28a95 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:50.696712 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7028af8c-4442-4517-b13b-3c8d06c28a95 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:50.826090 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7028af8c-4442-4517-b13b-3c8d06c28a95 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:50.835009 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7028af8c-4442-4517-b13b-3c8d06c28a95 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:50.836515 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7028af8c-4442-4517-b13b-3c8d06c28a95 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:50.837790 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7028af8c-4442-4517-b13b-3c8d06c28a95 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.154171 Dec 15 12:42:50.838362 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 250/496] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:50 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:51.486547 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-20d3fd17-d6ba-4f09-8bfb-0a491316c16b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:51.487370 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-20d3fd17-d6ba-4f09-8bfb-0a491316c16b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:51.493779 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20d3fd17-d6ba-4f09-8bfb-0a491316c16b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:51.494230 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20d3fd17-d6ba-4f09-8bfb-0a491316c16b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:51.495011 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20d3fd17-d6ba-4f09-8bfb-0a491316c16b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:51.495446 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20d3fd17-d6ba-4f09-8bfb-0a491316c16b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:51.529218 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-20d3fd17-d6ba-4f09-8bfb-0a491316c16b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046444 Dec 15 12:42:51.529799 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 247/497] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:51 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:51.856166 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5f92f563-2dfd-44c5-b3c6-20052d36dd5b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:51.856702 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5f92f563-2dfd-44c5-b3c6-20052d36dd5b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:51.862984 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5f92f563-2dfd-44c5-b3c6-20052d36dd5b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:51.863422 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5f92f563-2dfd-44c5-b3c6-20052d36dd5b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:51.864189 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5f92f563-2dfd-44c5-b3c6-20052d36dd5b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:51.864614 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5f92f563-2dfd-44c5-b3c6-20052d36dd5b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:52.008327 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5f92f563-2dfd-44c5-b3c6-20052d36dd5b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:52.017368 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5f92f563-2dfd-44c5-b3c6-20052d36dd5b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:52.018896 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5f92f563-2dfd-44c5-b3c6-20052d36dd5b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:52.020062 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5f92f563-2dfd-44c5-b3c6-20052d36dd5b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.167672 Dec 15 12:42:52.020617 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 251/498] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:51 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:52.540597 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-eba99c60-2cd0-4bd4-878b-568f4e913ff1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:52.541408 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-eba99c60-2cd0-4bd4-878b-568f4e913ff1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:52.548316 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eba99c60-2cd0-4bd4-878b-568f4e913ff1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:52.548841 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eba99c60-2cd0-4bd4-878b-568f4e913ff1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:52.549748 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eba99c60-2cd0-4bd4-878b-568f4e913ff1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:52.550212 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eba99c60-2cd0-4bd4-878b-568f4e913ff1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:52.580151 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-eba99c60-2cd0-4bd4-878b-568f4e913ff1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043312 Dec 15 12:42:52.580700 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 248/499] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:52 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:53.038741 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-37f7600e-988b-4094-8639-481b44e21c7a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:53.039347 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-37f7600e-988b-4094-8639-481b44e21c7a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:53.046032 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-37f7600e-988b-4094-8639-481b44e21c7a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:53.046477 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-37f7600e-988b-4094-8639-481b44e21c7a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:53.047263 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-37f7600e-988b-4094-8639-481b44e21c7a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:53.047884 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-37f7600e-988b-4094-8639-481b44e21c7a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:53.189901 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-37f7600e-988b-4094-8639-481b44e21c7a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:53.198172 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-37f7600e-988b-4094-8639-481b44e21c7a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:53.199647 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-37f7600e-988b-4094-8639-481b44e21c7a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:53.200780 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-37f7600e-988b-4094-8639-481b44e21c7a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.165746 Dec 15 12:42:53.201333 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 252/500] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:53 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:53.590800 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-58eb9aad-f02d-452a-8633-b848f1d692cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:53.591666 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-58eb9aad-f02d-452a-8633-b848f1d692cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:53.598188 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-58eb9aad-f02d-452a-8633-b848f1d692cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:53.598638 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-58eb9aad-f02d-452a-8633-b848f1d692cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:53.599441 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-58eb9aad-f02d-452a-8633-b848f1d692cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:53.599884 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-58eb9aad-f02d-452a-8633-b848f1d692cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:53.630951 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-58eb9aad-f02d-452a-8633-b848f1d692cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043947 Dec 15 12:42:53.631510 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 249/501] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:53 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:54.220429 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e3528e2c-2d8c-431b-886d-eb4126bc3a56 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:54.221181 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e3528e2c-2d8c-431b-886d-eb4126bc3a56 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:54.228426 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e3528e2c-2d8c-431b-886d-eb4126bc3a56 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:54.228865 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e3528e2c-2d8c-431b-886d-eb4126bc3a56 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:54.229725 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e3528e2c-2d8c-431b-886d-eb4126bc3a56 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:54.230160 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e3528e2c-2d8c-431b-886d-eb4126bc3a56 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:54.364478 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e3528e2c-2d8c-431b-886d-eb4126bc3a56 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:54.372556 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e3528e2c-2d8c-431b-886d-eb4126bc3a56 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:54.374092 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e3528e2c-2d8c-431b-886d-eb4126bc3a56 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:54.375244 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e3528e2c-2d8c-431b-886d-eb4126bc3a56 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.159270 Dec 15 12:42:54.375961 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 253/502] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:54 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:54.643421 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5ae3db93-1c2b-45f3-928e-c013da9aa326 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:54.644364 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5ae3db93-1c2b-45f3-928e-c013da9aa326 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:54.651010 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5ae3db93-1c2b-45f3-928e-c013da9aa326 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:54.651455 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5ae3db93-1c2b-45f3-928e-c013da9aa326 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:54.652256 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5ae3db93-1c2b-45f3-928e-c013da9aa326 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:54.652693 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5ae3db93-1c2b-45f3-928e-c013da9aa326 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:54.681172 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5ae3db93-1c2b-45f3-928e-c013da9aa326 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042547 Dec 15 12:42:54.681778 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 250/503] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:54 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:55.401083 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-27b3c617-6adc-432e-b76e-91595d19af9c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:55.401728 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-27b3c617-6adc-432e-b76e-91595d19af9c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:55.409809 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-27b3c617-6adc-432e-b76e-91595d19af9c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:55.410267 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-27b3c617-6adc-432e-b76e-91595d19af9c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:55.411126 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-27b3c617-6adc-432e-b76e-91595d19af9c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:55.411560 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-27b3c617-6adc-432e-b76e-91595d19af9c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:55.554157 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-27b3c617-6adc-432e-b76e-91595d19af9c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:55.562283 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-27b3c617-6adc-432e-b76e-91595d19af9c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:55.564015 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-27b3c617-6adc-432e-b76e-91595d19af9c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:55.565161 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-27b3c617-6adc-432e-b76e-91595d19af9c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.167727 Dec 15 12:42:55.565756 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 254/504] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:55 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:55.692240 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0e052048-0f40-4874-b00f-c7e9214383a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:55.693174 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0e052048-0f40-4874-b00f-c7e9214383a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:55.699631 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0e052048-0f40-4874-b00f-c7e9214383a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:55.700097 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0e052048-0f40-4874-b00f-c7e9214383a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:55.700913 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0e052048-0f40-4874-b00f-c7e9214383a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:55.701339 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0e052048-0f40-4874-b00f-c7e9214383a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:55.731645 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0e052048-0f40-4874-b00f-c7e9214383a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043109 Dec 15 12:42:55.732222 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 251/505] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:55 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:56.583339 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b8dd9fca-4185-402d-9de0-8dd7863389e9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:56.583910 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b8dd9fca-4185-402d-9de0-8dd7863389e9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:56.590224 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b8dd9fca-4185-402d-9de0-8dd7863389e9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:56.590675 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b8dd9fca-4185-402d-9de0-8dd7863389e9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:56.591448 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b8dd9fca-4185-402d-9de0-8dd7863389e9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:56.591880 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b8dd9fca-4185-402d-9de0-8dd7863389e9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:56.734512 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b8dd9fca-4185-402d-9de0-8dd7863389e9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:56.742953 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1ed54044-9be8-471c-b7ba-e3cbed44aeb4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:56.743816 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b8dd9fca-4185-402d-9de0-8dd7863389e9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:56.743945 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1ed54044-9be8-471c-b7ba-e3cbed44aeb4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:56.745309 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b8dd9fca-4185-402d-9de0-8dd7863389e9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:56.746537 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b8dd9fca-4185-402d-9de0-8dd7863389e9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.167008 Dec 15 12:42:56.747093 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 255/506] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:56 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:56.749970 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ed54044-9be8-471c-b7ba-e3cbed44aeb4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:56.750421 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ed54044-9be8-471c-b7ba-e3cbed44aeb4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:56.751818 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ed54044-9be8-471c-b7ba-e3cbed44aeb4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:56.752275 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ed54044-9be8-471c-b7ba-e3cbed44aeb4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:56.783277 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1ed54044-9be8-471c-b7ba-e3cbed44aeb4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043895 Dec 15 12:42:56.783847 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 252/507] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:56 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:42:57.765873 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9b1171b7-c32e-484a-8df1-e65e5ee0093d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:57.766897 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9b1171b7-c32e-484a-8df1-e65e5ee0093d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:57.772981 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9b1171b7-c32e-484a-8df1-e65e5ee0093d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:57.773422 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9b1171b7-c32e-484a-8df1-e65e5ee0093d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:57.774254 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9b1171b7-c32e-484a-8df1-e65e5ee0093d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:57.774678 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9b1171b7-c32e-484a-8df1-e65e5ee0093d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:57.794556 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-524677b2-131f-4fe7-88ab-cba1ceaaed2f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:57.795497 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-524677b2-131f-4fe7-88ab-cba1ceaaed2f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:57.802826 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-524677b2-131f-4fe7-88ab-cba1ceaaed2f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:57.803274 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-524677b2-131f-4fe7-88ab-cba1ceaaed2f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:57.804063 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-524677b2-131f-4fe7-88ab-cba1ceaaed2f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:57.804498 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-524677b2-131f-4fe7-88ab-cba1ceaaed2f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:57.835650 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-524677b2-131f-4fe7-88ab-cba1ceaaed2f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044784 Dec 15 12:42:57.836220 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 253/508] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:57 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:42:57.906466 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9b1171b7-c32e-484a-8df1-e65e5ee0093d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:57.915503 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9b1171b7-c32e-484a-8df1-e65e5ee0093d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:57.916964 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9b1171b7-c32e-484a-8df1-e65e5ee0093d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:57.918135 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9b1171b7-c32e-484a-8df1-e65e5ee0093d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.156263 Dec 15 12:42:57.918691 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 256/509] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:57 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:58.847865 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fa084919-2a16-4406-b192-2b848a82cd12 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:58.848801 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fa084919-2a16-4406-b192-2b848a82cd12 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:58.854996 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fa084919-2a16-4406-b192-2b848a82cd12 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:58.855465 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fa084919-2a16-4406-b192-2b848a82cd12 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:58.856243 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fa084919-2a16-4406-b192-2b848a82cd12 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:58.863576 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fa084919-2a16-4406-b192-2b848a82cd12 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:58.892863 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fa084919-2a16-4406-b192-2b848a82cd12 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049509 Dec 15 12:42:58.893427 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 254/510] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:58 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:42:58.936629 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c0544fff-11a8-446c-a8d2-36217bb2c74e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:58.937274 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c0544fff-11a8-446c-a8d2-36217bb2c74e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:58.943474 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c0544fff-11a8-446c-a8d2-36217bb2c74e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:58.943922 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c0544fff-11a8-446c-a8d2-36217bb2c74e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:58.944700 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c0544fff-11a8-446c-a8d2-36217bb2c74e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:58.945134 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c0544fff-11a8-446c-a8d2-36217bb2c74e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:59.090678 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c0544fff-11a8-446c-a8d2-36217bb2c74e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:59.098972 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c0544fff-11a8-446c-a8d2-36217bb2c74e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:59.100411 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c0544fff-11a8-446c-a8d2-36217bb2c74e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:42:59.101571 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c0544fff-11a8-446c-a8d2-36217bb2c74e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.168687 Dec 15 12:42:59.102125 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 257/511] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:42:58 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:42:59.904577 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-be6ae50f-8f4d-4361-900f-971ac867be53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:42:59.905491 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-be6ae50f-8f4d-4361-900f-971ac867be53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:42:59.911614 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-be6ae50f-8f4d-4361-900f-971ac867be53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:59.912065 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-be6ae50f-8f4d-4361-900f-971ac867be53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:59.912849 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-be6ae50f-8f4d-4361-900f-971ac867be53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:42:59.913288 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-be6ae50f-8f4d-4361-900f-971ac867be53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:42:59.943102 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-be6ae50f-8f4d-4361-900f-971ac867be53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042605 Dec 15 12:42:59.943669 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 255/512] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:42:59 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:00.120369 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7d27ae1c-2d75-462b-8d0e-4c8813785b46 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:00.120972 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7d27ae1c-2d75-462b-8d0e-4c8813785b46 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:00.127960 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7d27ae1c-2d75-462b-8d0e-4c8813785b46 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:00.128669 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7d27ae1c-2d75-462b-8d0e-4c8813785b46 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:00.129439 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7d27ae1c-2d75-462b-8d0e-4c8813785b46 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:00.129896 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7d27ae1c-2d75-462b-8d0e-4c8813785b46 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:00.261310 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7d27ae1c-2d75-462b-8d0e-4c8813785b46 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:00.270843 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7d27ae1c-2d75-462b-8d0e-4c8813785b46 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:00.272324 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7d27ae1c-2d75-462b-8d0e-4c8813785b46 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:00.273480 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7d27ae1c-2d75-462b-8d0e-4c8813785b46 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.157357 Dec 15 12:43:00.274066 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 258/513] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:00 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:00.956419 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9a212f83-7b1b-4b99-9a3d-08d078c209d4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:00.957616 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9a212f83-7b1b-4b99-9a3d-08d078c209d4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:00.963861 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9a212f83-7b1b-4b99-9a3d-08d078c209d4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:00.964302 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9a212f83-7b1b-4b99-9a3d-08d078c209d4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:00.965072 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9a212f83-7b1b-4b99-9a3d-08d078c209d4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:00.965498 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9a212f83-7b1b-4b99-9a3d-08d078c209d4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:00.995348 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9a212f83-7b1b-4b99-9a3d-08d078c209d4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044301 Dec 15 12:43:00.995976 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 256/514] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:00 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:43:01.291641 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d4a43494-ab51-46c3-9467-085d0a33cc2d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:01.292166 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d4a43494-ab51-46c3-9467-085d0a33cc2d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:01.298562 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d4a43494-ab51-46c3-9467-085d0a33cc2d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:01.299001 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d4a43494-ab51-46c3-9467-085d0a33cc2d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:01.299773 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d4a43494-ab51-46c3-9467-085d0a33cc2d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:01.300599 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d4a43494-ab51-46c3-9467-085d0a33cc2d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:01.436765 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d4a43494-ab51-46c3-9467-085d0a33cc2d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:01.445549 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d4a43494-ab51-46c3-9467-085d0a33cc2d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:01.447041 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d4a43494-ab51-46c3-9467-085d0a33cc2d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:01.448225 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d4a43494-ab51-46c3-9467-085d0a33cc2d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.160325 Dec 15 12:43:01.448786 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 259/515] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:01 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:02.007566 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-01cb01f4-e9c3-4681-ae5c-8355e9995da1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:02.008476 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-01cb01f4-e9c3-4681-ae5c-8355e9995da1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:02.014682 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-01cb01f4-e9c3-4681-ae5c-8355e9995da1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:02.015128 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-01cb01f4-e9c3-4681-ae5c-8355e9995da1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:02.015946 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-01cb01f4-e9c3-4681-ae5c-8355e9995da1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:02.016483 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-01cb01f4-e9c3-4681-ae5c-8355e9995da1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:02.046927 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-01cb01f4-e9c3-4681-ae5c-8355e9995da1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043370 Dec 15 12:43:02.048112 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 257/516] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:02 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:02.474945 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7a432c96-a3a3-4f3f-94c4-570ce3280a50 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:02.475622 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7a432c96-a3a3-4f3f-94c4-570ce3280a50 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:02.482258 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7a432c96-a3a3-4f3f-94c4-570ce3280a50 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:02.482709 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7a432c96-a3a3-4f3f-94c4-570ce3280a50 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:02.483496 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7a432c96-a3a3-4f3f-94c4-570ce3280a50 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:02.483933 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7a432c96-a3a3-4f3f-94c4-570ce3280a50 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:02.619583 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7a432c96-a3a3-4f3f-94c4-570ce3280a50 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:02.627695 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7a432c96-a3a3-4f3f-94c4-570ce3280a50 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:02.629430 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7a432c96-a3a3-4f3f-94c4-570ce3280a50 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:02.630608 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7a432c96-a3a3-4f3f-94c4-570ce3280a50 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.159475 Dec 15 12:43:02.631165 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 260/517] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:02 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:03.059067 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-91a27068-4e56-4d24-9862-d547417551f7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:03.059972 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-91a27068-4e56-4d24-9862-d547417551f7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:03.066314 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-91a27068-4e56-4d24-9862-d547417551f7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:03.066766 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-91a27068-4e56-4d24-9862-d547417551f7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:03.067550 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-91a27068-4e56-4d24-9862-d547417551f7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:03.067990 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-91a27068-4e56-4d24-9862-d547417551f7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:03.105341 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-91a27068-4e56-4d24-9862-d547417551f7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049929 Dec 15 12:43:03.105951 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 258/518] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:03 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:03.652180 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9902e5f5-28a4-418b-943f-a1a257ad0832 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:03.652863 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9902e5f5-28a4-418b-943f-a1a257ad0832 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:03.659492 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9902e5f5-28a4-418b-943f-a1a257ad0832 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:03.659964 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9902e5f5-28a4-418b-943f-a1a257ad0832 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:03.660823 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9902e5f5-28a4-418b-943f-a1a257ad0832 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:03.661298 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9902e5f5-28a4-418b-943f-a1a257ad0832 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:03.803640 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9902e5f5-28a4-418b-943f-a1a257ad0832 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:03.812408 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9902e5f5-28a4-418b-943f-a1a257ad0832 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:03.814624 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9902e5f5-28a4-418b-943f-a1a257ad0832 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:03.815805 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9902e5f5-28a4-418b-943f-a1a257ad0832 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.170640 Dec 15 12:43:03.816384 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 261/519] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:03 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:04.116884 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-30c1be2c-9cc0-4aa3-8ec6-17e887bc4aa6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:04.117785 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-30c1be2c-9cc0-4aa3-8ec6-17e887bc4aa6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:04.124392 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-30c1be2c-9cc0-4aa3-8ec6-17e887bc4aa6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:04.124840 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-30c1be2c-9cc0-4aa3-8ec6-17e887bc4aa6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:04.126281 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-30c1be2c-9cc0-4aa3-8ec6-17e887bc4aa6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:04.126919 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-30c1be2c-9cc0-4aa3-8ec6-17e887bc4aa6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:04.152062 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 12:43:04.153092 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 12:43:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments (ip 10.222.0.76) !!! Dec 15 12:43:04.166904 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-30c1be2c-9cc0-4aa3-8ec6-17e887bc4aa6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053869 Dec 15 12:43:04.169497 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 259/520] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:04 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:04.834988 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4d6e1e11-79a6-4f26-8eaf-e128461118a6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:04.835591 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4d6e1e11-79a6-4f26-8eaf-e128461118a6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:04.841839 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4d6e1e11-79a6-4f26-8eaf-e128461118a6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:04.842283 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4d6e1e11-79a6-4f26-8eaf-e128461118a6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:04.843062 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4d6e1e11-79a6-4f26-8eaf-e128461118a6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:04.843509 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4d6e1e11-79a6-4f26-8eaf-e128461118a6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:04.987864 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4d6e1e11-79a6-4f26-8eaf-e128461118a6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:04.995995 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4d6e1e11-79a6-4f26-8eaf-e128461118a6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:04.997492 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4d6e1e11-79a6-4f26-8eaf-e128461118a6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:04.998677 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4d6e1e11-79a6-4f26-8eaf-e128461118a6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.167852 Dec 15 12:43:04.999236 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 262/521] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:04 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:05.178776 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e5a7df71-b284-4f12-93e3-c8250386cd8c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:05.179684 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e5a7df71-b284-4f12-93e3-c8250386cd8c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:05.185947 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e5a7df71-b284-4f12-93e3-c8250386cd8c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:05.186393 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e5a7df71-b284-4f12-93e3-c8250386cd8c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:05.187172 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e5a7df71-b284-4f12-93e3-c8250386cd8c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:05.187607 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e5a7df71-b284-4f12-93e3-c8250386cd8c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:05.218294 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e5a7df71-b284-4f12-93e3-c8250386cd8c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043147 Dec 15 12:43:05.219038 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 260/522] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:05 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:06.017289 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9e9f5b66-d551-434d-82fa-8dcb83e85538 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:06.017990 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9e9f5b66-d551-434d-82fa-8dcb83e85538 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:06.024202 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9e9f5b66-d551-434d-82fa-8dcb83e85538 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:06.024655 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9e9f5b66-d551-434d-82fa-8dcb83e85538 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:06.025436 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9e9f5b66-d551-434d-82fa-8dcb83e85538 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:06.025898 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9e9f5b66-d551-434d-82fa-8dcb83e85538 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:06.167632 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9e9f5b66-d551-434d-82fa-8dcb83e85538 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:06.177536 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9e9f5b66-d551-434d-82fa-8dcb83e85538 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:06.178951 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9e9f5b66-d551-434d-82fa-8dcb83e85538 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:06.180094 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9e9f5b66-d551-434d-82fa-8dcb83e85538 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.166551 Dec 15 12:43:06.180674 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 263/523] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:06 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:06.230018 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5d6b68af-f9bf-47d6-9003-f03c5be9bd1a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:06.230872 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5d6b68af-f9bf-47d6-9003-f03c5be9bd1a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:06.237701 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5d6b68af-f9bf-47d6-9003-f03c5be9bd1a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:06.238150 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5d6b68af-f9bf-47d6-9003-f03c5be9bd1a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:06.238937 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5d6b68af-f9bf-47d6-9003-f03c5be9bd1a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:06.239373 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5d6b68af-f9bf-47d6-9003-f03c5be9bd1a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:06.270889 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5d6b68af-f9bf-47d6-9003-f03c5be9bd1a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044562 Dec 15 12:43:06.271480 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 261/524] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:06 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:07.201098 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9b2c9065-deaf-4a53-a7b0-0d6d5f73b00f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:07.201098 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9b2c9065-deaf-4a53-a7b0-0d6d5f73b00f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:07.208065 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9b2c9065-deaf-4a53-a7b0-0d6d5f73b00f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:07.208512 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9b2c9065-deaf-4a53-a7b0-0d6d5f73b00f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:07.209315 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9b2c9065-deaf-4a53-a7b0-0d6d5f73b00f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:07.209778 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9b2c9065-deaf-4a53-a7b0-0d6d5f73b00f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:07.283043 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bd9b2b81-e57b-423c-8e2b-7ec259662b32 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:07.283957 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bd9b2b81-e57b-423c-8e2b-7ec259662b32 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:07.290194 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bd9b2b81-e57b-423c-8e2b-7ec259662b32 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:07.290635 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bd9b2b81-e57b-423c-8e2b-7ec259662b32 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:07.291425 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bd9b2b81-e57b-423c-8e2b-7ec259662b32 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:07.291856 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bd9b2b81-e57b-423c-8e2b-7ec259662b32 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:07.323248 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bd9b2b81-e57b-423c-8e2b-7ec259662b32 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044606 Dec 15 12:43:07.323822 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 262/525] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:07 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:43:07.354973 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9b2c9065-deaf-4a53-a7b0-0d6d5f73b00f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:07.364524 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9b2c9065-deaf-4a53-a7b0-0d6d5f73b00f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:07.366030 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9b2c9065-deaf-4a53-a7b0-0d6d5f73b00f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:07.367178 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9b2c9065-deaf-4a53-a7b0-0d6d5f73b00f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.171691 Dec 15 12:43:07.367743 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 264/526] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:07 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:08.335301 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-32934592-fcaf-47ae-9df3-2532301c3845 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:08.336248 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-32934592-fcaf-47ae-9df3-2532301c3845 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:08.342523 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-32934592-fcaf-47ae-9df3-2532301c3845 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:08.342969 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-32934592-fcaf-47ae-9df3-2532301c3845 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:08.343775 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-32934592-fcaf-47ae-9df3-2532301c3845 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:08.344223 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-32934592-fcaf-47ae-9df3-2532301c3845 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:08.374640 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-32934592-fcaf-47ae-9df3-2532301c3845 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043004 Dec 15 12:43:08.375708 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 263/527] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:08 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:08.386174 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3665739b-292d-4db1-a38b-11f9c5b563d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:08.386798 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3665739b-292d-4db1-a38b-11f9c5b563d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:08.393899 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3665739b-292d-4db1-a38b-11f9c5b563d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:08.394347 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3665739b-292d-4db1-a38b-11f9c5b563d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:08.395128 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3665739b-292d-4db1-a38b-11f9c5b563d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:08.395562 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3665739b-292d-4db1-a38b-11f9c5b563d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:08.527347 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3665739b-292d-4db1-a38b-11f9c5b563d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:08.535661 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3665739b-292d-4db1-a38b-11f9c5b563d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:08.537148 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3665739b-292d-4db1-a38b-11f9c5b563d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:08.538318 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3665739b-292d-4db1-a38b-11f9c5b563d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.155837 Dec 15 12:43:08.538875 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 265/528] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:08 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:09.386893 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-20feb0ae-4bf0-46d3-ac0f-375a74df0c65 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:09.387803 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-20feb0ae-4bf0-46d3-ac0f-375a74df0c65 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:09.396513 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20feb0ae-4bf0-46d3-ac0f-375a74df0c65 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:09.396968 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20feb0ae-4bf0-46d3-ac0f-375a74df0c65 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:09.397842 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20feb0ae-4bf0-46d3-ac0f-375a74df0c65 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:09.398280 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20feb0ae-4bf0-46d3-ac0f-375a74df0c65 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:09.429189 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-20feb0ae-4bf0-46d3-ac0f-375a74df0c65 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045932 Dec 15 12:43:09.429817 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 264/529] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:09 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:09.556137 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-90ffabe1-5582-485e-a68e-f1d16dc9eb2c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:09.556679 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-90ffabe1-5582-485e-a68e-f1d16dc9eb2c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:09.563829 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-90ffabe1-5582-485e-a68e-f1d16dc9eb2c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:09.564278 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-90ffabe1-5582-485e-a68e-f1d16dc9eb2c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:09.565057 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-90ffabe1-5582-485e-a68e-f1d16dc9eb2c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:09.565491 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-90ffabe1-5582-485e-a68e-f1d16dc9eb2c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:09.703077 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-90ffabe1-5582-485e-a68e-f1d16dc9eb2c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:09.712530 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-90ffabe1-5582-485e-a68e-f1d16dc9eb2c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:09.714080 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-90ffabe1-5582-485e-a68e-f1d16dc9eb2c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:09.715271 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-90ffabe1-5582-485e-a68e-f1d16dc9eb2c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.162902 Dec 15 12:43:09.715947 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 266/530] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:09 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:10.440470 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-248567e9-bcb7-4e6a-a175-87b4aa550c47 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:10.441383 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-248567e9-bcb7-4e6a-a175-87b4aa550c47 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:10.447746 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-248567e9-bcb7-4e6a-a175-87b4aa550c47 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:10.448187 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-248567e9-bcb7-4e6a-a175-87b4aa550c47 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:10.448978 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-248567e9-bcb7-4e6a-a175-87b4aa550c47 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:10.449411 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-248567e9-bcb7-4e6a-a175-87b4aa550c47 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:10.478536 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-248567e9-bcb7-4e6a-a175-87b4aa550c47 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042084 Dec 15 12:43:10.479091 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 265/531] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:10 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:10.733399 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a8bf18ae-20a2-4891-9873-1168ce5f6114 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:10.734043 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a8bf18ae-20a2-4891-9873-1168ce5f6114 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:10.740352 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a8bf18ae-20a2-4891-9873-1168ce5f6114 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:10.740795 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a8bf18ae-20a2-4891-9873-1168ce5f6114 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:10.741606 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a8bf18ae-20a2-4891-9873-1168ce5f6114 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:10.742042 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a8bf18ae-20a2-4891-9873-1168ce5f6114 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:10.877831 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a8bf18ae-20a2-4891-9873-1168ce5f6114 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:10.886135 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a8bf18ae-20a2-4891-9873-1168ce5f6114 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:10.887649 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a8bf18ae-20a2-4891-9873-1168ce5f6114 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:10.888782 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a8bf18ae-20a2-4891-9873-1168ce5f6114 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.159137 Dec 15 12:43:10.889343 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 267/532] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:10 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:11.490486 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2a44c54b-b284-4392-9d4f-c1aa21ec9857 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:11.491401 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2a44c54b-b284-4392-9d4f-c1aa21ec9857 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:11.497778 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2a44c54b-b284-4392-9d4f-c1aa21ec9857 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:11.498229 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2a44c54b-b284-4392-9d4f-c1aa21ec9857 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:11.499000 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2a44c54b-b284-4392-9d4f-c1aa21ec9857 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:11.499427 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2a44c54b-b284-4392-9d4f-c1aa21ec9857 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:11.529195 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2a44c54b-b284-4392-9d4f-c1aa21ec9857 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042384 Dec 15 12:43:11.529828 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 266/533] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:11 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:11.691836 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5a647c81-bac9-4055-a40d-72bc7e1f0186 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:11.692324 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5a647c81-bac9-4055-a40d-72bc7e1f0186 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: d2617ab9-727c-4fdc-8c26-1c46312c89ca] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:11.698410 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5a647c81-bac9-4055-a40d-72bc7e1f0186 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:11.698851 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5a647c81-bac9-4055-a40d-72bc7e1f0186 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:11.699626 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5a647c81-bac9-4055-a40d-72bc7e1f0186 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:11.700055 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5a647c81-bac9-4055-a40d-72bc7e1f0186 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:11.724016 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5a647c81-bac9-4055-a40d-72bc7e1f0186 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: d2617ab9-727c-4fdc-8c26-1c46312c89ca] Going to try to terminate instance {{(pid=122615) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 12:43:11.803960 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5a647c81-bac9-4055-a40d-72bc7e1f0186 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca" status: 204 len: 0 microversion: 2.1 time: 0.116435 Dec 15 12:43:11.804650 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 268/534] 10.222.0.76 () {58 vars in 1238 bytes} [Wed Dec 15 12:43:11 2021] DELETE /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 12:43:11.812810 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-cd223db2-b490-474f-8eb1-e16b908ef014 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:11.813861 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-cd223db2-b490-474f-8eb1-e16b908ef014 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: d2617ab9-727c-4fdc-8c26-1c46312c89ca] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:11.819545 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cd223db2-b490-474f-8eb1-e16b908ef014 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:11.819980 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cd223db2-b490-474f-8eb1-e16b908ef014 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:11.820751 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cd223db2-b490-474f-8eb1-e16b908ef014 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:11.821169 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cd223db2-b490-474f-8eb1-e16b908ef014 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:11.908515 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c67697da-a694-4e96-aa33-4e4520e1fe8c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:11.909202 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c67697da-a694-4e96-aa33-4e4520e1fe8c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:11.915443 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c67697da-a694-4e96-aa33-4e4520e1fe8c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:11.915887 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c67697da-a694-4e96-aa33-4e4520e1fe8c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:11.916665 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c67697da-a694-4e96-aa33-4e4520e1fe8c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:11.917092 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c67697da-a694-4e96-aa33-4e4520e1fe8c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:11.964478 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-cd223db2-b490-474f-8eb1-e16b908ef014 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13d2fbbad43428b8e5637e6d86d93fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473ac1badd984fbeb2e27b1ac44b3d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:11.972422 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-cd223db2-b490-474f-8eb1-e16b908ef014 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca" status: 200 len: 1505 microversion: 2.1 time: 0.163480 Dec 15 12:43:11.973096 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 267/535] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:43:11 2021] GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:43:12.058705 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c67697da-a694-4e96-aa33-4e4520e1fe8c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:12.067210 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c67697da-a694-4e96-aa33-4e4520e1fe8c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:12.068674 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c67697da-a694-4e96-aa33-4e4520e1fe8c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:12.069835 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c67697da-a694-4e96-aa33-4e4520e1fe8c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.165947 Dec 15 12:43:12.070392 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 269/536] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:11 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:43:12.540761 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0da4ae49-0b60-42d4-8e9a-3e6dbae74f93 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:12.541741 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0da4ae49-0b60-42d4-8e9a-3e6dbae74f93 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:12.548027 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0da4ae49-0b60-42d4-8e9a-3e6dbae74f93 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:12.548476 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0da4ae49-0b60-42d4-8e9a-3e6dbae74f93 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:12.549257 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0da4ae49-0b60-42d4-8e9a-3e6dbae74f93 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:12.549769 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0da4ae49-0b60-42d4-8e9a-3e6dbae74f93 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:12.580271 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0da4ae49-0b60-42d4-8e9a-3e6dbae74f93 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043025 Dec 15 12:43:12.580853 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 268/537] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:12 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:12.991367 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c2b0300f-bf99-4332-8aef-d7f1666bc5f5 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:12.992020 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c2b0300f-bf99-4332-8aef-d7f1666bc5f5 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: d2617ab9-727c-4fdc-8c26-1c46312c89ca] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:12.998388 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2b0300f-bf99-4332-8aef-d7f1666bc5f5 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:12.998834 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2b0300f-bf99-4332-8aef-d7f1666bc5f5 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:12.999624 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2b0300f-bf99-4332-8aef-d7f1666bc5f5 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:13.000087 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2b0300f-bf99-4332-8aef-d7f1666bc5f5 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:13.087840 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-32ed776f-0f45-4e2c-a78f-f39466fec8d5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:13.088435 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-32ed776f-0f45-4e2c-a78f-f39466fec8d5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:13.095068 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-32ed776f-0f45-4e2c-a78f-f39466fec8d5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:13.095509 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-32ed776f-0f45-4e2c-a78f-f39466fec8d5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:13.096305 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-32ed776f-0f45-4e2c-a78f-f39466fec8d5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:13.096739 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-32ed776f-0f45-4e2c-a78f-f39466fec8d5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:13.147435 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c2b0300f-bf99-4332-8aef-d7f1666bc5f5 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13d2fbbad43428b8e5637e6d86d93fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473ac1badd984fbeb2e27b1ac44b3d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:13.155096 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c2b0300f-bf99-4332-8aef-d7f1666bc5f5 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca" status: 200 len: 1505 microversion: 2.1 time: 0.167374 Dec 15 12:43:13.155674 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 270/538] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:43:12 2021] GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:43:13.240094 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-32ed776f-0f45-4e2c-a78f-f39466fec8d5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:13.248950 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-32ed776f-0f45-4e2c-a78f-f39466fec8d5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:13.251413 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-32ed776f-0f45-4e2c-a78f-f39466fec8d5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:13.252727 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-32ed776f-0f45-4e2c-a78f-f39466fec8d5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.168533 Dec 15 12:43:13.253299 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 269/539] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:13 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:43:13.590807 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ae20092a-6ab5-4917-b439-3c6258e3c558 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:13.591816 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ae20092a-6ab5-4917-b439-3c6258e3c558 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:13.598192 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ae20092a-6ab5-4917-b439-3c6258e3c558 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:13.598637 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ae20092a-6ab5-4917-b439-3c6258e3c558 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:13.599416 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ae20092a-6ab5-4917-b439-3c6258e3c558 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:13.599855 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ae20092a-6ab5-4917-b439-3c6258e3c558 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:13.631431 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ae20092a-6ab5-4917-b439-3c6258e3c558 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044255 Dec 15 12:43:13.631999 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 271/540] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:13 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:43:13.839181 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-921f2ba3-9cf4-4f74-ba9f-c88d82e23d2f req-7d1bc3a6-70a8-4ebd-bb53-f403800fd93c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2617ab9-727c-4fdc-8c26-1c46312c89ca", "name": "network-vif-deleted", "tag": "0bb97ec6-500a-4062-bdaa-84dd4b6d7435"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:43:13.841348 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:43:13.841348 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 12:43:13.851553 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-921f2ba3-9cf4-4f74-ba9f-c88d82e23d2f req-7d1bc3a6-70a8-4ebd-bb53-f403800fd93c service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:13.852236 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-921f2ba3-9cf4-4f74-ba9f-c88d82e23d2f req-7d1bc3a6-70a8-4ebd-bb53-f403800fd93c service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:13.865067 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-921f2ba3-9cf4-4f74-ba9f-c88d82e23d2f req-7d1bc3a6-70a8-4ebd-bb53-f403800fd93c service nova] Creating event network-vif-deleted:0bb97ec6-500a-4062-bdaa-84dd4b6d7435 for instance d2617ab9-727c-4fdc-8c26-1c46312c89ca on hv-cinder-81322 Dec 15 12:43:13.871048 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-921f2ba3-9cf4-4f74-ba9f-c88d82e23d2f req-7d1bc3a6-70a8-4ebd-bb53-f403800fd93c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035709 Dec 15 12:43:13.871640 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 270/541] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 12:43:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:14.172014 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2eb06e25-5ef7-4649-8138-395ef6084da1 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:14.172673 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2eb06e25-5ef7-4649-8138-395ef6084da1 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: d2617ab9-727c-4fdc-8c26-1c46312c89ca] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:14.179205 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2eb06e25-5ef7-4649-8138-395ef6084da1 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:14.179756 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2eb06e25-5ef7-4649-8138-395ef6084da1 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:14.180572 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2eb06e25-5ef7-4649-8138-395ef6084da1 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:14.180992 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2eb06e25-5ef7-4649-8138-395ef6084da1 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:14.214240 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2eb06e25-5ef7-4649-8138-395ef6084da1 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:14.214678 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2eb06e25-5ef7-4649-8138-395ef6084da1 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:14.215116 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.objects.instance [None req-2eb06e25-5ef7-4649-8138-395ef6084da1 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lazy-loading 'fault' on Instance uuid d2617ab9-727c-4fdc-8c26-1c46312c89ca {{(pid=122615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 12:43:14.265325 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2eb06e25-5ef7-4649-8138-395ef6084da1 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13d2fbbad43428b8e5637e6d86d93fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473ac1badd984fbeb2e27b1ac44b3d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:14.272725 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-63d37038-9eda-4d22-953c-21e5668e03a1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:14.273574 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-63d37038-9eda-4d22-953c-21e5668e03a1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:14.274286 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2eb06e25-5ef7-4649-8138-395ef6084da1 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca" status: 200 len: 1304 microversion: 2.1 time: 0.105855 Dec 15 12:43:14.274867 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 272/542] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:43:14 2021] GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:43:14.279714 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-63d37038-9eda-4d22-953c-21e5668e03a1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:14.280154 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-63d37038-9eda-4d22-953c-21e5668e03a1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:14.280955 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-63d37038-9eda-4d22-953c-21e5668e03a1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:14.282061 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-63d37038-9eda-4d22-953c-21e5668e03a1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:14.421829 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-63d37038-9eda-4d22-953c-21e5668e03a1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:14.430174 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-63d37038-9eda-4d22-953c-21e5668e03a1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:14.431672 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-63d37038-9eda-4d22-953c-21e5668e03a1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:14.432816 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-63d37038-9eda-4d22-953c-21e5668e03a1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.164698 Dec 15 12:43:14.433377 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 271/543] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:14 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:43:14.643241 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8c244874-bae0-4f25-a625-523bef3a4a5a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:14.644573 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8c244874-bae0-4f25-a625-523bef3a4a5a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:14.650891 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c244874-bae0-4f25-a625-523bef3a4a5a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:14.651440 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c244874-bae0-4f25-a625-523bef3a4a5a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:14.652194 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c244874-bae0-4f25-a625-523bef3a4a5a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:14.652664 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c244874-bae0-4f25-a625-523bef3a4a5a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:14.687899 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8c244874-bae0-4f25-a625-523bef3a4a5a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049517 Dec 15 12:43:14.688794 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 273/544] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:14 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:15.291987 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-59d0fbdb-6a6e-4667-8d8e-eb73224736d2 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:15.292661 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-59d0fbdb-6a6e-4667-8d8e-eb73224736d2 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: d2617ab9-727c-4fdc-8c26-1c46312c89ca] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:15.301340 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-59d0fbdb-6a6e-4667-8d8e-eb73224736d2 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:15.301462 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-59d0fbdb-6a6e-4667-8d8e-eb73224736d2 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:15.302270 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-59d0fbdb-6a6e-4667-8d8e-eb73224736d2 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:15.302783 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-59d0fbdb-6a6e-4667-8d8e-eb73224736d2 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:15.316638 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.wsgi [None req-59d0fbdb-6a6e-4667-8d8e-eb73224736d2 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] HTTP exception thrown: Instance d2617ab9-727c-4fdc-8c26-1c46312c89ca could not be found. Dec 15 12:43:15.317260 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-59d0fbdb-6a6e-4667-8d8e-eb73224736d2 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Returning 404 to user: Instance d2617ab9-727c-4fdc-8c26-1c46312c89ca could not be found. {{(pid=122614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:43:15.318118 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-59d0fbdb-6a6e-4667-8d8e-eb73224736d2 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca" status: 404 len: 111 microversion: 2.1 time: 0.029923 Dec 15 12:43:15.318680 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 272/545] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:43:15 2021] GET /compute/v2.1/servers/d2617ab9-727c-4fdc-8c26-1c46312c89ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 12:43:15.420938 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e09c54ac-ba7f-4295-8f24-c0113823a84b tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-950574704", "imageRef": "d302555e-2bff-4492-b57d-d59c0097a278", "flavorRef": "452", "networks": [{"uuid": "09867c92-35d2-4901-9521-87067935a7a9"}]}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:43:15.453689 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-deba9413-a18a-4faa-95e7-7042244125d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:15.454697 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-deba9413-a18a-4faa-95e7-7042244125d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:15.462365 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-deba9413-a18a-4faa-95e7-7042244125d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:15.462365 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-deba9413-a18a-4faa-95e7-7042244125d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:15.463149 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-deba9413-a18a-4faa-95e7-7042244125d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:15.463770 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-deba9413-a18a-4faa-95e7-7042244125d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:15.473974 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.network.neutron [None req-e09c54ac-ba7f-4295-8f24-c0113823a84b tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] validate_networks() for [('09867c92-35d2-4901-9521-87067935a7a9', None, None, None, None, None)] {{(pid=122615) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 12:43:15.875872 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-deba9413-a18a-4faa-95e7-7042244125d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:15.884639 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-deba9413-a18a-4faa-95e7-7042244125d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:15.886182 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-deba9413-a18a-4faa-95e7-7042244125d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:15.887385 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-deba9413-a18a-4faa-95e7-7042244125d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.439795 Dec 15 12:43:15.887976 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 273/546] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:15 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:15.892777 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-414f7ba7-2497-45b2-9776-3243c6d1238f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:15.893703 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-414f7ba7-2497-45b2-9776-3243c6d1238f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:15.899508 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-414f7ba7-2497-45b2-9776-3243c6d1238f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:15.899959 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-414f7ba7-2497-45b2-9776-3243c6d1238f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:15.900746 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-414f7ba7-2497-45b2-9776-3243c6d1238f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:15.901178 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-414f7ba7-2497-45b2-9776-3243c6d1238f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:15.931986 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-414f7ba7-2497-45b2-9776-3243c6d1238f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042971 Dec 15 12:43:15.932543 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 274/547] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:15 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:16.053000 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-e09c54ac-ba7f-4295-8f24-c0113823a84b tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Flavor limits 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 12:43:16.053421 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-e09c54ac-ba7f-4295-8f24-c0113823a84b tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Image limits 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 12:43:16.053922 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-e09c54ac-ba7f-4295-8f24-c0113823a84b tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Flavor pref 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 12:43:16.054332 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-e09c54ac-ba7f-4295-8f24-c0113823a84b tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Image pref 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 12:43:16.054900 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-e09c54ac-ba7f-4295-8f24-c0113823a84b tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 12:43:16.063814 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e09c54ac-ba7f-4295-8f24-c0113823a84b tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:16.064254 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e09c54ac-ba7f-4295-8f24-c0113823a84b tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:16.065230 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e09c54ac-ba7f-4295-8f24-c0113823a84b tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:16.065697 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e09c54ac-ba7f-4295-8f24-c0113823a84b tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:16.084946 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-e09c54ac-ba7f-4295-8f24-c0113823a84b tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Getting quotas for project 473ac1badd984fbeb2e27b1ac44b3d51. Resources: {'instances', 'cores', 'ram'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 12:43:16.089639 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-e09c54ac-ba7f-4295-8f24-c0113823a84b tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Getting quotas for user c13d2fbbad43428b8e5637e6d86d93fe and project 473ac1badd984fbeb2e27b1ac44b3d51. Resources: {'instances', 'cores', 'ram'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 12:43:16.108931 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e09c54ac-ba7f-4295-8f24-c0113823a84b tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Going to run 1 instances... {{(pid=122615) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 12:43:16.114615 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e09c54ac-ba7f-4295-8f24-c0113823a84b tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: 0066217c-9069-4dc5-8a29-14b22c285ff6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d302555e-2bff-4492-b57d-d59c0097a278',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 12:43:16.171401 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e09c54ac-ba7f-4295-8f24-c0113823a84b tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.753991 Dec 15 12:43:16.172348 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 274/548] 10.222.0.76 () {60 vars in 1146 bytes} [Wed Dec 15 12:43:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 12:43:16.185769 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-26ff64c9-ae16-43bb-a7cd-56d176e05b5f tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:16.186398 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-26ff64c9-ae16-43bb-a7cd-56d176e05b5f tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: 0066217c-9069-4dc5-8a29-14b22c285ff6] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:16.240207 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-26ff64c9-ae16-43bb-a7cd-56d176e05b5f tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13d2fbbad43428b8e5637e6d86d93fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473ac1badd984fbeb2e27b1ac44b3d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:16.246829 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-26ff64c9-ae16-43bb-a7cd-56d176e05b5f tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6" status: 200 len: 1213 microversion: 2.1 time: 0.065817 Dec 15 12:43:16.247390 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 275/549] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:43:16 2021] GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6 => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:43:16.908531 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-02195b20-a60a-4cb4-972d-c53afe6b13dc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:16.909203 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-02195b20-a60a-4cb4-972d-c53afe6b13dc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:16.915599 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-02195b20-a60a-4cb4-972d-c53afe6b13dc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:16.916035 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-02195b20-a60a-4cb4-972d-c53afe6b13dc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:16.916807 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-02195b20-a60a-4cb4-972d-c53afe6b13dc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:16.917234 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-02195b20-a60a-4cb4-972d-c53afe6b13dc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:16.943193 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5f4b08cd-7fd8-427a-97d1-01297c2adae1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:16.944177 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5f4b08cd-7fd8-427a-97d1-01297c2adae1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:16.951164 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5f4b08cd-7fd8-427a-97d1-01297c2adae1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:16.951607 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5f4b08cd-7fd8-427a-97d1-01297c2adae1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:16.952473 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5f4b08cd-7fd8-427a-97d1-01297c2adae1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:16.953622 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5f4b08cd-7fd8-427a-97d1-01297c2adae1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:16.985372 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5f4b08cd-7fd8-427a-97d1-01297c2adae1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045698 Dec 15 12:43:16.986176 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 276/550] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:16 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:43:17.055233 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-02195b20-a60a-4cb4-972d-c53afe6b13dc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:17.066098 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-02195b20-a60a-4cb4-972d-c53afe6b13dc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:17.067651 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-02195b20-a60a-4cb4-972d-c53afe6b13dc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:17.068829 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-02195b20-a60a-4cb4-972d-c53afe6b13dc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.165635 Dec 15 12:43:17.069583 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 275/551] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:16 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:17.270821 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6984fa17-2576-4532-8875-bbc979216c14 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:17.271420 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6984fa17-2576-4532-8875-bbc979216c14 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: 0066217c-9069-4dc5-8a29-14b22c285ff6] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:17.280690 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6984fa17-2576-4532-8875-bbc979216c14 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:17.281163 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6984fa17-2576-4532-8875-bbc979216c14 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:17.282078 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6984fa17-2576-4532-8875-bbc979216c14 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:17.282482 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6984fa17-2576-4532-8875-bbc979216c14 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:17.356304 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6984fa17-2576-4532-8875-bbc979216c14 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13d2fbbad43428b8e5637e6d86d93fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473ac1badd984fbeb2e27b1ac44b3d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:17.363830 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6984fa17-2576-4532-8875-bbc979216c14 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6" status: 200 len: 1271 microversion: 2.1 time: 0.098276 Dec 15 12:43:17.364615 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 277/552] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:43:17 2021] GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6 => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:43:17.996451 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1665a76d-ce06-440f-ba2a-2d57868b083c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:17.997548 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1665a76d-ce06-440f-ba2a-2d57868b083c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:18.004868 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1665a76d-ce06-440f-ba2a-2d57868b083c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:18.005338 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1665a76d-ce06-440f-ba2a-2d57868b083c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:18.006135 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1665a76d-ce06-440f-ba2a-2d57868b083c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:18.006568 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1665a76d-ce06-440f-ba2a-2d57868b083c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:18.036944 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1665a76d-ce06-440f-ba2a-2d57868b083c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044454 Dec 15 12:43:18.041033 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 276/553] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:17 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:18.086784 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-cd949fe8-8461-4d1e-8b08-bfe3f98c3ff8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:18.087394 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-cd949fe8-8461-4d1e-8b08-bfe3f98c3ff8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:18.093629 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cd949fe8-8461-4d1e-8b08-bfe3f98c3ff8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:18.094732 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cd949fe8-8461-4d1e-8b08-bfe3f98c3ff8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:18.095523 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cd949fe8-8461-4d1e-8b08-bfe3f98c3ff8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:18.095961 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cd949fe8-8461-4d1e-8b08-bfe3f98c3ff8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:18.239688 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-cd949fe8-8461-4d1e-8b08-bfe3f98c3ff8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:18.248728 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-cd949fe8-8461-4d1e-8b08-bfe3f98c3ff8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:18.250452 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-cd949fe8-8461-4d1e-8b08-bfe3f98c3ff8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:18.251627 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-cd949fe8-8461-4d1e-8b08-bfe3f98c3ff8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.168586 Dec 15 12:43:18.252354 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 278/554] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:18 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:18.380156 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-db21dc9c-c3e3-41bf-9c93-915d5af5e215 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:18.380769 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-db21dc9c-c3e3-41bf-9c93-915d5af5e215 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: 0066217c-9069-4dc5-8a29-14b22c285ff6] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:18.386412 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-db21dc9c-c3e3-41bf-9c93-915d5af5e215 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:18.387060 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-db21dc9c-c3e3-41bf-9c93-915d5af5e215 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:18.388011 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-db21dc9c-c3e3-41bf-9c93-915d5af5e215 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:18.388437 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-db21dc9c-c3e3-41bf-9c93-915d5af5e215 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:18.520382 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-6ef59ae6-b0f1-4185-a7c4-8477ce4595a0 req-9b9f2e25-71ec-49f7-a40f-34b9492bb5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0066217c-9069-4dc5-8a29-14b22c285ff6", "tag": "c910ab73-3a86-47e4-b8cd-8874c1b57845"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:43:18.522902 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:43:18.522902 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 12:43:18.530252 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-db21dc9c-c3e3-41bf-9c93-915d5af5e215 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13d2fbbad43428b8e5637e6d86d93fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473ac1badd984fbeb2e27b1ac44b3d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:18.539565 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-db21dc9c-c3e3-41bf-9c93-915d5af5e215 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6" status: 200 len: 1313 microversion: 2.1 time: 0.162418 Dec 15 12:43:18.539926 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 277/555] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:43:18 2021] GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:43:18.542658 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-6ef59ae6-b0f1-4185-a7c4-8477ce4595a0 req-9b9f2e25-71ec-49f7-a40f-34b9492bb5b3 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:18.543097 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-6ef59ae6-b0f1-4185-a7c4-8477ce4595a0 req-9b9f2e25-71ec-49f7-a40f-34b9492bb5b3 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:18.555994 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-6ef59ae6-b0f1-4185-a7c4-8477ce4595a0 req-9b9f2e25-71ec-49f7-a40f-34b9492bb5b3 service nova] Creating event network-changed:c910ab73-3a86-47e4-b8cd-8874c1b57845 for instance 0066217c-9069-4dc5-8a29-14b22c285ff6 on hv-cinder-81322 Dec 15 12:43:18.560596 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-6ef59ae6-b0f1-4185-a7c4-8477ce4595a0 req-9b9f2e25-71ec-49f7-a40f-34b9492bb5b3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047028 Dec 15 12:43:18.561200 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 279/556] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 12:43:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:19.049252 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-afcf30ff-5f93-42d6-8d2d-d204de4b23ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:19.050241 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-afcf30ff-5f93-42d6-8d2d-d204de4b23ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:19.056025 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afcf30ff-5f93-42d6-8d2d-d204de4b23ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:19.056450 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afcf30ff-5f93-42d6-8d2d-d204de4b23ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:19.057224 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afcf30ff-5f93-42d6-8d2d-d204de4b23ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:19.057685 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afcf30ff-5f93-42d6-8d2d-d204de4b23ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:19.087861 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-afcf30ff-5f93-42d6-8d2d-d204de4b23ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043190 Dec 15 12:43:19.088541 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 278/557] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:19 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:19.271544 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1adcd83b-516e-4bb2-8187-a47715c5c8ee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:19.272229 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1adcd83b-516e-4bb2-8187-a47715c5c8ee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:19.278524 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1adcd83b-516e-4bb2-8187-a47715c5c8ee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:19.278903 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1adcd83b-516e-4bb2-8187-a47715c5c8ee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:19.279685 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1adcd83b-516e-4bb2-8187-a47715c5c8ee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:19.280114 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1adcd83b-516e-4bb2-8187-a47715c5c8ee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:19.425470 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1adcd83b-516e-4bb2-8187-a47715c5c8ee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:19.433877 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1adcd83b-516e-4bb2-8187-a47715c5c8ee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:19.435386 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1adcd83b-516e-4bb2-8187-a47715c5c8ee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:19.436542 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1adcd83b-516e-4bb2-8187-a47715c5c8ee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.169646 Dec 15 12:43:19.437345 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 280/558] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:19 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:19.555799 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c000d26e-7299-4647-8ae9-158d40486ec2 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:19.556404 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c000d26e-7299-4647-8ae9-158d40486ec2 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: 0066217c-9069-4dc5-8a29-14b22c285ff6] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:19.562951 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c000d26e-7299-4647-8ae9-158d40486ec2 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:19.563410 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c000d26e-7299-4647-8ae9-158d40486ec2 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:19.564251 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c000d26e-7299-4647-8ae9-158d40486ec2 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:19.564683 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c000d26e-7299-4647-8ae9-158d40486ec2 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:19.697881 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c000d26e-7299-4647-8ae9-158d40486ec2 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13d2fbbad43428b8e5637e6d86d93fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473ac1badd984fbeb2e27b1ac44b3d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:19.705206 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c000d26e-7299-4647-8ae9-158d40486ec2 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6" status: 200 len: 1313 microversion: 2.1 time: 0.153116 Dec 15 12:43:19.705891 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 279/559] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:43:19 2021] GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:43:20.099670 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-cd63a6f8-5e8e-4ccc-9e0d-cace7d332769 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:20.100529 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-cd63a6f8-5e8e-4ccc-9e0d-cace7d332769 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:20.106352 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cd63a6f8-5e8e-4ccc-9e0d-cace7d332769 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:20.106808 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cd63a6f8-5e8e-4ccc-9e0d-cace7d332769 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:20.107583 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cd63a6f8-5e8e-4ccc-9e0d-cace7d332769 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:20.108017 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cd63a6f8-5e8e-4ccc-9e0d-cace7d332769 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:20.137287 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-cd63a6f8-5e8e-4ccc-9e0d-cace7d332769 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041348 Dec 15 12:43:20.137920 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 281/560] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:20 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:20.456473 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c1e09d9a-920e-4122-bf4b-94699d026f78 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:20.457059 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c1e09d9a-920e-4122-bf4b-94699d026f78 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:20.463437 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c1e09d9a-920e-4122-bf4b-94699d026f78 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:20.463881 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c1e09d9a-920e-4122-bf4b-94699d026f78 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:20.464653 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c1e09d9a-920e-4122-bf4b-94699d026f78 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:20.465081 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c1e09d9a-920e-4122-bf4b-94699d026f78 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:20.612530 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c1e09d9a-920e-4122-bf4b-94699d026f78 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:20.621033 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c1e09d9a-920e-4122-bf4b-94699d026f78 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:20.622548 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c1e09d9a-920e-4122-bf4b-94699d026f78 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:20.623754 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c1e09d9a-920e-4122-bf4b-94699d026f78 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.171482 Dec 15 12:43:20.624299 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 280/561] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:20 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:20.723032 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3ff64495-269a-47ab-9270-ada30cafe0d2 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:20.723590 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3ff64495-269a-47ab-9270-ada30cafe0d2 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: 0066217c-9069-4dc5-8a29-14b22c285ff6] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:20.729833 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3ff64495-269a-47ab-9270-ada30cafe0d2 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:20.730274 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3ff64495-269a-47ab-9270-ada30cafe0d2 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:20.731042 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3ff64495-269a-47ab-9270-ada30cafe0d2 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:20.731470 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3ff64495-269a-47ab-9270-ada30cafe0d2 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:20.878738 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3ff64495-269a-47ab-9270-ada30cafe0d2 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13d2fbbad43428b8e5637e6d86d93fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473ac1badd984fbeb2e27b1ac44b3d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:20.886047 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3ff64495-269a-47ab-9270-ada30cafe0d2 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6" status: 200 len: 1313 microversion: 2.1 time: 0.167614 Dec 15 12:43:20.886621 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 282/562] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:43:20 2021] GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:43:21.148870 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8f7265d3-2bd6-4502-878e-d06163b4e7a5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:21.149797 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8f7265d3-2bd6-4502-878e-d06163b4e7a5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:21.155631 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8f7265d3-2bd6-4502-878e-d06163b4e7a5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:21.156068 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8f7265d3-2bd6-4502-878e-d06163b4e7a5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:21.157209 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8f7265d3-2bd6-4502-878e-d06163b4e7a5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:21.157598 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8f7265d3-2bd6-4502-878e-d06163b4e7a5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:21.188695 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8f7265d3-2bd6-4502-878e-d06163b4e7a5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042878 Dec 15 12:43:21.189268 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 281/563] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:21 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:21.641947 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9a6ab9f6-50d2-4c8e-aea5-383b3688c585 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:21.642553 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9a6ab9f6-50d2-4c8e-aea5-383b3688c585 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:21.648797 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9a6ab9f6-50d2-4c8e-aea5-383b3688c585 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:21.649247 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9a6ab9f6-50d2-4c8e-aea5-383b3688c585 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:21.650103 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9a6ab9f6-50d2-4c8e-aea5-383b3688c585 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:21.650535 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9a6ab9f6-50d2-4c8e-aea5-383b3688c585 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:21.785731 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9a6ab9f6-50d2-4c8e-aea5-383b3688c585 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:21.793865 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9a6ab9f6-50d2-4c8e-aea5-383b3688c585 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:21.795366 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9a6ab9f6-50d2-4c8e-aea5-383b3688c585 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:21.796514 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9a6ab9f6-50d2-4c8e-aea5-383b3688c585 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.158307 Dec 15 12:43:21.797721 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 283/564] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:21 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:21.903374 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ba0ed2ef-a5f1-49b0-9319-956b2861e7d7 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:21.904030 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ba0ed2ef-a5f1-49b0-9319-956b2861e7d7 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: 0066217c-9069-4dc5-8a29-14b22c285ff6] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:21.911674 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ba0ed2ef-a5f1-49b0-9319-956b2861e7d7 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:21.912123 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ba0ed2ef-a5f1-49b0-9319-956b2861e7d7 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:21.912956 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ba0ed2ef-a5f1-49b0-9319-956b2861e7d7 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:21.913389 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ba0ed2ef-a5f1-49b0-9319-956b2861e7d7 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:22.048053 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ba0ed2ef-a5f1-49b0-9319-956b2861e7d7 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13d2fbbad43428b8e5637e6d86d93fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473ac1badd984fbeb2e27b1ac44b3d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:22.055233 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ba0ed2ef-a5f1-49b0-9319-956b2861e7d7 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6" status: 200 len: 1313 microversion: 2.1 time: 0.155549 Dec 15 12:43:22.055796 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 282/565] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:43:21 2021] GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:43:22.200343 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-513a2329-8cc7-4558-af1d-99c1bba9f556 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:22.201243 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-513a2329-8cc7-4558-af1d-99c1bba9f556 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:22.207821 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-513a2329-8cc7-4558-af1d-99c1bba9f556 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:22.208285 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-513a2329-8cc7-4558-af1d-99c1bba9f556 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:22.209062 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-513a2329-8cc7-4558-af1d-99c1bba9f556 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:22.209494 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-513a2329-8cc7-4558-af1d-99c1bba9f556 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:22.240072 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-513a2329-8cc7-4558-af1d-99c1bba9f556 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043426 Dec 15 12:43:22.240626 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 284/566] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:22 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:43:22.816319 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d9de23fb-23f2-4f36-ba10-8deb53a1a355 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:22.816954 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d9de23fb-23f2-4f36-ba10-8deb53a1a355 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:22.823145 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d9de23fb-23f2-4f36-ba10-8deb53a1a355 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:22.823512 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d9de23fb-23f2-4f36-ba10-8deb53a1a355 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:22.824297 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d9de23fb-23f2-4f36-ba10-8deb53a1a355 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:22.824723 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d9de23fb-23f2-4f36-ba10-8deb53a1a355 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:22.961335 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d9de23fb-23f2-4f36-ba10-8deb53a1a355 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:22.970267 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d9de23fb-23f2-4f36-ba10-8deb53a1a355 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:22.971773 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d9de23fb-23f2-4f36-ba10-8deb53a1a355 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:22.972933 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d9de23fb-23f2-4f36-ba10-8deb53a1a355 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.161304 Dec 15 12:43:22.973497 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 283/567] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:22 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:23.072216 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4c5f05d9-9977-41fd-a419-4de356e234d3 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:23.072819 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4c5f05d9-9977-41fd-a419-4de356e234d3 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: 0066217c-9069-4dc5-8a29-14b22c285ff6] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:23.079899 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4c5f05d9-9977-41fd-a419-4de356e234d3 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:23.080283 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4c5f05d9-9977-41fd-a419-4de356e234d3 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:23.081069 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4c5f05d9-9977-41fd-a419-4de356e234d3 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:23.081500 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4c5f05d9-9977-41fd-a419-4de356e234d3 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:23.217366 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4c5f05d9-9977-41fd-a419-4de356e234d3 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13d2fbbad43428b8e5637e6d86d93fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473ac1badd984fbeb2e27b1ac44b3d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:23.224945 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4c5f05d9-9977-41fd-a419-4de356e234d3 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6" status: 200 len: 1313 microversion: 2.1 time: 0.156366 Dec 15 12:43:23.225530 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 285/568] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:43:23 2021] GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:43:23.251911 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-02c12885-bb27-41ff-8eff-71b5974793d6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:23.252813 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-02c12885-bb27-41ff-8eff-71b5974793d6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:23.259062 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-02c12885-bb27-41ff-8eff-71b5974793d6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:23.259510 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-02c12885-bb27-41ff-8eff-71b5974793d6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:23.260299 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-02c12885-bb27-41ff-8eff-71b5974793d6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:23.260735 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-02c12885-bb27-41ff-8eff-71b5974793d6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:23.291692 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-02c12885-bb27-41ff-8eff-71b5974793d6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044054 Dec 15 12:43:23.292259 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 284/569] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:23 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:23.990997 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-62cb2071-327e-4b72-9897-8e140e8492fb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:23.991660 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-62cb2071-327e-4b72-9897-8e140e8492fb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:23.998064 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-62cb2071-327e-4b72-9897-8e140e8492fb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:23.998512 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-62cb2071-327e-4b72-9897-8e140e8492fb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:23.999303 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-62cb2071-327e-4b72-9897-8e140e8492fb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:23.999738 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-62cb2071-327e-4b72-9897-8e140e8492fb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:24.129668 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-62cb2071-327e-4b72-9897-8e140e8492fb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:24.137784 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-62cb2071-327e-4b72-9897-8e140e8492fb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:24.139299 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-62cb2071-327e-4b72-9897-8e140e8492fb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:24.140728 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-62cb2071-327e-4b72-9897-8e140e8492fb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.153265 Dec 15 12:43:24.141503 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 286/570] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:23 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:24.241449 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7b50de97-0953-4691-bd87-2d280670b3ba tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:24.242014 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7b50de97-0953-4691-bd87-2d280670b3ba tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: 0066217c-9069-4dc5-8a29-14b22c285ff6] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:24.248459 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7b50de97-0953-4691-bd87-2d280670b3ba tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:24.248924 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7b50de97-0953-4691-bd87-2d280670b3ba tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:24.249896 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7b50de97-0953-4691-bd87-2d280670b3ba tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:24.250804 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7b50de97-0953-4691-bd87-2d280670b3ba tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:24.304404 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-998cfbcb-4f3e-41ae-b85f-f3fbc70486e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:24.305338 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-998cfbcb-4f3e-41ae-b85f-f3fbc70486e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:24.311727 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-998cfbcb-4f3e-41ae-b85f-f3fbc70486e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:24.312174 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-998cfbcb-4f3e-41ae-b85f-f3fbc70486e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:24.313683 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-998cfbcb-4f3e-41ae-b85f-f3fbc70486e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:24.314109 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-998cfbcb-4f3e-41ae-b85f-f3fbc70486e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:24.347534 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-998cfbcb-4f3e-41ae-b85f-f3fbc70486e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046964 Dec 15 12:43:24.348201 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 287/571] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:24 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:43:24.392258 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7b50de97-0953-4691-bd87-2d280670b3ba tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13d2fbbad43428b8e5637e6d86d93fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473ac1badd984fbeb2e27b1ac44b3d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:24.399673 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7b50de97-0953-4691-bd87-2d280670b3ba tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6" status: 200 len: 1313 microversion: 2.1 time: 0.161907 Dec 15 12:43:24.400248 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 285/572] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:43:24 2021] GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:43:24.494043 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-0628b291-c80e-4142-b1da-74e68d07c53c req-942b1390-53f3-4abb-b35f-41cc548928b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0066217c-9069-4dc5-8a29-14b22c285ff6", "name": "network-vif-plugged", "status": "completed", "tag": "c910ab73-3a86-47e4-b8cd-8874c1b57845"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:43:24.495580 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:43:24.495580 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 12:43:24.503952 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-0628b291-c80e-4142-b1da-74e68d07c53c req-942b1390-53f3-4abb-b35f-41cc548928b4 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:24.504399 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-0628b291-c80e-4142-b1da-74e68d07c53c req-942b1390-53f3-4abb-b35f-41cc548928b4 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:24.517169 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-0628b291-c80e-4142-b1da-74e68d07c53c req-942b1390-53f3-4abb-b35f-41cc548928b4 service nova] Creating event network-vif-plugged:c910ab73-3a86-47e4-b8cd-8874c1b57845 for instance 0066217c-9069-4dc5-8a29-14b22c285ff6 on hv-cinder-81322 Dec 15 12:43:24.522981 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-0628b291-c80e-4142-b1da-74e68d07c53c req-942b1390-53f3-4abb-b35f-41cc548928b4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032570 Dec 15 12:43:24.523576 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 288/573] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 12:43:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:25.159738 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fee519c4-1f6b-47d2-8207-f02d0a5bd8e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:25.160341 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fee519c4-1f6b-47d2-8207-f02d0a5bd8e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:25.166479 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fee519c4-1f6b-47d2-8207-f02d0a5bd8e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:25.166924 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fee519c4-1f6b-47d2-8207-f02d0a5bd8e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:25.167689 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fee519c4-1f6b-47d2-8207-f02d0a5bd8e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:25.168117 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fee519c4-1f6b-47d2-8207-f02d0a5bd8e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:25.310517 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fee519c4-1f6b-47d2-8207-f02d0a5bd8e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:25.318960 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fee519c4-1f6b-47d2-8207-f02d0a5bd8e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:25.320435 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fee519c4-1f6b-47d2-8207-f02d0a5bd8e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:25.321633 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fee519c4-1f6b-47d2-8207-f02d0a5bd8e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.165673 Dec 15 12:43:25.322187 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 286/574] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:25 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:25.360641 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-201adfe7-bf3f-4359-bacf-15bba258f392 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:25.361741 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-201adfe7-bf3f-4359-bacf-15bba258f392 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:25.368050 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-201adfe7-bf3f-4359-bacf-15bba258f392 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:25.368525 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-201adfe7-bf3f-4359-bacf-15bba258f392 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:25.369303 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-201adfe7-bf3f-4359-bacf-15bba258f392 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:25.369770 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-201adfe7-bf3f-4359-bacf-15bba258f392 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:25.401593 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-201adfe7-bf3f-4359-bacf-15bba258f392 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045704 Dec 15 12:43:25.402624 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 289/575] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:25 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:25.415862 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4a31a2bd-432a-490c-ba42-a90a92ecdd83 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:25.416444 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4a31a2bd-432a-490c-ba42-a90a92ecdd83 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: 0066217c-9069-4dc5-8a29-14b22c285ff6] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:25.423282 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a31a2bd-432a-490c-ba42-a90a92ecdd83 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:25.423722 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a31a2bd-432a-490c-ba42-a90a92ecdd83 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:25.424490 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a31a2bd-432a-490c-ba42-a90a92ecdd83 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:25.424918 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a31a2bd-432a-490c-ba42-a90a92ecdd83 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:25.565776 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4a31a2bd-432a-490c-ba42-a90a92ecdd83 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13d2fbbad43428b8e5637e6d86d93fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473ac1badd984fbeb2e27b1ac44b3d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:25.573000 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4a31a2bd-432a-490c-ba42-a90a92ecdd83 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6" status: 200 len: 1313 microversion: 2.1 time: 0.160807 Dec 15 12:43:25.573595 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 287/576] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:43:25 2021] GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:43:26.339783 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-867e3ac0-8085-48f1-8077-3a9682c0f1de tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:26.344940 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-867e3ac0-8085-48f1-8077-3a9682c0f1de tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:26.347016 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-867e3ac0-8085-48f1-8077-3a9682c0f1de tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:26.347478 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-867e3ac0-8085-48f1-8077-3a9682c0f1de tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:26.348280 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-867e3ac0-8085-48f1-8077-3a9682c0f1de tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:26.348714 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-867e3ac0-8085-48f1-8077-3a9682c0f1de tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:26.414362 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-afa5da81-85a2-4f07-a687-44c3371ddc62 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:26.415286 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-afa5da81-85a2-4f07-a687-44c3371ddc62 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:26.423229 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afa5da81-85a2-4f07-a687-44c3371ddc62 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:26.423717 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afa5da81-85a2-4f07-a687-44c3371ddc62 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:26.424532 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afa5da81-85a2-4f07-a687-44c3371ddc62 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:26.424969 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afa5da81-85a2-4f07-a687-44c3371ddc62 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:26.458189 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-afa5da81-85a2-4f07-a687-44c3371ddc62 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047476 Dec 15 12:43:26.458789 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 288/577] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:26 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:43:26.488918 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-867e3ac0-8085-48f1-8077-3a9682c0f1de tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:26.498135 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-867e3ac0-8085-48f1-8077-3a9682c0f1de tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:26.499636 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-867e3ac0-8085-48f1-8077-3a9682c0f1de tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:26.501410 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-867e3ac0-8085-48f1-8077-3a9682c0f1de tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.165499 Dec 15 12:43:26.502026 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 290/578] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:26 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:26.590322 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-96cf94d7-d264-4d43-84f3-1413615f5437 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:26.590839 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-96cf94d7-d264-4d43-84f3-1413615f5437 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: 0066217c-9069-4dc5-8a29-14b22c285ff6] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:26.599118 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-96cf94d7-d264-4d43-84f3-1413615f5437 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:26.599558 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-96cf94d7-d264-4d43-84f3-1413615f5437 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:26.600368 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-96cf94d7-d264-4d43-84f3-1413615f5437 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:26.600799 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-96cf94d7-d264-4d43-84f3-1413615f5437 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:26.734516 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-96cf94d7-d264-4d43-84f3-1413615f5437 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13d2fbbad43428b8e5637e6d86d93fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473ac1badd984fbeb2e27b1ac44b3d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:26.741855 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-96cf94d7-d264-4d43-84f3-1413615f5437 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6" status: 200 len: 1498 microversion: 2.1 time: 0.155240 Dec 15 12:43:26.742429 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 289/579] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:43:26 2021] GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6 => generated 1498 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:43:27.469799 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f7be66c4-46ef-4b17-9448-4619e2ae5bfc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:27.470750 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f7be66c4-46ef-4b17-9448-4619e2ae5bfc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:27.477132 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f7be66c4-46ef-4b17-9448-4619e2ae5bfc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:27.477641 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f7be66c4-46ef-4b17-9448-4619e2ae5bfc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:27.478462 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f7be66c4-46ef-4b17-9448-4619e2ae5bfc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:27.479017 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f7be66c4-46ef-4b17-9448-4619e2ae5bfc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:27.509968 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f7be66c4-46ef-4b17-9448-4619e2ae5bfc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044044 Dec 15 12:43:27.510713 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 291/580] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:27 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:27.520235 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e904f8ea-fb50-4939-b157-533692c17582 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:27.520847 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e904f8ea-fb50-4939-b157-533692c17582 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:27.526876 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e904f8ea-fb50-4939-b157-533692c17582 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:27.527323 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e904f8ea-fb50-4939-b157-533692c17582 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:27.528098 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e904f8ea-fb50-4939-b157-533692c17582 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:27.528531 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e904f8ea-fb50-4939-b157-533692c17582 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:27.671508 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e904f8ea-fb50-4939-b157-533692c17582 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:27.680077 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e904f8ea-fb50-4939-b157-533692c17582 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:27.681617 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e904f8ea-fb50-4939-b157-533692c17582 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:27.682782 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e904f8ea-fb50-4939-b157-533692c17582 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.167295 Dec 15 12:43:27.683340 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 290/581] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:27 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:28.528438 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-316884e7-f248-4e23-b7f3-a33c0ca92f7a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:28.529346 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-316884e7-f248-4e23-b7f3-a33c0ca92f7a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:28.536017 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-316884e7-f248-4e23-b7f3-a33c0ca92f7a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:28.536461 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-316884e7-f248-4e23-b7f3-a33c0ca92f7a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:28.537237 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-316884e7-f248-4e23-b7f3-a33c0ca92f7a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:28.537713 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-316884e7-f248-4e23-b7f3-a33c0ca92f7a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:28.566803 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-316884e7-f248-4e23-b7f3-a33c0ca92f7a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042073 Dec 15 12:43:28.567280 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 292/582] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:28 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:28.701307 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-05fbbca3-9c1d-406e-9f47-05ef34d6e77b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:28.701943 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-05fbbca3-9c1d-406e-9f47-05ef34d6e77b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:28.708491 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-05fbbca3-9c1d-406e-9f47-05ef34d6e77b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:28.708938 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-05fbbca3-9c1d-406e-9f47-05ef34d6e77b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:28.709756 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-05fbbca3-9c1d-406e-9f47-05ef34d6e77b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:28.710188 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-05fbbca3-9c1d-406e-9f47-05ef34d6e77b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:28.846986 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-05fbbca3-9c1d-406e-9f47-05ef34d6e77b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:28.855569 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-05fbbca3-9c1d-406e-9f47-05ef34d6e77b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:28.857064 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-05fbbca3-9c1d-406e-9f47-05ef34d6e77b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:28.858245 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-05fbbca3-9c1d-406e-9f47-05ef34d6e77b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.160643 Dec 15 12:43:28.858805 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 291/583] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:28 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:29.578210 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-93b0c6bc-15ff-4718-91f8-b5d08b7d91bf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:29.579061 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-93b0c6bc-15ff-4718-91f8-b5d08b7d91bf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:29.585412 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-93b0c6bc-15ff-4718-91f8-b5d08b7d91bf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:29.585896 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-93b0c6bc-15ff-4718-91f8-b5d08b7d91bf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:29.587081 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-93b0c6bc-15ff-4718-91f8-b5d08b7d91bf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:29.587842 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-93b0c6bc-15ff-4718-91f8-b5d08b7d91bf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:29.619964 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-93b0c6bc-15ff-4718-91f8-b5d08b7d91bf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045663 Dec 15 12:43:29.620545 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 293/584] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:29 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:29.878795 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5693e583-df61-4a73-855e-f5bc4e3b3888 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:29.879763 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5693e583-df61-4a73-855e-f5bc4e3b3888 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:29.887703 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5693e583-df61-4a73-855e-f5bc4e3b3888 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:29.888126 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5693e583-df61-4a73-855e-f5bc4e3b3888 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:29.888917 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5693e583-df61-4a73-855e-f5bc4e3b3888 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:29.890184 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5693e583-df61-4a73-855e-f5bc4e3b3888 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:30.046659 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5693e583-df61-4a73-855e-f5bc4e3b3888 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:30.054976 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5693e583-df61-4a73-855e-f5bc4e3b3888 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:30.056467 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5693e583-df61-4a73-855e-f5bc4e3b3888 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:30.057627 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5693e583-df61-4a73-855e-f5bc4e3b3888 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.184040 Dec 15 12:43:30.058185 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 292/585] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:29 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:30.631316 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d3d62e20-8ea7-49ae-afb1-7bb40ab788ac tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:30.632213 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d3d62e20-8ea7-49ae-afb1-7bb40ab788ac tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:30.638138 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d3d62e20-8ea7-49ae-afb1-7bb40ab788ac tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:30.638573 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d3d62e20-8ea7-49ae-afb1-7bb40ab788ac tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:30.639346 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d3d62e20-8ea7-49ae-afb1-7bb40ab788ac tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:30.639774 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d3d62e20-8ea7-49ae-afb1-7bb40ab788ac tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:30.672775 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d3d62e20-8ea7-49ae-afb1-7bb40ab788ac tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044898 Dec 15 12:43:30.673344 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 294/586] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:30 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:31.076523 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f1271ba5-a006-49f4-a4fe-a945b815ba33 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:31.077136 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f1271ba5-a006-49f4-a4fe-a945b815ba33 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:31.084070 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f1271ba5-a006-49f4-a4fe-a945b815ba33 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:31.084518 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f1271ba5-a006-49f4-a4fe-a945b815ba33 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:31.085301 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f1271ba5-a006-49f4-a4fe-a945b815ba33 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:31.085890 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f1271ba5-a006-49f4-a4fe-a945b815ba33 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:31.230345 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-f1271ba5-a006-49f4-a4fe-a945b815ba33 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:31.239624 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-f1271ba5-a006-49f4-a4fe-a945b815ba33 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:31.241119 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-f1271ba5-a006-49f4-a4fe-a945b815ba33 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:31.242336 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f1271ba5-a006-49f4-a4fe-a945b815ba33 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.169675 Dec 15 12:43:31.242899 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 293/587] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:31 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:31.684287 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0f240260-82f9-4834-b70b-91694138b248 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:31.685187 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0f240260-82f9-4834-b70b-91694138b248 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:31.692084 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0f240260-82f9-4834-b70b-91694138b248 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:31.692519 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0f240260-82f9-4834-b70b-91694138b248 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:31.693327 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0f240260-82f9-4834-b70b-91694138b248 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:31.693799 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0f240260-82f9-4834-b70b-91694138b248 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:31.724092 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0f240260-82f9-4834-b70b-91694138b248 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043441 Dec 15 12:43:31.724538 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 295/588] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:31 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:32.260293 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9fa8b082-f367-4110-a723-6385775b43aa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:32.260918 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9fa8b082-f367-4110-a723-6385775b43aa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:32.268704 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9fa8b082-f367-4110-a723-6385775b43aa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:32.269155 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9fa8b082-f367-4110-a723-6385775b43aa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:32.269993 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9fa8b082-f367-4110-a723-6385775b43aa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:32.270420 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9fa8b082-f367-4110-a723-6385775b43aa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:32.405884 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9fa8b082-f367-4110-a723-6385775b43aa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:32.414427 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9fa8b082-f367-4110-a723-6385775b43aa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:32.415926 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9fa8b082-f367-4110-a723-6385775b43aa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:32.419104 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9fa8b082-f367-4110-a723-6385775b43aa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.162364 Dec 15 12:43:32.419732 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 294/589] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:32 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:32.736567 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b8505d2d-4d13-4a26-a5dd-ed132ae85ef2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:32.737528 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b8505d2d-4d13-4a26-a5dd-ed132ae85ef2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:32.744113 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b8505d2d-4d13-4a26-a5dd-ed132ae85ef2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:32.744561 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b8505d2d-4d13-4a26-a5dd-ed132ae85ef2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:32.745357 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b8505d2d-4d13-4a26-a5dd-ed132ae85ef2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:32.746045 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b8505d2d-4d13-4a26-a5dd-ed132ae85ef2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:32.776405 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b8505d2d-4d13-4a26-a5dd-ed132ae85ef2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044556 Dec 15 12:43:32.776879 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 296/590] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:32 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:33.438013 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9d164cf7-71b0-4dd0-815d-f435e97fd3bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:33.438654 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9d164cf7-71b0-4dd0-815d-f435e97fd3bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:33.444911 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9d164cf7-71b0-4dd0-815d-f435e97fd3bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:33.445357 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9d164cf7-71b0-4dd0-815d-f435e97fd3bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:33.446183 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9d164cf7-71b0-4dd0-815d-f435e97fd3bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:33.446651 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9d164cf7-71b0-4dd0-815d-f435e97fd3bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:33.582867 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9d164cf7-71b0-4dd0-815d-f435e97fd3bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:33.591108 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9d164cf7-71b0-4dd0-815d-f435e97fd3bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:33.592633 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9d164cf7-71b0-4dd0-815d-f435e97fd3bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:33.594128 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9d164cf7-71b0-4dd0-815d-f435e97fd3bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.160091 Dec 15 12:43:33.594698 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 295/591] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:33 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:33.787997 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e6fd2725-b98b-4f0d-8f52-e32c432d2561 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:33.788812 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e6fd2725-b98b-4f0d-8f52-e32c432d2561 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:33.795027 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e6fd2725-b98b-4f0d-8f52-e32c432d2561 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:33.795469 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e6fd2725-b98b-4f0d-8f52-e32c432d2561 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:33.796246 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e6fd2725-b98b-4f0d-8f52-e32c432d2561 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:33.796821 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e6fd2725-b98b-4f0d-8f52-e32c432d2561 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:33.825821 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e6fd2725-b98b-4f0d-8f52-e32c432d2561 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041579 Dec 15 12:43:33.826371 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 297/592] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:33 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:34.612841 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7b19c4c7-f1b9-480d-a394-40eb4d601bf9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:34.613399 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7b19c4c7-f1b9-480d-a394-40eb4d601bf9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:34.620006 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7b19c4c7-f1b9-480d-a394-40eb4d601bf9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:34.620453 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7b19c4c7-f1b9-480d-a394-40eb4d601bf9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:34.621252 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7b19c4c7-f1b9-480d-a394-40eb4d601bf9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:34.621718 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7b19c4c7-f1b9-480d-a394-40eb4d601bf9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:34.757408 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7b19c4c7-f1b9-480d-a394-40eb4d601bf9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:34.766819 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7b19c4c7-f1b9-480d-a394-40eb4d601bf9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:34.768331 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7b19c4c7-f1b9-480d-a394-40eb4d601bf9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:34.769663 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7b19c4c7-f1b9-480d-a394-40eb4d601bf9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.161304 Dec 15 12:43:34.770261 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 296/593] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:34 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:34.838723 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-85ad66b1-bbcc-4266-b821-2a6486a04fb1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:34.839635 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-85ad66b1-bbcc-4266-b821-2a6486a04fb1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:34.846741 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-85ad66b1-bbcc-4266-b821-2a6486a04fb1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:34.847190 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-85ad66b1-bbcc-4266-b821-2a6486a04fb1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:34.847977 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-85ad66b1-bbcc-4266-b821-2a6486a04fb1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:34.848412 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-85ad66b1-bbcc-4266-b821-2a6486a04fb1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:34.877540 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-85ad66b1-bbcc-4266-b821-2a6486a04fb1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042733 Dec 15 12:43:34.878065 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 298/594] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:34 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:43:35.789145 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-83b225fc-4427-4142-9de7-d6efbd58a0c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:35.789963 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-83b225fc-4427-4142-9de7-d6efbd58a0c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:35.796311 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-83b225fc-4427-4142-9de7-d6efbd58a0c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:35.797338 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-83b225fc-4427-4142-9de7-d6efbd58a0c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:35.798152 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-83b225fc-4427-4142-9de7-d6efbd58a0c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:35.798593 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-83b225fc-4427-4142-9de7-d6efbd58a0c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:35.888640 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-48d269d8-072a-4801-823e-a84006418600 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:35.889556 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-48d269d8-072a-4801-823e-a84006418600 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:35.895467 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-48d269d8-072a-4801-823e-a84006418600 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:35.895916 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-48d269d8-072a-4801-823e-a84006418600 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:35.896702 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-48d269d8-072a-4801-823e-a84006418600 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:35.897139 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-48d269d8-072a-4801-823e-a84006418600 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:35.929656 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-48d269d8-072a-4801-823e-a84006418600 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045009 Dec 15 12:43:35.930258 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 299/595] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:35 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:43:35.938330 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-83b225fc-4427-4142-9de7-d6efbd58a0c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:35.946528 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-83b225fc-4427-4142-9de7-d6efbd58a0c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:35.948015 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-83b225fc-4427-4142-9de7-d6efbd58a0c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:35.949198 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-83b225fc-4427-4142-9de7-d6efbd58a0c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.164743 Dec 15 12:43:35.949750 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 297/596] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:35 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:36.940944 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-935c27cc-ed05-4ee9-b92c-b9abc8fd9628 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:36.941871 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-935c27cc-ed05-4ee9-b92c-b9abc8fd9628 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:36.948161 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-935c27cc-ed05-4ee9-b92c-b9abc8fd9628 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:36.948597 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-935c27cc-ed05-4ee9-b92c-b9abc8fd9628 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:36.949390 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-935c27cc-ed05-4ee9-b92c-b9abc8fd9628 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:36.949848 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-935c27cc-ed05-4ee9-b92c-b9abc8fd9628 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:36.967860 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-84b32480-f804-4f9c-9fdc-c4537cc0d209 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:36.968473 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-84b32480-f804-4f9c-9fdc-c4537cc0d209 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:36.974800 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-84b32480-f804-4f9c-9fdc-c4537cc0d209 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:36.975253 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-84b32480-f804-4f9c-9fdc-c4537cc0d209 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:36.976043 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-84b32480-f804-4f9c-9fdc-c4537cc0d209 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:36.976480 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-84b32480-f804-4f9c-9fdc-c4537cc0d209 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:36.980613 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-935c27cc-ed05-4ee9-b92c-b9abc8fd9628 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044158 Dec 15 12:43:36.981364 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 300/597] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:36 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:37.113543 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-84b32480-f804-4f9c-9fdc-c4537cc0d209 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:37.122731 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-84b32480-f804-4f9c-9fdc-c4537cc0d209 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:37.124288 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-84b32480-f804-4f9c-9fdc-c4537cc0d209 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:37.126314 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-84b32480-f804-4f9c-9fdc-c4537cc0d209 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.162149 Dec 15 12:43:37.126869 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 298/598] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:36 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:43:37.992663 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-21b53b55-be2f-4829-91bd-6f3d86ae3099 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:37.993599 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-21b53b55-be2f-4829-91bd-6f3d86ae3099 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:38.002269 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-21b53b55-be2f-4829-91bd-6f3d86ae3099 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:38.002718 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-21b53b55-be2f-4829-91bd-6f3d86ae3099 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:38.003529 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-21b53b55-be2f-4829-91bd-6f3d86ae3099 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:38.004222 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-21b53b55-be2f-4829-91bd-6f3d86ae3099 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:38.035316 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-21b53b55-be2f-4829-91bd-6f3d86ae3099 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046365 Dec 15 12:43:38.035877 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 301/599] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:37 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:38.145827 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e1f3f469-b5cd-4201-89af-1f695dffbe2f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:38.146435 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e1f3f469-b5cd-4201-89af-1f695dffbe2f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:38.152659 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e1f3f469-b5cd-4201-89af-1f695dffbe2f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:38.153116 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e1f3f469-b5cd-4201-89af-1f695dffbe2f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:38.153997 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e1f3f469-b5cd-4201-89af-1f695dffbe2f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:38.154424 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e1f3f469-b5cd-4201-89af-1f695dffbe2f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:38.290274 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e1f3f469-b5cd-4201-89af-1f695dffbe2f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:38.298973 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e1f3f469-b5cd-4201-89af-1f695dffbe2f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:38.300451 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e1f3f469-b5cd-4201-89af-1f695dffbe2f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:38.301684 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e1f3f469-b5cd-4201-89af-1f695dffbe2f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.159484 Dec 15 12:43:38.302184 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 299/600] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:38 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:39.047692 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b652b2f5-3f42-459b-9e7d-152a0b89188d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:39.048604 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b652b2f5-3f42-459b-9e7d-152a0b89188d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:39.054915 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b652b2f5-3f42-459b-9e7d-152a0b89188d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:39.055363 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b652b2f5-3f42-459b-9e7d-152a0b89188d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:39.056150 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b652b2f5-3f42-459b-9e7d-152a0b89188d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:39.056590 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b652b2f5-3f42-459b-9e7d-152a0b89188d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:39.087099 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b652b2f5-3f42-459b-9e7d-152a0b89188d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043234 Dec 15 12:43:39.087664 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 302/601] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:39 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:39.326739 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-855f8559-c0e2-4384-9ed3-1fac3f5b3039 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:39.327381 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-855f8559-c0e2-4384-9ed3-1fac3f5b3039 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:39.334080 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-855f8559-c0e2-4384-9ed3-1fac3f5b3039 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:39.334515 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-855f8559-c0e2-4384-9ed3-1fac3f5b3039 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:39.335277 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-855f8559-c0e2-4384-9ed3-1fac3f5b3039 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:39.335702 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-855f8559-c0e2-4384-9ed3-1fac3f5b3039 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:39.474334 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-855f8559-c0e2-4384-9ed3-1fac3f5b3039 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:39.482662 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-855f8559-c0e2-4384-9ed3-1fac3f5b3039 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:39.484636 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-855f8559-c0e2-4384-9ed3-1fac3f5b3039 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:39.485814 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-855f8559-c0e2-4384-9ed3-1fac3f5b3039 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.162710 Dec 15 12:43:39.486371 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 300/602] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:39 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:40.099944 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-41daa03f-5989-4572-b1f1-28eef3b74703 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:40.100860 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-41daa03f-5989-4572-b1f1-28eef3b74703 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:40.108519 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-41daa03f-5989-4572-b1f1-28eef3b74703 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:40.108974 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-41daa03f-5989-4572-b1f1-28eef3b74703 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:40.109798 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-41daa03f-5989-4572-b1f1-28eef3b74703 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:40.110238 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-41daa03f-5989-4572-b1f1-28eef3b74703 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:40.139571 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-41daa03f-5989-4572-b1f1-28eef3b74703 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044026 Dec 15 12:43:40.140641 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 303/603] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:40 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:40.503913 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d6626953-66e1-4d72-81a0-82af84c32048 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:40.504504 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d6626953-66e1-4d72-81a0-82af84c32048 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:40.510911 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d6626953-66e1-4d72-81a0-82af84c32048 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:40.511356 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d6626953-66e1-4d72-81a0-82af84c32048 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:40.512132 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d6626953-66e1-4d72-81a0-82af84c32048 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:40.512564 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d6626953-66e1-4d72-81a0-82af84c32048 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:40.644034 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d6626953-66e1-4d72-81a0-82af84c32048 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:40.660897 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d6626953-66e1-4d72-81a0-82af84c32048 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:40.662435 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d6626953-66e1-4d72-81a0-82af84c32048 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:40.663641 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d6626953-66e1-4d72-81a0-82af84c32048 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.163909 Dec 15 12:43:40.664215 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 301/604] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:40 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:41.151742 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-75d98794-f930-41e7-b029-dc63cc5aef8d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:41.152649 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-75d98794-f930-41e7-b029-dc63cc5aef8d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:41.159039 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-75d98794-f930-41e7-b029-dc63cc5aef8d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:41.159492 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-75d98794-f930-41e7-b029-dc63cc5aef8d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:41.160273 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-75d98794-f930-41e7-b029-dc63cc5aef8d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:41.160711 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-75d98794-f930-41e7-b029-dc63cc5aef8d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:41.197658 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-75d98794-f930-41e7-b029-dc63cc5aef8d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049702 Dec 15 12:43:41.198220 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 304/605] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:41 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:41.681978 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b0ba6bf9-ffcd-4376-aac6-2702cc3c838c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:41.682622 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b0ba6bf9-ffcd-4376-aac6-2702cc3c838c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:41.689615 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b0ba6bf9-ffcd-4376-aac6-2702cc3c838c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:41.690063 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b0ba6bf9-ffcd-4376-aac6-2702cc3c838c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:41.690849 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b0ba6bf9-ffcd-4376-aac6-2702cc3c838c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:41.691283 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b0ba6bf9-ffcd-4376-aac6-2702cc3c838c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:41.826135 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b0ba6bf9-ffcd-4376-aac6-2702cc3c838c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:41.834626 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b0ba6bf9-ffcd-4376-aac6-2702cc3c838c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:41.836242 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b0ba6bf9-ffcd-4376-aac6-2702cc3c838c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:41.837377 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b0ba6bf9-ffcd-4376-aac6-2702cc3c838c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.159147 Dec 15 12:43:41.837977 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 302/606] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:41 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:42.209552 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-cfc50401-9500-4f04-a081-04827919af0b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:42.210500 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-cfc50401-9500-4f04-a081-04827919af0b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:42.216997 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cfc50401-9500-4f04-a081-04827919af0b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:42.217447 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cfc50401-9500-4f04-a081-04827919af0b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:42.218938 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cfc50401-9500-4f04-a081-04827919af0b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:42.219387 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cfc50401-9500-4f04-a081-04827919af0b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:42.248098 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-cfc50401-9500-4f04-a081-04827919af0b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042301 Dec 15 12:43:42.248654 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 305/607] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:42 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:42.856410 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c051e3b2-87a7-44fc-8dea-6b581c6a82a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:42.856998 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c051e3b2-87a7-44fc-8dea-6b581c6a82a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:42.863444 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c051e3b2-87a7-44fc-8dea-6b581c6a82a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:42.863919 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c051e3b2-87a7-44fc-8dea-6b581c6a82a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:42.864679 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c051e3b2-87a7-44fc-8dea-6b581c6a82a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:42.865106 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c051e3b2-87a7-44fc-8dea-6b581c6a82a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:43.000846 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c051e3b2-87a7-44fc-8dea-6b581c6a82a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:43.009895 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c051e3b2-87a7-44fc-8dea-6b581c6a82a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:43.011389 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c051e3b2-87a7-44fc-8dea-6b581c6a82a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:43.012546 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c051e3b2-87a7-44fc-8dea-6b581c6a82a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.159975 Dec 15 12:43:43.013108 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 303/608] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:42 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:43:43.260175 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-124f93da-8aa8-4275-871b-61b0b4598997 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:43.261211 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-124f93da-8aa8-4275-871b-61b0b4598997 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:43.268880 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-124f93da-8aa8-4275-871b-61b0b4598997 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:43.269320 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-124f93da-8aa8-4275-871b-61b0b4598997 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:43.270138 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-124f93da-8aa8-4275-871b-61b0b4598997 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:43.270568 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-124f93da-8aa8-4275-871b-61b0b4598997 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:43.300546 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-124f93da-8aa8-4275-871b-61b0b4598997 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044229 Dec 15 12:43:43.301137 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 306/609] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:43 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:44.031694 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1950e458-7e03-48f2-a30a-b1b2dd8d35e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:44.032307 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1950e458-7e03-48f2-a30a-b1b2dd8d35e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:44.038895 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1950e458-7e03-48f2-a30a-b1b2dd8d35e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:44.039338 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1950e458-7e03-48f2-a30a-b1b2dd8d35e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:44.040140 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1950e458-7e03-48f2-a30a-b1b2dd8d35e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:44.040577 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1950e458-7e03-48f2-a30a-b1b2dd8d35e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:44.180680 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1950e458-7e03-48f2-a30a-b1b2dd8d35e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:44.189553 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1950e458-7e03-48f2-a30a-b1b2dd8d35e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:44.191056 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1950e458-7e03-48f2-a30a-b1b2dd8d35e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:44.192213 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1950e458-7e03-48f2-a30a-b1b2dd8d35e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.165051 Dec 15 12:43:44.192774 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 304/610] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:44 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:44.312384 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-17096a31-5e97-46c8-a28a-600a2113c0cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:44.313473 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-17096a31-5e97-46c8-a28a-600a2113c0cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:44.320012 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-17096a31-5e97-46c8-a28a-600a2113c0cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:44.320458 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-17096a31-5e97-46c8-a28a-600a2113c0cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:44.321232 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-17096a31-5e97-46c8-a28a-600a2113c0cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:44.321701 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-17096a31-5e97-46c8-a28a-600a2113c0cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:44.350494 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-17096a31-5e97-46c8-a28a-600a2113c0cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042241 Dec 15 12:43:44.351077 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 307/611] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:44 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:45.210602 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-149282a4-e6c3-4541-acab-34d560dce106 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:45.211265 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-149282a4-e6c3-4541-acab-34d560dce106 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:45.217463 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-149282a4-e6c3-4541-acab-34d560dce106 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:45.217941 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-149282a4-e6c3-4541-acab-34d560dce106 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:45.219352 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-149282a4-e6c3-4541-acab-34d560dce106 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:45.219783 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-149282a4-e6c3-4541-acab-34d560dce106 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:45.357026 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-149282a4-e6c3-4541-acab-34d560dce106 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:45.362080 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c3c8f605-b9db-4ca8-af25-1cf9093d6d8e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:45.362983 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c3c8f605-b9db-4ca8-af25-1cf9093d6d8e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:45.365526 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-149282a4-e6c3-4541-acab-34d560dce106 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:45.367015 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-149282a4-e6c3-4541-acab-34d560dce106 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:45.368174 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-149282a4-e6c3-4541-acab-34d560dce106 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.161320 Dec 15 12:43:45.368741 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 305/612] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:45 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:45.369076 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c3c8f605-b9db-4ca8-af25-1cf9093d6d8e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:45.369529 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c3c8f605-b9db-4ca8-af25-1cf9093d6d8e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:45.370332 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c3c8f605-b9db-4ca8-af25-1cf9093d6d8e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:45.370763 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c3c8f605-b9db-4ca8-af25-1cf9093d6d8e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:45.401949 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c3c8f605-b9db-4ca8-af25-1cf9093d6d8e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043724 Dec 15 12:43:45.402714 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 308/613] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:45 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:43:46.386604 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7fb5fda5-5dae-4099-b7cd-3971e7f2abc4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:46.387203 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7fb5fda5-5dae-4099-b7cd-3971e7f2abc4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:46.394214 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7fb5fda5-5dae-4099-b7cd-3971e7f2abc4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:46.394660 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7fb5fda5-5dae-4099-b7cd-3971e7f2abc4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:46.395435 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7fb5fda5-5dae-4099-b7cd-3971e7f2abc4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:46.395868 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7fb5fda5-5dae-4099-b7cd-3971e7f2abc4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:46.414035 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9c604aaa-85f2-41c6-97a1-41a4b7e986af tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:46.414934 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9c604aaa-85f2-41c6-97a1-41a4b7e986af tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:46.421849 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9c604aaa-85f2-41c6-97a1-41a4b7e986af tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:46.422300 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9c604aaa-85f2-41c6-97a1-41a4b7e986af tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:46.423093 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9c604aaa-85f2-41c6-97a1-41a4b7e986af tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:46.423529 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9c604aaa-85f2-41c6-97a1-41a4b7e986af tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:46.461643 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9c604aaa-85f2-41c6-97a1-41a4b7e986af tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051341 Dec 15 12:43:46.462211 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 309/614] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:46 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:43:46.529632 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7fb5fda5-5dae-4099-b7cd-3971e7f2abc4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:46.538502 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7fb5fda5-5dae-4099-b7cd-3971e7f2abc4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:46.540077 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7fb5fda5-5dae-4099-b7cd-3971e7f2abc4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:46.541269 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7fb5fda5-5dae-4099-b7cd-3971e7f2abc4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.158396 Dec 15 12:43:46.541877 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 306/615] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:46 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:47.473198 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7feb839a-7966-4654-9ed1-0e88525d8666 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:47.474133 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7feb839a-7966-4654-9ed1-0e88525d8666 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:47.480771 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7feb839a-7966-4654-9ed1-0e88525d8666 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:47.481232 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7feb839a-7966-4654-9ed1-0e88525d8666 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:47.482115 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7feb839a-7966-4654-9ed1-0e88525d8666 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:47.482559 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7feb839a-7966-4654-9ed1-0e88525d8666 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:47.511804 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7feb839a-7966-4654-9ed1-0e88525d8666 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042288 Dec 15 12:43:47.512476 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 310/616] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:47 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:47.559421 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-74f1120b-7e5e-4505-8690-d6d7482730bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:47.559950 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-74f1120b-7e5e-4505-8690-d6d7482730bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:47.566338 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-74f1120b-7e5e-4505-8690-d6d7482730bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:47.566790 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-74f1120b-7e5e-4505-8690-d6d7482730bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:47.567568 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-74f1120b-7e5e-4505-8690-d6d7482730bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:47.568001 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-74f1120b-7e5e-4505-8690-d6d7482730bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:47.710630 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-74f1120b-7e5e-4505-8690-d6d7482730bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:47.719090 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-74f1120b-7e5e-4505-8690-d6d7482730bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:47.720574 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-74f1120b-7e5e-4505-8690-d6d7482730bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:47.721765 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-74f1120b-7e5e-4505-8690-d6d7482730bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.166138 Dec 15 12:43:47.722333 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 307/617] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:47 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:48.523788 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-80357e04-e2b4-49ba-a1d1-f9b902b3358a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:48.524793 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-80357e04-e2b4-49ba-a1d1-f9b902b3358a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:48.532167 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-80357e04-e2b4-49ba-a1d1-f9b902b3358a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:48.532680 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-80357e04-e2b4-49ba-a1d1-f9b902b3358a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:48.533476 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-80357e04-e2b4-49ba-a1d1-f9b902b3358a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:48.533947 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-80357e04-e2b4-49ba-a1d1-f9b902b3358a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:48.563032 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-80357e04-e2b4-49ba-a1d1-f9b902b3358a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042786 Dec 15 12:43:48.563498 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 311/618] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:48 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:48.740548 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e80ca087-e1a7-4569-894a-73b6d50cacc8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:48.741201 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e80ca087-e1a7-4569-894a-73b6d50cacc8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:48.747548 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e80ca087-e1a7-4569-894a-73b6d50cacc8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:48.747984 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e80ca087-e1a7-4569-894a-73b6d50cacc8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:48.748756 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e80ca087-e1a7-4569-894a-73b6d50cacc8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:48.749180 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e80ca087-e1a7-4569-894a-73b6d50cacc8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:48.881499 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e80ca087-e1a7-4569-894a-73b6d50cacc8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:48.893662 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e80ca087-e1a7-4569-894a-73b6d50cacc8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:48.895179 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e80ca087-e1a7-4569-894a-73b6d50cacc8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:48.896509 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e80ca087-e1a7-4569-894a-73b6d50cacc8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.159836 Dec 15 12:43:48.897099 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 308/619] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:48 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:49.574565 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-349ee43d-d78c-4217-aa5e-3be584ecd736 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:49.575410 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-349ee43d-d78c-4217-aa5e-3be584ecd736 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:49.582597 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-349ee43d-d78c-4217-aa5e-3be584ecd736 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:49.583071 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-349ee43d-d78c-4217-aa5e-3be584ecd736 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:49.583841 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-349ee43d-d78c-4217-aa5e-3be584ecd736 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:49.584278 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-349ee43d-d78c-4217-aa5e-3be584ecd736 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:49.612586 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-349ee43d-d78c-4217-aa5e-3be584ecd736 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041966 Dec 15 12:43:49.613137 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 312/620] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:49 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:49.915245 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-11b8b05b-4116-4a09-a031-ee85126f3fad tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:49.915823 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-11b8b05b-4116-4a09-a031-ee85126f3fad tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:49.922800 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-11b8b05b-4116-4a09-a031-ee85126f3fad tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:49.923261 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-11b8b05b-4116-4a09-a031-ee85126f3fad tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:49.924036 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-11b8b05b-4116-4a09-a031-ee85126f3fad tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:49.924470 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-11b8b05b-4116-4a09-a031-ee85126f3fad tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:50.059107 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-11b8b05b-4116-4a09-a031-ee85126f3fad tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:50.067354 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-11b8b05b-4116-4a09-a031-ee85126f3fad tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:50.068847 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-11b8b05b-4116-4a09-a031-ee85126f3fad tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:50.070029 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-11b8b05b-4116-4a09-a031-ee85126f3fad tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.158498 Dec 15 12:43:50.071255 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 309/621] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:49 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:50.624308 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0668ff39-fddb-4d83-9638-bfaced560d5b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:50.625261 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0668ff39-fddb-4d83-9638-bfaced560d5b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:50.631846 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0668ff39-fddb-4d83-9638-bfaced560d5b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:50.632297 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0668ff39-fddb-4d83-9638-bfaced560d5b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:50.633082 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0668ff39-fddb-4d83-9638-bfaced560d5b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:50.633528 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0668ff39-fddb-4d83-9638-bfaced560d5b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:50.670730 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0668ff39-fddb-4d83-9638-bfaced560d5b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050193 Dec 15 12:43:50.671389 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 313/622] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:50 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:51.091679 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-929cc3e7-4fb3-4dbc-8a3c-5adf691bde48 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:51.092814 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-929cc3e7-4fb3-4dbc-8a3c-5adf691bde48 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:51.103580 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-929cc3e7-4fb3-4dbc-8a3c-5adf691bde48 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:51.104372 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-929cc3e7-4fb3-4dbc-8a3c-5adf691bde48 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:51.105766 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-929cc3e7-4fb3-4dbc-8a3c-5adf691bde48 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:51.106151 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-929cc3e7-4fb3-4dbc-8a3c-5adf691bde48 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:51.239990 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-929cc3e7-4fb3-4dbc-8a3c-5adf691bde48 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:51.248189 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-929cc3e7-4fb3-4dbc-8a3c-5adf691bde48 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:51.250294 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-929cc3e7-4fb3-4dbc-8a3c-5adf691bde48 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:51.251576 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-929cc3e7-4fb3-4dbc-8a3c-5adf691bde48 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.166623 Dec 15 12:43:51.252139 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 310/623] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:51 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:51.682997 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c98bb9c3-940a-4fab-85fc-be046b212730 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:51.683967 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c98bb9c3-940a-4fab-85fc-be046b212730 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:51.690798 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c98bb9c3-940a-4fab-85fc-be046b212730 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:51.691248 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c98bb9c3-940a-4fab-85fc-be046b212730 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:51.692042 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c98bb9c3-940a-4fab-85fc-be046b212730 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:51.692481 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c98bb9c3-940a-4fab-85fc-be046b212730 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:51.728730 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c98bb9c3-940a-4fab-85fc-be046b212730 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049545 Dec 15 12:43:51.729291 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 314/624] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:51 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:52.271230 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1c544992-9c27-4e73-806a-2600837578f5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:52.271827 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1c544992-9c27-4e73-806a-2600837578f5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:52.278279 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1c544992-9c27-4e73-806a-2600837578f5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:52.278709 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1c544992-9c27-4e73-806a-2600837578f5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:52.279491 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1c544992-9c27-4e73-806a-2600837578f5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:52.279913 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1c544992-9c27-4e73-806a-2600837578f5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:52.414811 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1c544992-9c27-4e73-806a-2600837578f5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:52.423049 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1c544992-9c27-4e73-806a-2600837578f5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:52.424604 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1c544992-9c27-4e73-806a-2600837578f5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:52.425894 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1c544992-9c27-4e73-806a-2600837578f5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.158359 Dec 15 12:43:52.426460 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 311/625] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:52 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:52.740738 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bf80c302-0159-4bbc-96de-2870f7c7ab08 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:52.741673 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bf80c302-0159-4bbc-96de-2870f7c7ab08 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:52.748759 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bf80c302-0159-4bbc-96de-2870f7c7ab08 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:52.750069 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bf80c302-0159-4bbc-96de-2870f7c7ab08 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:52.751382 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bf80c302-0159-4bbc-96de-2870f7c7ab08 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:52.752048 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bf80c302-0159-4bbc-96de-2870f7c7ab08 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:52.782448 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bf80c302-0159-4bbc-96de-2870f7c7ab08 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045492 Dec 15 12:43:52.783036 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 315/626] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:52 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:53.444321 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6b57be5f-b6cd-4bf9-9d27-c0d578caaf6a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:53.444922 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6b57be5f-b6cd-4bf9-9d27-c0d578caaf6a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:53.451189 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6b57be5f-b6cd-4bf9-9d27-c0d578caaf6a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:53.451632 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6b57be5f-b6cd-4bf9-9d27-c0d578caaf6a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:53.452909 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6b57be5f-b6cd-4bf9-9d27-c0d578caaf6a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:53.453340 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6b57be5f-b6cd-4bf9-9d27-c0d578caaf6a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:53.585747 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6b57be5f-b6cd-4bf9-9d27-c0d578caaf6a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:53.595487 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6b57be5f-b6cd-4bf9-9d27-c0d578caaf6a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:53.596998 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6b57be5f-b6cd-4bf9-9d27-c0d578caaf6a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:53.598180 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6b57be5f-b6cd-4bf9-9d27-c0d578caaf6a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.157768 Dec 15 12:43:53.598737 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 312/627] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:53 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:53.794115 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d46d92ef-d72b-48e5-bf7f-8d253ad46a8c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:53.795059 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d46d92ef-d72b-48e5-bf7f-8d253ad46a8c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:53.801635 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d46d92ef-d72b-48e5-bf7f-8d253ad46a8c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:53.802088 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d46d92ef-d72b-48e5-bf7f-8d253ad46a8c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:53.802885 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d46d92ef-d72b-48e5-bf7f-8d253ad46a8c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:53.803323 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d46d92ef-d72b-48e5-bf7f-8d253ad46a8c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:53.832890 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d46d92ef-d72b-48e5-bf7f-8d253ad46a8c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042650 Dec 15 12:43:53.833497 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 316/628] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:53 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:54.616230 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1c374c78-2757-414e-9a83-e2afa450921f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:54.616770 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1c374c78-2757-414e-9a83-e2afa450921f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:54.623201 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1c374c78-2757-414e-9a83-e2afa450921f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:54.623637 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1c374c78-2757-414e-9a83-e2afa450921f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:54.624956 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1c374c78-2757-414e-9a83-e2afa450921f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:54.625743 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1c374c78-2757-414e-9a83-e2afa450921f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:54.761008 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1c374c78-2757-414e-9a83-e2afa450921f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:54.769880 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1c374c78-2757-414e-9a83-e2afa450921f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:54.771385 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1c374c78-2757-414e-9a83-e2afa450921f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:54.772547 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1c374c78-2757-414e-9a83-e2afa450921f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.160037 Dec 15 12:43:54.773106 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 313/629] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:54 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:54.845077 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-56f720cf-7a62-4133-b9bf-57976be9f3e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:54.846017 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-56f720cf-7a62-4133-b9bf-57976be9f3e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:54.852534 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-56f720cf-7a62-4133-b9bf-57976be9f3e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:54.852976 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-56f720cf-7a62-4133-b9bf-57976be9f3e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:54.853781 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-56f720cf-7a62-4133-b9bf-57976be9f3e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:54.854208 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-56f720cf-7a62-4133-b9bf-57976be9f3e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:54.886654 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-56f720cf-7a62-4133-b9bf-57976be9f3e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045451 Dec 15 12:43:54.887753 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 317/630] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:54 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:55.791854 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-463834f9-4d81-4af1-b04c-d19b3e154511 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:55.792458 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-463834f9-4d81-4af1-b04c-d19b3e154511 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:55.798936 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-463834f9-4d81-4af1-b04c-d19b3e154511 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:55.799381 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-463834f9-4d81-4af1-b04c-d19b3e154511 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:55.800154 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-463834f9-4d81-4af1-b04c-d19b3e154511 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:55.800588 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-463834f9-4d81-4af1-b04c-d19b3e154511 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:55.899722 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ffa592eb-c5bc-41dd-b840-5b661d7e4bd5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:55.900628 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ffa592eb-c5bc-41dd-b840-5b661d7e4bd5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:55.907545 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ffa592eb-c5bc-41dd-b840-5b661d7e4bd5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:55.907996 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ffa592eb-c5bc-41dd-b840-5b661d7e4bd5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:55.908785 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ffa592eb-c5bc-41dd-b840-5b661d7e4bd5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:55.909216 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ffa592eb-c5bc-41dd-b840-5b661d7e4bd5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:55.933431 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-463834f9-4d81-4af1-b04c-d19b3e154511 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:55.939882 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ffa592eb-c5bc-41dd-b840-5b661d7e4bd5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043812 Dec 15 12:43:55.940452 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 318/631] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:55 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:43:55.941702 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-463834f9-4d81-4af1-b04c-d19b3e154511 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:55.943187 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-463834f9-4d81-4af1-b04c-d19b3e154511 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:55.944335 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-463834f9-4d81-4af1-b04c-d19b3e154511 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.156245 Dec 15 12:43:55.944882 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 314/632] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:55 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:56.951281 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1e983cc0-f926-4b94-99a6-db5083c29c0a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:56.952246 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1e983cc0-f926-4b94-99a6-db5083c29c0a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:56.959350 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1e983cc0-f926-4b94-99a6-db5083c29c0a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:56.959786 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1e983cc0-f926-4b94-99a6-db5083c29c0a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:56.960615 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1e983cc0-f926-4b94-99a6-db5083c29c0a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:56.961060 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1e983cc0-f926-4b94-99a6-db5083c29c0a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:56.962189 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-82e6cbb4-9716-45ff-9c63-4177858a7f97 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:56.962812 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-82e6cbb4-9716-45ff-9c63-4177858a7f97 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:56.970906 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-82e6cbb4-9716-45ff-9c63-4177858a7f97 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:56.971672 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-82e6cbb4-9716-45ff-9c63-4177858a7f97 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:56.972459 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-82e6cbb4-9716-45ff-9c63-4177858a7f97 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:56.972892 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-82e6cbb4-9716-45ff-9c63-4177858a7f97 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:56.995554 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1e983cc0-f926-4b94-99a6-db5083c29c0a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047920 Dec 15 12:43:56.996425 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 319/633] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:56 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:57.113813 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-82e6cbb4-9716-45ff-9c63-4177858a7f97 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:57.122500 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-82e6cbb4-9716-45ff-9c63-4177858a7f97 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:57.124030 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-82e6cbb4-9716-45ff-9c63-4177858a7f97 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:57.125310 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-82e6cbb4-9716-45ff-9c63-4177858a7f97 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.166833 Dec 15 12:43:57.125904 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 315/634] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:56 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:43:58.008891 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d1998713-e893-463f-8f62-e7128aaf93be tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:58.010426 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d1998713-e893-463f-8f62-e7128aaf93be tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:58.018659 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d1998713-e893-463f-8f62-e7128aaf93be tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:58.019158 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d1998713-e893-463f-8f62-e7128aaf93be tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:58.020053 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d1998713-e893-463f-8f62-e7128aaf93be tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:58.020565 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d1998713-e893-463f-8f62-e7128aaf93be tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:58.054516 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d1998713-e893-463f-8f62-e7128aaf93be tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050587 Dec 15 12:43:58.055092 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 320/635] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:58 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:43:58.144487 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e0db1059-3650-47f8-9978-75bd92a80f3f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:58.145098 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e0db1059-3650-47f8-9978-75bd92a80f3f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:58.151156 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0db1059-3650-47f8-9978-75bd92a80f3f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:58.151714 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0db1059-3650-47f8-9978-75bd92a80f3f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:58.152366 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0db1059-3650-47f8-9978-75bd92a80f3f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:58.152852 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0db1059-3650-47f8-9978-75bd92a80f3f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:58.286813 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e0db1059-3650-47f8-9978-75bd92a80f3f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:58.295245 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e0db1059-3650-47f8-9978-75bd92a80f3f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:58.296814 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e0db1059-3650-47f8-9978-75bd92a80f3f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:58.298056 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e0db1059-3650-47f8-9978-75bd92a80f3f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.157401 Dec 15 12:43:58.298593 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 316/636] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:58 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:43:59.067561 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d306c1f2-ceb9-4b6b-955d-abb346036a00 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:59.068491 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d306c1f2-ceb9-4b6b-955d-abb346036a00 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:59.074721 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d306c1f2-ceb9-4b6b-955d-abb346036a00 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:59.075167 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d306c1f2-ceb9-4b6b-955d-abb346036a00 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:59.075950 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d306c1f2-ceb9-4b6b-955d-abb346036a00 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:59.076386 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d306c1f2-ceb9-4b6b-955d-abb346036a00 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:59.106147 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d306c1f2-ceb9-4b6b-955d-abb346036a00 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042305 Dec 15 12:43:59.106734 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 321/637] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:43:59 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:43:59.316167 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8e5070a9-f3c2-4a7f-b52f-f3d1f7f2c0f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:43:59.316756 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8e5070a9-f3c2-4a7f-b52f-f3d1f7f2c0f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:43:59.323276 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8e5070a9-f3c2-4a7f-b52f-f3d1f7f2c0f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:59.323653 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8e5070a9-f3c2-4a7f-b52f-f3d1f7f2c0f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:59.324413 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8e5070a9-f3c2-4a7f-b52f-f3d1f7f2c0f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:43:59.324838 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8e5070a9-f3c2-4a7f-b52f-f3d1f7f2c0f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:43:59.459604 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8e5070a9-f3c2-4a7f-b52f-f3d1f7f2c0f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:59.469349 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8e5070a9-f3c2-4a7f-b52f-f3d1f7f2c0f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:59.470912 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8e5070a9-f3c2-4a7f-b52f-f3d1f7f2c0f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:43:59.472065 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8e5070a9-f3c2-4a7f-b52f-f3d1f7f2c0f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.159676 Dec 15 12:43:59.472628 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 317/638] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:43:59 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:00.119155 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-78b64662-8f2f-4931-a6ff-6d22e50f2c42 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:00.120068 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-78b64662-8f2f-4931-a6ff-6d22e50f2c42 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:00.126672 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-78b64662-8f2f-4931-a6ff-6d22e50f2c42 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:00.127111 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-78b64662-8f2f-4931-a6ff-6d22e50f2c42 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:00.127892 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-78b64662-8f2f-4931-a6ff-6d22e50f2c42 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:00.128319 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-78b64662-8f2f-4931-a6ff-6d22e50f2c42 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:00.158707 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-78b64662-8f2f-4931-a6ff-6d22e50f2c42 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044172 Dec 15 12:44:00.159265 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 322/639] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:00 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:00.490606 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2773aa37-af00-4bf7-8a62-7d4ac55bf4d0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:00.491245 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2773aa37-af00-4bf7-8a62-7d4ac55bf4d0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:00.497717 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2773aa37-af00-4bf7-8a62-7d4ac55bf4d0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:00.498165 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2773aa37-af00-4bf7-8a62-7d4ac55bf4d0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:00.498946 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2773aa37-af00-4bf7-8a62-7d4ac55bf4d0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:00.499971 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2773aa37-af00-4bf7-8a62-7d4ac55bf4d0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:00.643783 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2773aa37-af00-4bf7-8a62-7d4ac55bf4d0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:00.647861 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2773aa37-af00-4bf7-8a62-7d4ac55bf4d0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:00.649336 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2773aa37-af00-4bf7-8a62-7d4ac55bf4d0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:00.650523 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2773aa37-af00-4bf7-8a62-7d4ac55bf4d0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.163657 Dec 15 12:44:00.651080 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 318/640] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:00 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:01.170292 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-60c94132-3556-411c-85b1-9d2b7387a2f9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:01.171286 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-60c94132-3556-411c-85b1-9d2b7387a2f9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:01.177607 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-60c94132-3556-411c-85b1-9d2b7387a2f9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:01.178061 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-60c94132-3556-411c-85b1-9d2b7387a2f9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:01.178846 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-60c94132-3556-411c-85b1-9d2b7387a2f9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:01.179283 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-60c94132-3556-411c-85b1-9d2b7387a2f9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:01.209068 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-60c94132-3556-411c-85b1-9d2b7387a2f9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042517 Dec 15 12:44:01.209724 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 323/641] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:01 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:01.669605 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1aa1daba-0e01-4e74-91b8-25eee6c59b08 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:01.670219 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1aa1daba-0e01-4e74-91b8-25eee6c59b08 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:01.677103 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1aa1daba-0e01-4e74-91b8-25eee6c59b08 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:01.677580 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1aa1daba-0e01-4e74-91b8-25eee6c59b08 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:01.678369 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1aa1daba-0e01-4e74-91b8-25eee6c59b08 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:01.678804 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1aa1daba-0e01-4e74-91b8-25eee6c59b08 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:01.823986 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1aa1daba-0e01-4e74-91b8-25eee6c59b08 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:01.832245 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1aa1daba-0e01-4e74-91b8-25eee6c59b08 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:01.833762 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1aa1daba-0e01-4e74-91b8-25eee6c59b08 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:01.834912 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1aa1daba-0e01-4e74-91b8-25eee6c59b08 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.169112 Dec 15 12:44:01.835485 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 319/642] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:01 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:02.221193 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f287f0ea-b62d-4118-9174-db09b5866e7a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:02.222141 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f287f0ea-b62d-4118-9174-db09b5866e7a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:02.228740 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f287f0ea-b62d-4118-9174-db09b5866e7a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:02.229198 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f287f0ea-b62d-4118-9174-db09b5866e7a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:02.230072 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f287f0ea-b62d-4118-9174-db09b5866e7a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:02.230541 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f287f0ea-b62d-4118-9174-db09b5866e7a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:02.260513 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f287f0ea-b62d-4118-9174-db09b5866e7a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043741 Dec 15 12:44:02.261078 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 324/643] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:02 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:02.852875 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a1b6de5e-70e9-4d1e-a1af-341356d4335f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:02.853534 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a1b6de5e-70e9-4d1e-a1af-341356d4335f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:02.860236 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1b6de5e-70e9-4d1e-a1af-341356d4335f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:02.860682 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1b6de5e-70e9-4d1e-a1af-341356d4335f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:02.861474 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1b6de5e-70e9-4d1e-a1af-341356d4335f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:02.861936 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1b6de5e-70e9-4d1e-a1af-341356d4335f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:03.001003 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a1b6de5e-70e9-4d1e-a1af-341356d4335f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:03.010067 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a1b6de5e-70e9-4d1e-a1af-341356d4335f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:03.011626 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a1b6de5e-70e9-4d1e-a1af-341356d4335f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:03.012858 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a1b6de5e-70e9-4d1e-a1af-341356d4335f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.163768 Dec 15 12:44:03.013425 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 320/644] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:02 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:03.272217 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-51246f6f-52c2-4da8-b5f4-29dcf7a93924 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:03.273265 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-51246f6f-52c2-4da8-b5f4-29dcf7a93924 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:03.279823 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-51246f6f-52c2-4da8-b5f4-29dcf7a93924 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:03.280477 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-51246f6f-52c2-4da8-b5f4-29dcf7a93924 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:03.281204 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-51246f6f-52c2-4da8-b5f4-29dcf7a93924 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:03.281661 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-51246f6f-52c2-4da8-b5f4-29dcf7a93924 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:03.312495 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-51246f6f-52c2-4da8-b5f4-29dcf7a93924 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043540 Dec 15 12:44:03.313060 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 325/645] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:03 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:04.031562 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1aeaa714-a3b0-4fcb-9036-8023cca76548 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:04.032152 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1aeaa714-a3b0-4fcb-9036-8023cca76548 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:04.038137 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1aeaa714-a3b0-4fcb-9036-8023cca76548 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:04.038584 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1aeaa714-a3b0-4fcb-9036-8023cca76548 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:04.039364 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1aeaa714-a3b0-4fcb-9036-8023cca76548 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:04.039795 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1aeaa714-a3b0-4fcb-9036-8023cca76548 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:04.179546 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1aeaa714-a3b0-4fcb-9036-8023cca76548 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:04.187803 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1aeaa714-a3b0-4fcb-9036-8023cca76548 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:04.189304 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1aeaa714-a3b0-4fcb-9036-8023cca76548 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:04.190497 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1aeaa714-a3b0-4fcb-9036-8023cca76548 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.163376 Dec 15 12:44:04.191063 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 321/646] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:04 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:04.324137 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c0f6b42a-0fc6-47b5-8cff-43e9de19ea97 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:04.325065 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c0f6b42a-0fc6-47b5-8cff-43e9de19ea97 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:04.331986 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c0f6b42a-0fc6-47b5-8cff-43e9de19ea97 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:04.332432 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c0f6b42a-0fc6-47b5-8cff-43e9de19ea97 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:04.333204 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c0f6b42a-0fc6-47b5-8cff-43e9de19ea97 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:04.333764 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c0f6b42a-0fc6-47b5-8cff-43e9de19ea97 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:04.362357 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c0f6b42a-0fc6-47b5-8cff-43e9de19ea97 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041914 Dec 15 12:44:04.362962 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 326/647] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:04 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:05.208463 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b913578c-c471-46a2-b649-6867acf685ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:05.209069 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b913578c-c471-46a2-b649-6867acf685ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:05.215413 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b913578c-c471-46a2-b649-6867acf685ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:05.215857 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b913578c-c471-46a2-b649-6867acf685ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:05.216628 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b913578c-c471-46a2-b649-6867acf685ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:05.217059 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b913578c-c471-46a2-b649-6867acf685ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:05.354950 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b913578c-c471-46a2-b649-6867acf685ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:05.364045 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b913578c-c471-46a2-b649-6867acf685ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:05.365543 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b913578c-c471-46a2-b649-6867acf685ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:05.366695 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b913578c-c471-46a2-b649-6867acf685ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.161952 Dec 15 12:44:05.367280 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 322/648] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:05 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:05.373397 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b55a0251-b249-4e60-a6c7-39083c5a9429 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:05.374427 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b55a0251-b249-4e60-a6c7-39083c5a9429 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:05.380857 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b55a0251-b249-4e60-a6c7-39083c5a9429 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:05.381311 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b55a0251-b249-4e60-a6c7-39083c5a9429 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:05.382306 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b55a0251-b249-4e60-a6c7-39083c5a9429 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:05.382750 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b55a0251-b249-4e60-a6c7-39083c5a9429 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:05.413623 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b55a0251-b249-4e60-a6c7-39083c5a9429 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043972 Dec 15 12:44:05.414185 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 327/649] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:05 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:06.384921 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f5b68b8d-23b8-47a1-9ef1-2c8217cf3730 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:06.385543 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f5b68b8d-23b8-47a1-9ef1-2c8217cf3730 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:06.392663 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f5b68b8d-23b8-47a1-9ef1-2c8217cf3730 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:06.393100 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f5b68b8d-23b8-47a1-9ef1-2c8217cf3730 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:06.394057 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f5b68b8d-23b8-47a1-9ef1-2c8217cf3730 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:06.394483 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f5b68b8d-23b8-47a1-9ef1-2c8217cf3730 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:06.425336 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7a68518d-7003-450a-beaa-d6a041da04dd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:06.426782 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7a68518d-7003-450a-beaa-d6a041da04dd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:06.435009 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7a68518d-7003-450a-beaa-d6a041da04dd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:06.435692 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7a68518d-7003-450a-beaa-d6a041da04dd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:06.436906 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7a68518d-7003-450a-beaa-d6a041da04dd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:06.437616 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7a68518d-7003-450a-beaa-d6a041da04dd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:06.475571 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7a68518d-7003-450a-beaa-d6a041da04dd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054578 Dec 15 12:44:06.476903 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 328/650] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:06 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:44:06.527397 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-f5b68b8d-23b8-47a1-9ef1-2c8217cf3730 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:06.536280 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-f5b68b8d-23b8-47a1-9ef1-2c8217cf3730 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:06.537808 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-f5b68b8d-23b8-47a1-9ef1-2c8217cf3730 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:06.538966 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f5b68b8d-23b8-47a1-9ef1-2c8217cf3730 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.157774 Dec 15 12:44:06.539529 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 323/651] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:06 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:07.486583 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a9ede5bc-0899-442a-8d3c-590fde036cbc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:07.487512 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a9ede5bc-0899-442a-8d3c-590fde036cbc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:07.494499 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a9ede5bc-0899-442a-8d3c-590fde036cbc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:07.494971 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a9ede5bc-0899-442a-8d3c-590fde036cbc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:07.495763 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a9ede5bc-0899-442a-8d3c-590fde036cbc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:07.496196 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a9ede5bc-0899-442a-8d3c-590fde036cbc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:07.524623 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a9ede5bc-0899-442a-8d3c-590fde036cbc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042837 Dec 15 12:44:07.525178 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 329/652] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:07 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:07.557286 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bf030fca-3116-42cc-b7e1-6ee1ed0d025f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:07.557900 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bf030fca-3116-42cc-b7e1-6ee1ed0d025f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:07.564217 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bf030fca-3116-42cc-b7e1-6ee1ed0d025f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:07.564666 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bf030fca-3116-42cc-b7e1-6ee1ed0d025f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:07.565443 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bf030fca-3116-42cc-b7e1-6ee1ed0d025f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:07.565912 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bf030fca-3116-42cc-b7e1-6ee1ed0d025f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:07.698458 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bf030fca-3116-42cc-b7e1-6ee1ed0d025f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:07.707856 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bf030fca-3116-42cc-b7e1-6ee1ed0d025f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:07.709350 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bf030fca-3116-42cc-b7e1-6ee1ed0d025f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:07.710589 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bf030fca-3116-42cc-b7e1-6ee1ed0d025f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.157139 Dec 15 12:44:07.711155 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 324/653] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:07 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:08.536273 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b5415043-b68f-49df-a8bb-5e9b1c4a6e6a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:08.537783 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b5415043-b68f-49df-a8bb-5e9b1c4a6e6a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:08.544247 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5415043-b68f-49df-a8bb-5e9b1c4a6e6a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:08.544694 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5415043-b68f-49df-a8bb-5e9b1c4a6e6a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:08.545489 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5415043-b68f-49df-a8bb-5e9b1c4a6e6a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:08.546760 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5415043-b68f-49df-a8bb-5e9b1c4a6e6a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:08.575732 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b5415043-b68f-49df-a8bb-5e9b1c4a6e6a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043371 Dec 15 12:44:08.576291 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 330/654] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:08 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:08.728809 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d4098e95-1f1d-4886-8880-207e2f56a92a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:08.729400 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d4098e95-1f1d-4886-8880-207e2f56a92a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:08.736575 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d4098e95-1f1d-4886-8880-207e2f56a92a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:08.737021 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d4098e95-1f1d-4886-8880-207e2f56a92a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:08.737837 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d4098e95-1f1d-4886-8880-207e2f56a92a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:08.738265 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d4098e95-1f1d-4886-8880-207e2f56a92a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:08.890198 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d4098e95-1f1d-4886-8880-207e2f56a92a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:08.899238 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d4098e95-1f1d-4886-8880-207e2f56a92a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:08.900828 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d4098e95-1f1d-4886-8880-207e2f56a92a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:08.902034 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d4098e95-1f1d-4886-8880-207e2f56a92a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.177197 Dec 15 12:44:08.902791 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 325/655] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:08 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:09.586918 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d5e4c54c-bd57-4760-b331-7d52a5ccc8d4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:09.587817 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d5e4c54c-bd57-4760-b331-7d52a5ccc8d4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:09.595386 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d5e4c54c-bd57-4760-b331-7d52a5ccc8d4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:09.595830 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d5e4c54c-bd57-4760-b331-7d52a5ccc8d4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:09.596629 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d5e4c54c-bd57-4760-b331-7d52a5ccc8d4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:09.597061 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d5e4c54c-bd57-4760-b331-7d52a5ccc8d4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:09.628065 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d5e4c54c-bd57-4760-b331-7d52a5ccc8d4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044863 Dec 15 12:44:09.628622 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 331/656] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:09 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:09.925854 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-05461e56-7b2b-40d1-b64b-6641c7b5250e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:09.926475 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-05461e56-7b2b-40d1-b64b-6641c7b5250e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:09.932801 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-05461e56-7b2b-40d1-b64b-6641c7b5250e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:09.933247 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-05461e56-7b2b-40d1-b64b-6641c7b5250e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:09.934047 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-05461e56-7b2b-40d1-b64b-6641c7b5250e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:09.934477 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-05461e56-7b2b-40d1-b64b-6641c7b5250e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:10.067759 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-05461e56-7b2b-40d1-b64b-6641c7b5250e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:10.076602 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-05461e56-7b2b-40d1-b64b-6641c7b5250e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:10.078121 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-05461e56-7b2b-40d1-b64b-6641c7b5250e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:10.079285 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-05461e56-7b2b-40d1-b64b-6641c7b5250e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.157175 Dec 15 12:44:10.079851 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 326/657] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:09 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:10.640386 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-621ce96f-86a5-44ef-bf87-cbc983d1bf89 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:10.641320 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-621ce96f-86a5-44ef-bf87-cbc983d1bf89 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:10.648171 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-621ce96f-86a5-44ef-bf87-cbc983d1bf89 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:10.648623 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-621ce96f-86a5-44ef-bf87-cbc983d1bf89 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:10.649431 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-621ce96f-86a5-44ef-bf87-cbc983d1bf89 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:10.649895 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-621ce96f-86a5-44ef-bf87-cbc983d1bf89 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:10.680646 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-621ce96f-86a5-44ef-bf87-cbc983d1bf89 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044666 Dec 15 12:44:10.681219 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 332/658] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:10 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:11.097434 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d76c280e-17e3-4a51-9501-af84f694030e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:11.098041 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d76c280e-17e3-4a51-9501-af84f694030e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:11.104438 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d76c280e-17e3-4a51-9501-af84f694030e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:11.104880 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d76c280e-17e3-4a51-9501-af84f694030e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:11.105696 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d76c280e-17e3-4a51-9501-af84f694030e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:11.106129 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d76c280e-17e3-4a51-9501-af84f694030e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:11.243278 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d76c280e-17e3-4a51-9501-af84f694030e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:11.251938 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d76c280e-17e3-4a51-9501-af84f694030e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:11.253419 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d76c280e-17e3-4a51-9501-af84f694030e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:11.255825 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d76c280e-17e3-4a51-9501-af84f694030e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.162156 Dec 15 12:44:11.256391 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 327/659] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:11 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:11.693008 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d4fd3257-9ac9-4fd4-9f51-7179e7655558 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:11.693930 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d4fd3257-9ac9-4fd4-9f51-7179e7655558 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:11.700144 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d4fd3257-9ac9-4fd4-9f51-7179e7655558 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:11.700581 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d4fd3257-9ac9-4fd4-9f51-7179e7655558 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:11.701352 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d4fd3257-9ac9-4fd4-9f51-7179e7655558 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:11.701876 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d4fd3257-9ac9-4fd4-9f51-7179e7655558 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:11.732094 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d4fd3257-9ac9-4fd4-9f51-7179e7655558 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042783 Dec 15 12:44:11.732824 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 333/660] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:11 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:44:11.932814 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4bd2be98-6e94-4d5a-95f2-ec36d154ef24 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:11.933312 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4bd2be98-6e94-4d5a-95f2-ec36d154ef24 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: 0066217c-9069-4dc5-8a29-14b22c285ff6] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:11.939062 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4bd2be98-6e94-4d5a-95f2-ec36d154ef24 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:11.939506 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4bd2be98-6e94-4d5a-95f2-ec36d154ef24 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:11.940286 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4bd2be98-6e94-4d5a-95f2-ec36d154ef24 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:11.940721 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4bd2be98-6e94-4d5a-95f2-ec36d154ef24 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:11.966108 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4bd2be98-6e94-4d5a-95f2-ec36d154ef24 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: 0066217c-9069-4dc5-8a29-14b22c285ff6] Going to try to terminate instance {{(pid=122615) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 12:44:12.060865 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4bd2be98-6e94-4d5a-95f2-ec36d154ef24 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "DELETE /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6" status: 204 len: 0 microversion: 2.1 time: 0.131417 Dec 15 12:44:12.061712 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 328/661] 10.222.0.76 () {58 vars in 1238 bytes} [Wed Dec 15 12:44:11 2021] DELETE /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 12:44:12.070513 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c0cacaa8-e273-48f5-b861-eb09706e8d9c tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:12.071884 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c0cacaa8-e273-48f5-b861-eb09706e8d9c tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: 0066217c-9069-4dc5-8a29-14b22c285ff6] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:12.078164 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c0cacaa8-e273-48f5-b861-eb09706e8d9c tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:12.078844 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c0cacaa8-e273-48f5-b861-eb09706e8d9c tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:12.079648 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c0cacaa8-e273-48f5-b861-eb09706e8d9c tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:12.080089 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c0cacaa8-e273-48f5-b861-eb09706e8d9c tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:12.201304 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e68e4df8-507e-438c-9e09-24fb51387bbc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:12.201939 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e68e4df8-507e-438c-9e09-24fb51387bbc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:12.208946 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e68e4df8-507e-438c-9e09-24fb51387bbc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:12.209404 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e68e4df8-507e-438c-9e09-24fb51387bbc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:12.210325 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e68e4df8-507e-438c-9e09-24fb51387bbc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:12.210766 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e68e4df8-507e-438c-9e09-24fb51387bbc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:12.226423 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c0cacaa8-e273-48f5-b861-eb09706e8d9c tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13d2fbbad43428b8e5637e6d86d93fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473ac1badd984fbeb2e27b1ac44b3d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:12.234155 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c0cacaa8-e273-48f5-b861-eb09706e8d9c tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6" status: 200 len: 1504 microversion: 2.1 time: 0.167678 Dec 15 12:44:12.234752 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 334/662] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:44:12 2021] GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:44:12.274960 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b3a0977a-ce62-4f43-afb1-72480e9904ab tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:12.276019 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b3a0977a-ce62-4f43-afb1-72480e9904ab tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:12.281914 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b3a0977a-ce62-4f43-afb1-72480e9904ab tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:12.282440 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b3a0977a-ce62-4f43-afb1-72480e9904ab tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:12.283302 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b3a0977a-ce62-4f43-afb1-72480e9904ab tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:12.283846 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b3a0977a-ce62-4f43-afb1-72480e9904ab tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:12.300801 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.objects.instance [None req-e68e4df8-507e-438c-9e09-24fb51387bbc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lazy-loading 'services' on Instance uuid af14627f-65d9-46ce-9fea-d9c7c74c0ef3 {{(pid=122615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 12:44:12.378117 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e68e4df8-507e-438c-9e09-24fb51387bbc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "DELETE /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments/ee0b2570-eef1-4bfc-af8f-6c7ed6bfbacb" status: 202 len: 0 microversion: 2.1 time: 0.180553 Dec 15 12:44:12.378730 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 329/663] 10.222.0.76 () {58 vars in 1415 bytes} [Wed Dec 15 12:44:12 2021] DELETE /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments/ee0b2570-eef1-4bfc-af8f-6c7ed6bfbacb => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 12:44:12.390212 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e2b9cdde-e5ad-498f-8ec9-aacfc0c363b6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:12.391685 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e2b9cdde-e5ad-498f-8ec9-aacfc0c363b6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:12.398285 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e2b9cdde-e5ad-498f-8ec9-aacfc0c363b6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:12.399079 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e2b9cdde-e5ad-498f-8ec9-aacfc0c363b6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:12.399929 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e2b9cdde-e5ad-498f-8ec9-aacfc0c363b6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:12.400321 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e2b9cdde-e5ad-498f-8ec9-aacfc0c363b6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:12.433193 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e2b9cdde-e5ad-498f-8ec9-aacfc0c363b6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049408 Dec 15 12:44:12.433813 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 330/664] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:12 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:44:12.437904 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b3a0977a-ce62-4f43-afb1-72480e9904ab tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:12.446740 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b3a0977a-ce62-4f43-afb1-72480e9904ab tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:12.448218 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b3a0977a-ce62-4f43-afb1-72480e9904ab tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:12.449517 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b3a0977a-ce62-4f43-afb1-72480e9904ab tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.178200 Dec 15 12:44:12.450078 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 335/665] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:12 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:44:12.744246 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2c9c828a-8ff0-4549-a69f-361b5148de7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:12.745157 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2c9c828a-8ff0-4549-a69f-361b5148de7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:12.751130 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2c9c828a-8ff0-4549-a69f-361b5148de7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:12.751578 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2c9c828a-8ff0-4549-a69f-361b5148de7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:12.752357 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2c9c828a-8ff0-4549-a69f-361b5148de7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:12.752791 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2c9c828a-8ff0-4549-a69f-361b5148de7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:12.781550 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2c9c828a-8ff0-4549-a69f-361b5148de7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041013 Dec 15 12:44:12.782112 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 331/666] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:12 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:13.251481 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f8bf4179-2564-4f77-80cb-d471f647c5b0 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:13.252089 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f8bf4179-2564-4f77-80cb-d471f647c5b0 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: 0066217c-9069-4dc5-8a29-14b22c285ff6] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:13.259405 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f8bf4179-2564-4f77-80cb-d471f647c5b0 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:13.259846 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f8bf4179-2564-4f77-80cb-d471f647c5b0 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:13.260745 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f8bf4179-2564-4f77-80cb-d471f647c5b0 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:13.261182 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f8bf4179-2564-4f77-80cb-d471f647c5b0 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:13.392819 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f8bf4179-2564-4f77-80cb-d471f647c5b0 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13d2fbbad43428b8e5637e6d86d93fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473ac1badd984fbeb2e27b1ac44b3d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:13.399989 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f8bf4179-2564-4f77-80cb-d471f647c5b0 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6" status: 200 len: 1504 microversion: 2.1 time: 0.152186 Dec 15 12:44:13.400560 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 336/667] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:44:13 2021] GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:44:13.445382 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-aeb1cd08-b788-4cd2-9b74-967c3ab14539 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:13.446355 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-aeb1cd08-b788-4cd2-9b74-967c3ab14539 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:13.453586 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aeb1cd08-b788-4cd2-9b74-967c3ab14539 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:13.454039 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aeb1cd08-b788-4cd2-9b74-967c3ab14539 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:13.454819 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aeb1cd08-b788-4cd2-9b74-967c3ab14539 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:13.455252 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aeb1cd08-b788-4cd2-9b74-967c3ab14539 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:13.468377 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9a4b0f32-ee0b-4204-8bec-b47c7e2623b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:13.469012 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9a4b0f32-ee0b-4204-8bec-b47c7e2623b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:13.475167 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9a4b0f32-ee0b-4204-8bec-b47c7e2623b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:13.475620 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9a4b0f32-ee0b-4204-8bec-b47c7e2623b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:13.476451 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9a4b0f32-ee0b-4204-8bec-b47c7e2623b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:13.476886 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9a4b0f32-ee0b-4204-8bec-b47c7e2623b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:13.485847 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-aeb1cd08-b788-4cd2-9b74-967c3ab14539 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044185 Dec 15 12:44:13.486428 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 332/668] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:13 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:13.612730 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9a4b0f32-ee0b-4204-8bec-b47c7e2623b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:13.621061 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9a4b0f32-ee0b-4204-8bec-b47c7e2623b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:13.622811 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9a4b0f32-ee0b-4204-8bec-b47c7e2623b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:13.624993 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9a4b0f32-ee0b-4204-8bec-b47c7e2623b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.159873 Dec 15 12:44:13.625609 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 337/669] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:13 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:44:13.800254 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f02e0906-c8a3-4114-8ac3-be24f4572f89 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:13.801278 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f02e0906-c8a3-4114-8ac3-be24f4572f89 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:13.807265 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f02e0906-c8a3-4114-8ac3-be24f4572f89 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:13.807648 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f02e0906-c8a3-4114-8ac3-be24f4572f89 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:13.808426 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f02e0906-c8a3-4114-8ac3-be24f4572f89 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:13.808859 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f02e0906-c8a3-4114-8ac3-be24f4572f89 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:13.839327 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f02e0906-c8a3-4114-8ac3-be24f4572f89 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043566 Dec 15 12:44:13.840268 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 333/670] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:13 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:14.229665 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-37d63d8e-d38f-4c81-baee-d90f77120c48 req-a8c216de-40ee-4118-aa99-ecee61920771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0066217c-9069-4dc5-8a29-14b22c285ff6", "name": "network-vif-deleted", "tag": "c910ab73-3a86-47e4-b8cd-8874c1b57845"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:44:14.231246 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:44:14.231246 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 12:44:14.238969 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-37d63d8e-d38f-4c81-baee-d90f77120c48 req-a8c216de-40ee-4118-aa99-ecee61920771 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:14.239515 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-37d63d8e-d38f-4c81-baee-d90f77120c48 req-a8c216de-40ee-4118-aa99-ecee61920771 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:14.251626 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-37d63d8e-d38f-4c81-baee-d90f77120c48 req-a8c216de-40ee-4118-aa99-ecee61920771 service nova] Creating event network-vif-deleted:c910ab73-3a86-47e4-b8cd-8874c1b57845 for instance 0066217c-9069-4dc5-8a29-14b22c285ff6 on hv-cinder-81322 Dec 15 12:44:14.257533 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-37d63d8e-d38f-4c81-baee-d90f77120c48 req-a8c216de-40ee-4118-aa99-ecee61920771 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031517 Dec 15 12:44:14.258154 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 338/671] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 12:44:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:14.417007 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bfccb588-abb2-4577-a860-6666a8c9c41d tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:14.417656 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bfccb588-abb2-4577-a860-6666a8c9c41d tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: 0066217c-9069-4dc5-8a29-14b22c285ff6] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:14.424289 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bfccb588-abb2-4577-a860-6666a8c9c41d tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:14.424737 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bfccb588-abb2-4577-a860-6666a8c9c41d tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:14.425616 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bfccb588-abb2-4577-a860-6666a8c9c41d tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:14.426050 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bfccb588-abb2-4577-a860-6666a8c9c41d tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:14.456448 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bfccb588-abb2-4577-a860-6666a8c9c41d tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:14.457098 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bfccb588-abb2-4577-a860-6666a8c9c41d tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:14.457319 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.objects.instance [None req-bfccb588-abb2-4577-a860-6666a8c9c41d tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lazy-loading 'fault' on Instance uuid 0066217c-9069-4dc5-8a29-14b22c285ff6 {{(pid=122615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 12:44:14.496934 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bfccb588-abb2-4577-a860-6666a8c9c41d tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c13d2fbbad43428b8e5637e6d86d93fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473ac1badd984fbeb2e27b1ac44b3d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:14.497863 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-70c5c182-0248-4601-a9e1-00621e02da7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:14.498856 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-70c5c182-0248-4601-a9e1-00621e02da7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:14.505413 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bfccb588-abb2-4577-a860-6666a8c9c41d tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6" status: 200 len: 1303 microversion: 2.1 time: 0.092100 Dec 15 12:44:14.505895 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-70c5c182-0248-4601-a9e1-00621e02da7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:14.506017 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 334/672] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:44:14 2021] GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:44:14.506338 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-70c5c182-0248-4601-a9e1-00621e02da7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:14.507169 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-70c5c182-0248-4601-a9e1-00621e02da7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:14.507550 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-70c5c182-0248-4601-a9e1-00621e02da7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:14.537906 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-70c5c182-0248-4601-a9e1-00621e02da7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044172 Dec 15 12:44:14.538455 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 339/673] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:14 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:44:14.644451 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7aeb3aff-cd8d-4013-a32b-be8eba36814e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:14.645054 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7aeb3aff-cd8d-4013-a32b-be8eba36814e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:14.651165 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7aeb3aff-cd8d-4013-a32b-be8eba36814e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:14.651600 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7aeb3aff-cd8d-4013-a32b-be8eba36814e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:14.652376 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7aeb3aff-cd8d-4013-a32b-be8eba36814e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:14.652806 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7aeb3aff-cd8d-4013-a32b-be8eba36814e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:14.798693 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7aeb3aff-cd8d-4013-a32b-be8eba36814e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:14.808608 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7aeb3aff-cd8d-4013-a32b-be8eba36814e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:14.810126 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7aeb3aff-cd8d-4013-a32b-be8eba36814e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:14.811363 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7aeb3aff-cd8d-4013-a32b-be8eba36814e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.171015 Dec 15 12:44:14.820526 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 335/674] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:14 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:14.850750 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ea33a491-a559-4095-b29e-a74989536951 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:14.851673 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ea33a491-a559-4095-b29e-a74989536951 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:14.857561 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea33a491-a559-4095-b29e-a74989536951 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:14.858007 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea33a491-a559-4095-b29e-a74989536951 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:14.859378 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea33a491-a559-4095-b29e-a74989536951 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:14.859803 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea33a491-a559-4095-b29e-a74989536951 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:14.889435 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ea33a491-a559-4095-b29e-a74989536951 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042409 Dec 15 12:44:14.890091 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 340/675] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:14 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:15.522926 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1e074b43-5dc5-4f1c-82de-0094d752c3e6 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:15.523539 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1e074b43-5dc5-4f1c-82de-0094d752c3e6 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] [instance: 0066217c-9069-4dc5-8a29-14b22c285ff6] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:15.529926 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1e074b43-5dc5-4f1c-82de-0094d752c3e6 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:15.531158 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1e074b43-5dc5-4f1c-82de-0094d752c3e6 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:15.532011 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1e074b43-5dc5-4f1c-82de-0094d752c3e6 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:15.532444 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1e074b43-5dc5-4f1c-82de-0094d752c3e6 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:15.546209 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.wsgi [None req-1e074b43-5dc5-4f1c-82de-0094d752c3e6 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] HTTP exception thrown: Instance 0066217c-9069-4dc5-8a29-14b22c285ff6 could not be found. Dec 15 12:44:15.546953 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1e074b43-5dc5-4f1c-82de-0094d752c3e6 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] Returning 404 to user: Instance 0066217c-9069-4dc5-8a29-14b22c285ff6 could not be found. {{(pid=122615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:44:15.547802 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1e074b43-5dc5-4f1c-82de-0094d752c3e6 tempest-VolumesActionsTest-1216141119 tempest-VolumesActionsTest-1216141119-project] 10.222.0.76 "GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6" status: 404 len: 111 microversion: 2.1 time: 0.028599 Dec 15 12:44:15.548372 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 336/676] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:44:15 2021] GET /compute/v2.1/servers/0066217c-9069-4dc5-8a29-14b22c285ff6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 12:44:15.549396 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3dd14a6d-0b70-4104-8b51-b93ad44043fc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:15.550381 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3dd14a6d-0b70-4104-8b51-b93ad44043fc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:15.564608 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3dd14a6d-0b70-4104-8b51-b93ad44043fc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:15.565071 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3dd14a6d-0b70-4104-8b51-b93ad44043fc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:15.565931 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3dd14a6d-0b70-4104-8b51-b93ad44043fc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:15.566364 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3dd14a6d-0b70-4104-8b51-b93ad44043fc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:15.597621 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3dd14a6d-0b70-4104-8b51-b93ad44043fc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052073 Dec 15 12:44:15.599292 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 341/677] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:15 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:44:15.831180 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a91aba47-5910-4d19-9f8a-6f45d7718f7a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:15.831778 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a91aba47-5910-4d19-9f8a-6f45d7718f7a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:15.840546 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a91aba47-5910-4d19-9f8a-6f45d7718f7a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:15.841152 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a91aba47-5910-4d19-9f8a-6f45d7718f7a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:15.842184 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a91aba47-5910-4d19-9f8a-6f45d7718f7a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:15.842619 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a91aba47-5910-4d19-9f8a-6f45d7718f7a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:15.901218 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a4a032d8-930e-4263-befa-41dd7890a194 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:15.902156 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a4a032d8-930e-4263-befa-41dd7890a194 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:15.909212 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a4a032d8-930e-4263-befa-41dd7890a194 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:15.909612 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a4a032d8-930e-4263-befa-41dd7890a194 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:15.910344 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a4a032d8-930e-4263-befa-41dd7890a194 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:15.910889 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a4a032d8-930e-4263-befa-41dd7890a194 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:15.944229 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a4a032d8-930e-4263-befa-41dd7890a194 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046623 Dec 15 12:44:15.945030 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 342/678] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:15 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:44:16.005570 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a91aba47-5910-4d19-9f8a-6f45d7718f7a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:16.013728 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a91aba47-5910-4d19-9f8a-6f45d7718f7a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:16.015269 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a91aba47-5910-4d19-9f8a-6f45d7718f7a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:16.016434 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a91aba47-5910-4d19-9f8a-6f45d7718f7a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.190144 Dec 15 12:44:16.020001 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 337/679] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:15 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:16.609921 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b7f3e142-a5d3-499d-8c48-1e68aa793989 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:16.610874 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b7f3e142-a5d3-499d-8c48-1e68aa793989 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:16.617086 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b7f3e142-a5d3-499d-8c48-1e68aa793989 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:16.617553 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b7f3e142-a5d3-499d-8c48-1e68aa793989 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:16.618346 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b7f3e142-a5d3-499d-8c48-1e68aa793989 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:16.618781 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b7f3e142-a5d3-499d-8c48-1e68aa793989 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:16.650947 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b7f3e142-a5d3-499d-8c48-1e68aa793989 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045602 Dec 15 12:44:16.651546 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 343/680] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:16 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:16.956843 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bc7b3490-44c4-4c7d-91b5-93fce972e954 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:16.957799 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bc7b3490-44c4-4c7d-91b5-93fce972e954 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:16.964382 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc7b3490-44c4-4c7d-91b5-93fce972e954 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:16.964831 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc7b3490-44c4-4c7d-91b5-93fce972e954 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:16.965663 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc7b3490-44c4-4c7d-91b5-93fce972e954 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:16.966263 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc7b3490-44c4-4c7d-91b5-93fce972e954 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:16.998815 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bc7b3490-44c4-4c7d-91b5-93fce972e954 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046209 Dec 15 12:44:16.999767 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 338/681] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:16 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:17.035175 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-63760be8-5509-4b49-8d9d-f7096df0c9b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:17.035780 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-63760be8-5509-4b49-8d9d-f7096df0c9b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:17.041374 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-63760be8-5509-4b49-8d9d-f7096df0c9b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:17.041897 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-63760be8-5509-4b49-8d9d-f7096df0c9b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:17.042625 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-63760be8-5509-4b49-8d9d-f7096df0c9b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:17.043115 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-63760be8-5509-4b49-8d9d-f7096df0c9b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:17.194509 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-63760be8-5509-4b49-8d9d-f7096df0c9b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:17.203551 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-63760be8-5509-4b49-8d9d-f7096df0c9b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:17.205044 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-63760be8-5509-4b49-8d9d-f7096df0c9b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:17.206257 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-63760be8-5509-4b49-8d9d-f7096df0c9b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.174789 Dec 15 12:44:17.206801 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 344/682] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:17 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:17.668522 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-61a23ca9-4c44-4810-adf8-fb4f030dd0b5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:17.670265 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-61a23ca9-4c44-4810-adf8-fb4f030dd0b5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:17.681078 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-61a23ca9-4c44-4810-adf8-fb4f030dd0b5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:17.681902 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-61a23ca9-4c44-4810-adf8-fb4f030dd0b5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:17.683329 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-61a23ca9-4c44-4810-adf8-fb4f030dd0b5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:17.684119 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-61a23ca9-4c44-4810-adf8-fb4f030dd0b5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:17.718800 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-61a23ca9-4c44-4810-adf8-fb4f030dd0b5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057326 Dec 15 12:44:17.719376 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 339/683] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:17 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:44:18.015814 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b42a0a9c-2bcb-402b-9e03-e9ae7635786b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:18.017445 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b42a0a9c-2bcb-402b-9e03-e9ae7635786b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:18.024634 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b42a0a9c-2bcb-402b-9e03-e9ae7635786b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:18.025965 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b42a0a9c-2bcb-402b-9e03-e9ae7635786b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:18.026962 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b42a0a9c-2bcb-402b-9e03-e9ae7635786b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:18.027623 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b42a0a9c-2bcb-402b-9e03-e9ae7635786b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:18.059606 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b42a0a9c-2bcb-402b-9e03-e9ae7635786b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051439 Dec 15 12:44:18.060195 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 345/684] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:18 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:18.224350 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8c7d0277-9808-43af-824b-217d344536ac tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:18.224994 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8c7d0277-9808-43af-824b-217d344536ac tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:18.231626 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c7d0277-9808-43af-824b-217d344536ac tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:18.232073 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c7d0277-9808-43af-824b-217d344536ac tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:18.232840 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c7d0277-9808-43af-824b-217d344536ac tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:18.233808 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c7d0277-9808-43af-824b-217d344536ac tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:18.474084 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8c7d0277-9808-43af-824b-217d344536ac tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:18.484718 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8c7d0277-9808-43af-824b-217d344536ac tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:18.486694 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8c7d0277-9808-43af-824b-217d344536ac tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:18.488113 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8c7d0277-9808-43af-824b-217d344536ac tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.267454 Dec 15 12:44:18.489154 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 340/685] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:18 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:18.730836 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7c5dc176-116d-4e0e-9f68-b9f7af1ee970 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:18.732108 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7c5dc176-116d-4e0e-9f68-b9f7af1ee970 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:18.740760 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7c5dc176-116d-4e0e-9f68-b9f7af1ee970 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:18.741305 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7c5dc176-116d-4e0e-9f68-b9f7af1ee970 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:18.742439 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7c5dc176-116d-4e0e-9f68-b9f7af1ee970 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:18.743423 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7c5dc176-116d-4e0e-9f68-b9f7af1ee970 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:18.779386 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7c5dc176-116d-4e0e-9f68-b9f7af1ee970 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052630 Dec 15 12:44:18.784842 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 346/686] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:18 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:19.071612 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f168a98d-8ebd-4055-a4f1-7ff8418f3344 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:19.072782 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f168a98d-8ebd-4055-a4f1-7ff8418f3344 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:19.079857 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f168a98d-8ebd-4055-a4f1-7ff8418f3344 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:19.080308 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f168a98d-8ebd-4055-a4f1-7ff8418f3344 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:19.081118 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f168a98d-8ebd-4055-a4f1-7ff8418f3344 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:19.081595 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f168a98d-8ebd-4055-a4f1-7ff8418f3344 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:19.115186 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f168a98d-8ebd-4055-a4f1-7ff8418f3344 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047516 Dec 15 12:44:19.119007 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 341/687] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:19 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:19.507839 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-44c13f90-1760-46f4-ac0c-51196c6c7b9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:19.509391 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-44c13f90-1760-46f4-ac0c-51196c6c7b9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:19.519735 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-44c13f90-1760-46f4-ac0c-51196c6c7b9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:19.521284 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-44c13f90-1760-46f4-ac0c-51196c6c7b9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:19.522440 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-44c13f90-1760-46f4-ac0c-51196c6c7b9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:19.522975 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-44c13f90-1760-46f4-ac0c-51196c6c7b9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:19.759617 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-44c13f90-1760-46f4-ac0c-51196c6c7b9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:19.773896 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-44c13f90-1760-46f4-ac0c-51196c6c7b9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:19.775508 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-44c13f90-1760-46f4-ac0c-51196c6c7b9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:19.784175 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-44c13f90-1760-46f4-ac0c-51196c6c7b9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.274059 Dec 15 12:44:19.785304 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 347/688] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:19 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:44:19.803201 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a103eaeb-c75c-4a2c-ab2a-9fae79a1c4cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:19.811287 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a103eaeb-c75c-4a2c-ab2a-9fae79a1c4cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:19.817885 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a103eaeb-c75c-4a2c-ab2a-9fae79a1c4cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:19.818413 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a103eaeb-c75c-4a2c-ab2a-9fae79a1c4cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:19.819438 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a103eaeb-c75c-4a2c-ab2a-9fae79a1c4cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:19.819936 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a103eaeb-c75c-4a2c-ab2a-9fae79a1c4cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:19.854475 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a103eaeb-c75c-4a2c-ab2a-9fae79a1c4cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055120 Dec 15 12:44:19.859526 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 342/689] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:19 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:20.127703 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5e16aa4d-a26b-4298-a47d-da80512cf2fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:20.128618 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5e16aa4d-a26b-4298-a47d-da80512cf2fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:20.134646 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5e16aa4d-a26b-4298-a47d-da80512cf2fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:20.135098 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5e16aa4d-a26b-4298-a47d-da80512cf2fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:20.135874 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5e16aa4d-a26b-4298-a47d-da80512cf2fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:20.136304 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5e16aa4d-a26b-4298-a47d-da80512cf2fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:20.168728 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5e16aa4d-a26b-4298-a47d-da80512cf2fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045485 Dec 15 12:44:20.169289 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 348/690] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:20 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:20.804530 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-24ca9cc5-95e2-4d97-be8e-a24800d4a685 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:20.806039 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-24ca9cc5-95e2-4d97-be8e-a24800d4a685 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:20.813428 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-24ca9cc5-95e2-4d97-be8e-a24800d4a685 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:20.814051 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-24ca9cc5-95e2-4d97-be8e-a24800d4a685 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:20.815119 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-24ca9cc5-95e2-4d97-be8e-a24800d4a685 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:20.815876 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-24ca9cc5-95e2-4d97-be8e-a24800d4a685 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:20.866815 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-abc98b6c-85fa-452b-aeda-3eb72bcbbb1b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:20.868417 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-abc98b6c-85fa-452b-aeda-3eb72bcbbb1b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:20.875686 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-abc98b6c-85fa-452b-aeda-3eb72bcbbb1b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:20.876285 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-abc98b6c-85fa-452b-aeda-3eb72bcbbb1b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:20.877363 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-abc98b6c-85fa-452b-aeda-3eb72bcbbb1b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:20.878113 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-abc98b6c-85fa-452b-aeda-3eb72bcbbb1b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:20.910636 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-abc98b6c-85fa-452b-aeda-3eb72bcbbb1b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047532 Dec 15 12:44:20.911484 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 349/691] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:20 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:44:21.065397 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-24ca9cc5-95e2-4d97-be8e-a24800d4a685 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:21.075296 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-24ca9cc5-95e2-4d97-be8e-a24800d4a685 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:21.077312 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-24ca9cc5-95e2-4d97-be8e-a24800d4a685 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:21.079203 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-24ca9cc5-95e2-4d97-be8e-a24800d4a685 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.278352 Dec 15 12:44:21.079923 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 343/692] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:20 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:21.181212 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c5b7c602-f8ce-415d-b639-fe051861fe22 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:21.182530 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c5b7c602-f8ce-415d-b639-fe051861fe22 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:21.194350 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c5b7c602-f8ce-415d-b639-fe051861fe22 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:21.194884 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c5b7c602-f8ce-415d-b639-fe051861fe22 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:21.196392 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c5b7c602-f8ce-415d-b639-fe051861fe22 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:21.196953 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c5b7c602-f8ce-415d-b639-fe051861fe22 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:21.239122 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c5b7c602-f8ce-415d-b639-fe051861fe22 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062546 Dec 15 12:44:21.240011 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 350/693] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:21 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:21.924793 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-890f099b-a7ab-4e66-958b-8d4add6bd883 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:21.925845 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-890f099b-a7ab-4e66-958b-8d4add6bd883 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:21.932847 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-890f099b-a7ab-4e66-958b-8d4add6bd883 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:21.933548 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-890f099b-a7ab-4e66-958b-8d4add6bd883 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:21.934457 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-890f099b-a7ab-4e66-958b-8d4add6bd883 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:21.934969 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-890f099b-a7ab-4e66-958b-8d4add6bd883 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:21.970041 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-890f099b-a7ab-4e66-958b-8d4add6bd883 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049077 Dec 15 12:44:21.974179 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 344/694] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:21 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:22.097163 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9193ab7c-70c3-4ec2-9bb4-82e283cc8996 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:22.097790 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9193ab7c-70c3-4ec2-9bb4-82e283cc8996 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:22.104488 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9193ab7c-70c3-4ec2-9bb4-82e283cc8996 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:22.104935 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9193ab7c-70c3-4ec2-9bb4-82e283cc8996 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:22.105828 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9193ab7c-70c3-4ec2-9bb4-82e283cc8996 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:22.106157 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9193ab7c-70c3-4ec2-9bb4-82e283cc8996 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:22.254635 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a3b019f6-9b65-4c12-8d93-1f0a94570d3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:22.256033 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a3b019f6-9b65-4c12-8d93-1f0a94570d3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:22.262763 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a3b019f6-9b65-4c12-8d93-1f0a94570d3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:22.263450 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a3b019f6-9b65-4c12-8d93-1f0a94570d3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:22.264406 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a3b019f6-9b65-4c12-8d93-1f0a94570d3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:22.265641 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a3b019f6-9b65-4c12-8d93-1f0a94570d3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:22.339422 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a3b019f6-9b65-4c12-8d93-1f0a94570d3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092245 Dec 15 12:44:22.342385 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 345/695] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:22 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:44:22.374015 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9193ab7c-70c3-4ec2-9bb4-82e283cc8996 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:22.384975 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9193ab7c-70c3-4ec2-9bb4-82e283cc8996 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:22.386820 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9193ab7c-70c3-4ec2-9bb4-82e283cc8996 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:22.389948 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9193ab7c-70c3-4ec2-9bb4-82e283cc8996 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.295798 Dec 15 12:44:22.391699 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 351/696] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:22 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:22.982177 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-60af60f7-e380-4cfb-a7a3-caf47a1f0af6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:22.984283 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-60af60f7-e380-4cfb-a7a3-caf47a1f0af6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:22.990330 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-60af60f7-e380-4cfb-a7a3-caf47a1f0af6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:22.990777 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-60af60f7-e380-4cfb-a7a3-caf47a1f0af6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:22.991636 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-60af60f7-e380-4cfb-a7a3-caf47a1f0af6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:22.992073 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-60af60f7-e380-4cfb-a7a3-caf47a1f0af6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:23.038621 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-60af60f7-e380-4cfb-a7a3-caf47a1f0af6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060384 Dec 15 12:44:23.039643 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 346/697] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:22 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:23.353726 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fc65a030-d68d-4712-aa6a-79435272e373 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:23.356078 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fc65a030-d68d-4712-aa6a-79435272e373 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:23.365233 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fc65a030-d68d-4712-aa6a-79435272e373 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:23.366384 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fc65a030-d68d-4712-aa6a-79435272e373 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:23.367292 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fc65a030-d68d-4712-aa6a-79435272e373 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:23.367832 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fc65a030-d68d-4712-aa6a-79435272e373 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:23.407453 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fc65a030-d68d-4712-aa6a-79435272e373 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059319 Dec 15 12:44:23.408330 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 352/698] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:23 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:23.411660 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e2360390-9972-4494-8c2e-08fd55e11ce3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:23.412895 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e2360390-9972-4494-8c2e-08fd55e11ce3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:23.418418 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e2360390-9972-4494-8c2e-08fd55e11ce3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:23.419108 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e2360390-9972-4494-8c2e-08fd55e11ce3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:23.419891 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e2360390-9972-4494-8c2e-08fd55e11ce3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:23.420563 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e2360390-9972-4494-8c2e-08fd55e11ce3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:23.644336 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e2360390-9972-4494-8c2e-08fd55e11ce3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:23.664065 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e2360390-9972-4494-8c2e-08fd55e11ce3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:23.670176 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e2360390-9972-4494-8c2e-08fd55e11ce3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:23.672299 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e2360390-9972-4494-8c2e-08fd55e11ce3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.265968 Dec 15 12:44:23.673348 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 347/699] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:23 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:24.053437 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-76484f7a-63c5-4e8b-8637-6d4384232cfc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:24.054772 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-76484f7a-63c5-4e8b-8637-6d4384232cfc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:24.063126 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-76484f7a-63c5-4e8b-8637-6d4384232cfc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:24.063577 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-76484f7a-63c5-4e8b-8637-6d4384232cfc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:24.064607 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-76484f7a-63c5-4e8b-8637-6d4384232cfc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:24.065046 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-76484f7a-63c5-4e8b-8637-6d4384232cfc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:24.096985 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-76484f7a-63c5-4e8b-8637-6d4384232cfc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049431 Dec 15 12:44:24.097580 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 353/700] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:24 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:24.422772 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9a166628-1410-4646-817e-de94864e7e14 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:24.424225 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9a166628-1410-4646-817e-de94864e7e14 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:24.431480 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9a166628-1410-4646-817e-de94864e7e14 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:24.432421 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9a166628-1410-4646-817e-de94864e7e14 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:24.433658 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9a166628-1410-4646-817e-de94864e7e14 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:24.434316 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9a166628-1410-4646-817e-de94864e7e14 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:24.471932 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9a166628-1410-4646-817e-de94864e7e14 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055293 Dec 15 12:44:24.478576 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 348/701] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:24 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:24.691624 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-aa43c59a-8393-4f1d-b847-db3e8077052a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:24.692245 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-aa43c59a-8393-4f1d-b847-db3e8077052a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:24.703970 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa43c59a-8393-4f1d-b847-db3e8077052a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:24.704733 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa43c59a-8393-4f1d-b847-db3e8077052a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:24.709848 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa43c59a-8393-4f1d-b847-db3e8077052a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:24.710462 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa43c59a-8393-4f1d-b847-db3e8077052a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:24.899503 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-aa43c59a-8393-4f1d-b847-db3e8077052a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:24.908902 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-aa43c59a-8393-4f1d-b847-db3e8077052a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:24.910709 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-aa43c59a-8393-4f1d-b847-db3e8077052a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:24.912113 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-aa43c59a-8393-4f1d-b847-db3e8077052a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.224440 Dec 15 12:44:24.913176 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 354/702] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:24 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:25.109334 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bc69f155-8525-41eb-8916-ba4ee5820013 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:25.110436 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bc69f155-8525-41eb-8916-ba4ee5820013 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:25.116878 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc69f155-8525-41eb-8916-ba4ee5820013 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:25.117567 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc69f155-8525-41eb-8916-ba4ee5820013 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:25.119134 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc69f155-8525-41eb-8916-ba4ee5820013 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:25.119504 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc69f155-8525-41eb-8916-ba4ee5820013 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:25.153148 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bc69f155-8525-41eb-8916-ba4ee5820013 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048252 Dec 15 12:44:25.153806 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 349/703] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:25 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:25.487888 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-78ca0c2e-23de-4fe5-bf9b-a3c37f24f3b7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:25.490781 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-78ca0c2e-23de-4fe5-bf9b-a3c37f24f3b7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:25.499805 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-78ca0c2e-23de-4fe5-bf9b-a3c37f24f3b7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:25.501635 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-78ca0c2e-23de-4fe5-bf9b-a3c37f24f3b7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:25.503037 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-78ca0c2e-23de-4fe5-bf9b-a3c37f24f3b7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:25.524049 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-78ca0c2e-23de-4fe5-bf9b-a3c37f24f3b7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:25.629567 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-78ca0c2e-23de-4fe5-bf9b-a3c37f24f3b7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147529 Dec 15 12:44:25.634581 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 355/704] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:25 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:25.933965 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d2e66a7b-7f8d-4bad-a124-15df5f9a6aa9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:25.935464 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d2e66a7b-7f8d-4bad-a124-15df5f9a6aa9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:25.943600 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d2e66a7b-7f8d-4bad-a124-15df5f9a6aa9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:25.944424 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d2e66a7b-7f8d-4bad-a124-15df5f9a6aa9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:25.945532 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d2e66a7b-7f8d-4bad-a124-15df5f9a6aa9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:25.946219 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d2e66a7b-7f8d-4bad-a124-15df5f9a6aa9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:26.165242 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-acc1b9e9-8691-4986-b55b-fb49c4dba25c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:26.166204 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-acc1b9e9-8691-4986-b55b-fb49c4dba25c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:26.175902 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-acc1b9e9-8691-4986-b55b-fb49c4dba25c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:26.178066 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-acc1b9e9-8691-4986-b55b-fb49c4dba25c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:26.179091 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-acc1b9e9-8691-4986-b55b-fb49c4dba25c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:26.181562 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-acc1b9e9-8691-4986-b55b-fb49c4dba25c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:26.221852 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-acc1b9e9-8691-4986-b55b-fb49c4dba25c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060073 Dec 15 12:44:26.222971 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 356/705] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:26 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:44:26.281460 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d2e66a7b-7f8d-4bad-a124-15df5f9a6aa9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:26.316645 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d2e66a7b-7f8d-4bad-a124-15df5f9a6aa9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:26.320074 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d2e66a7b-7f8d-4bad-a124-15df5f9a6aa9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:26.322872 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d2e66a7b-7f8d-4bad-a124-15df5f9a6aa9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.395318 Dec 15 12:44:26.324052 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 350/706] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:25 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:26.643210 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ce25648a-d106-46c1-8065-7acd7e6af7c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:26.644152 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ce25648a-d106-46c1-8065-7acd7e6af7c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:26.651103 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce25648a-d106-46c1-8065-7acd7e6af7c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:26.651821 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce25648a-d106-46c1-8065-7acd7e6af7c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:26.652998 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce25648a-d106-46c1-8065-7acd7e6af7c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:26.653773 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce25648a-d106-46c1-8065-7acd7e6af7c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:26.701573 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ce25648a-d106-46c1-8065-7acd7e6af7c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063230 Dec 15 12:44:26.704044 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 357/707] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:26 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:27.234289 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0ded0114-fb8b-4384-9e2b-fb6447824254 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:27.235861 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0ded0114-fb8b-4384-9e2b-fb6447824254 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:27.250665 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0ded0114-fb8b-4384-9e2b-fb6447824254 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:27.251430 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0ded0114-fb8b-4384-9e2b-fb6447824254 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:27.252379 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0ded0114-fb8b-4384-9e2b-fb6447824254 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:27.252823 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0ded0114-fb8b-4384-9e2b-fb6447824254 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:27.303425 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0ded0114-fb8b-4384-9e2b-fb6447824254 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073245 Dec 15 12:44:27.304013 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 351/708] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:27 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:27.345277 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c9e01cda-be2c-4ce2-bf22-808adec4ecb4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:27.346430 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c9e01cda-be2c-4ce2-bf22-808adec4ecb4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:27.359698 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c9e01cda-be2c-4ce2-bf22-808adec4ecb4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:27.360263 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c9e01cda-be2c-4ce2-bf22-808adec4ecb4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:27.361174 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c9e01cda-be2c-4ce2-bf22-808adec4ecb4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:27.361738 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c9e01cda-be2c-4ce2-bf22-808adec4ecb4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:27.717221 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c0bf2527-3139-46ad-9102-1048ce9b8f4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:27.719137 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c0bf2527-3139-46ad-9102-1048ce9b8f4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:27.726549 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c0bf2527-3139-46ad-9102-1048ce9b8f4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:27.728884 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c0bf2527-3139-46ad-9102-1048ce9b8f4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:27.729945 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c0bf2527-3139-46ad-9102-1048ce9b8f4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:27.730568 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c0bf2527-3139-46ad-9102-1048ce9b8f4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:27.755593 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c9e01cda-be2c-4ce2-bf22-808adec4ecb4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:27.771113 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c9e01cda-be2c-4ce2-bf22-808adec4ecb4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:27.772436 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c9e01cda-be2c-4ce2-bf22-808adec4ecb4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:27.779207 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c9e01cda-be2c-4ce2-bf22-808adec4ecb4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.434116 Dec 15 12:44:27.782149 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 358/709] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:27 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:27.788718 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c0bf2527-3139-46ad-9102-1048ce9b8f4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077899 Dec 15 12:44:27.789869 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 352/710] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:27 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:28.315715 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bc204973-9f03-4c7b-9ee2-1f320ab7464d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:28.316767 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bc204973-9f03-4c7b-9ee2-1f320ab7464d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:28.325412 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bc204973-9f03-4c7b-9ee2-1f320ab7464d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:28.325922 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bc204973-9f03-4c7b-9ee2-1f320ab7464d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:28.327651 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bc204973-9f03-4c7b-9ee2-1f320ab7464d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:28.327816 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bc204973-9f03-4c7b-9ee2-1f320ab7464d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:28.369209 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bc204973-9f03-4c7b-9ee2-1f320ab7464d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057381 Dec 15 12:44:28.371671 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 359/711] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:28 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:28.640976 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7fd58fd8-b14c-4242-8eed-093d6dbf63b8 tempest-TestShelveInstance-1594053736 tempest-TestShelveInstance-1594053736-project] Action: 'create', calling method: .version_select at 0x7f3c6951d310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1619478811"}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:44:28.663646 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-7fd58fd8-b14c-4242-8eed-093d6dbf63b8 tempest-TestShelveInstance-1594053736 tempest-TestShelveInstance-1594053736-project] Getting quotas for project ac2c31e87cf84facb68366e1606e4184. Resources: {'key_pairs'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 12:44:28.667405 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-7fd58fd8-b14c-4242-8eed-093d6dbf63b8 tempest-TestShelveInstance-1594053736 tempest-TestShelveInstance-1594053736-project] Getting quotas for user 9250401d66dc4d3abb3d01a1dd4ccd3c and project ac2c31e87cf84facb68366e1606e4184. Resources: {'key_pairs'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 12:44:28.799326 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2f919a75-7f27-4add-9064-fd47aaddda27 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:28.799852 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2f919a75-7f27-4add-9064-fd47aaddda27 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:28.806045 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2f919a75-7f27-4add-9064-fd47aaddda27 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:28.806489 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2f919a75-7f27-4add-9064-fd47aaddda27 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:28.807281 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2f919a75-7f27-4add-9064-fd47aaddda27 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:28.807715 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2f919a75-7f27-4add-9064-fd47aaddda27 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:28.949625 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2f919a75-7f27-4add-9064-fd47aaddda27 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:28.951089 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-7fd58fd8-b14c-4242-8eed-093d6dbf63b8 tempest-TestShelveInstance-1594053736 tempest-TestShelveInstance-1594053736-project] Getting quotas for project ac2c31e87cf84facb68366e1606e4184. Resources: {'key_pairs'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 12:44:28.954875 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-7fd58fd8-b14c-4242-8eed-093d6dbf63b8 tempest-TestShelveInstance-1594053736 tempest-TestShelveInstance-1594053736-project] Getting quotas for user 9250401d66dc4d3abb3d01a1dd4ccd3c and project ac2c31e87cf84facb68366e1606e4184. Resources: {'key_pairs'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 12:44:28.958281 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2f919a75-7f27-4add-9064-fd47aaddda27 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:28.959793 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2f919a75-7f27-4add-9064-fd47aaddda27 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:28.968831 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2f919a75-7f27-4add-9064-fd47aaddda27 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.173792 Dec 15 12:44:28.969703 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 360/712] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:28 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:44:28.971471 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7fd58fd8-b14c-4242-8eed-093d6dbf63b8 tempest-TestShelveInstance-1594053736 tempest-TestShelveInstance-1594053736-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.534976 Dec 15 12:44:28.972046 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 353/713] 10.222.0.76 () {60 vars in 1157 bytes} [Wed Dec 15 12:44:28 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:44:28.979056 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2837e441-fac5-42d0-89d1-a0529ebda5a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:28.979951 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2837e441-fac5-42d0-89d1-a0529ebda5a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:28.986591 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2837e441-fac5-42d0-89d1-a0529ebda5a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:28.987161 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2837e441-fac5-42d0-89d1-a0529ebda5a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:28.987953 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2837e441-fac5-42d0-89d1-a0529ebda5a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:28.988382 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2837e441-fac5-42d0-89d1-a0529ebda5a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:29.026846 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2837e441-fac5-42d0-89d1-a0529ebda5a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051365 Dec 15 12:44:29.027424 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 361/714] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:28 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:29.382815 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2082c037-e1cd-438e-9927-0cddd12e7b78 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:29.383877 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2082c037-e1cd-438e-9927-0cddd12e7b78 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:29.391493 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2082c037-e1cd-438e-9927-0cddd12e7b78 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:29.392061 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2082c037-e1cd-438e-9927-0cddd12e7b78 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:29.393251 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2082c037-e1cd-438e-9927-0cddd12e7b78 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:29.393886 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2082c037-e1cd-438e-9927-0cddd12e7b78 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:29.438913 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2082c037-e1cd-438e-9927-0cddd12e7b78 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059792 Dec 15 12:44:29.439797 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 354/715] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:29 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:29.987779 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a22523b8-d031-4cfe-9544-b85732ffc86b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:29.988477 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a22523b8-d031-4cfe-9544-b85732ffc86b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:29.997193 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a22523b8-d031-4cfe-9544-b85732ffc86b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:29.997746 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a22523b8-d031-4cfe-9544-b85732ffc86b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:29.999788 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a22523b8-d031-4cfe-9544-b85732ffc86b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:30.000320 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a22523b8-d031-4cfe-9544-b85732ffc86b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:30.040627 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-01e961ff-9de3-4c43-a97c-ec2a65d3801c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:30.041766 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-01e961ff-9de3-4c43-a97c-ec2a65d3801c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:30.051741 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-01e961ff-9de3-4c43-a97c-ec2a65d3801c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:30.066186 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-01e961ff-9de3-4c43-a97c-ec2a65d3801c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:30.067087 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-01e961ff-9de3-4c43-a97c-ec2a65d3801c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:30.067537 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-01e961ff-9de3-4c43-a97c-ec2a65d3801c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:30.101759 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-01e961ff-9de3-4c43-a97c-ec2a65d3801c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066777 Dec 15 12:44:30.113794 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 355/716] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:30 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:44:30.160623 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a22523b8-d031-4cfe-9544-b85732ffc86b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:30.174032 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a22523b8-d031-4cfe-9544-b85732ffc86b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:30.175872 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a22523b8-d031-4cfe-9544-b85732ffc86b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:30.177065 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a22523b8-d031-4cfe-9544-b85732ffc86b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.193553 Dec 15 12:44:30.177648 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 362/717] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:29 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:30.450961 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e9876b3c-d73e-4d7d-b9cf-ba3ce2140bdb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:30.451918 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e9876b3c-d73e-4d7d-b9cf-ba3ce2140bdb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:30.458987 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e9876b3c-d73e-4d7d-b9cf-ba3ce2140bdb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:30.459439 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e9876b3c-d73e-4d7d-b9cf-ba3ce2140bdb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:30.460233 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e9876b3c-d73e-4d7d-b9cf-ba3ce2140bdb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:30.460670 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e9876b3c-d73e-4d7d-b9cf-ba3ce2140bdb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:30.505489 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e9876b3c-d73e-4d7d-b9cf-ba3ce2140bdb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058092 Dec 15 12:44:30.506228 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 356/718] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:30 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:31.123168 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c82e833d-d362-41bb-be1c-eba5325ca9b9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:31.124769 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c82e833d-d362-41bb-be1c-eba5325ca9b9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:31.134916 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c82e833d-d362-41bb-be1c-eba5325ca9b9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:31.135565 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c82e833d-d362-41bb-be1c-eba5325ca9b9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:31.136876 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c82e833d-d362-41bb-be1c-eba5325ca9b9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:31.137533 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c82e833d-d362-41bb-be1c-eba5325ca9b9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:31.200899 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4ab865d4-45b0-453f-9840-6b8164b54949 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:31.201542 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4ab865d4-45b0-453f-9840-6b8164b54949 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:31.211228 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4ab865d4-45b0-453f-9840-6b8164b54949 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:31.211829 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4ab865d4-45b0-453f-9840-6b8164b54949 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:31.212786 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4ab865d4-45b0-453f-9840-6b8164b54949 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:31.213337 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4ab865d4-45b0-453f-9840-6b8164b54949 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:31.215545 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c82e833d-d362-41bb-be1c-eba5325ca9b9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097303 Dec 15 12:44:31.216704 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 363/719] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:31 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:31.421990 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4ab865d4-45b0-453f-9840-6b8164b54949 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:31.431185 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4ab865d4-45b0-453f-9840-6b8164b54949 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:31.432669 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4ab865d4-45b0-453f-9840-6b8164b54949 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:31.433922 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4ab865d4-45b0-453f-9840-6b8164b54949 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.238815 Dec 15 12:44:31.434499 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 357/720] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:31 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:31.517091 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-460f63c7-50a6-42dc-ba42-677b49d91aba tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:31.517987 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-460f63c7-50a6-42dc-ba42-677b49d91aba tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:31.524739 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-460f63c7-50a6-42dc-ba42-677b49d91aba tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:31.525543 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-460f63c7-50a6-42dc-ba42-677b49d91aba tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:31.526542 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-460f63c7-50a6-42dc-ba42-677b49d91aba tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:31.527137 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-460f63c7-50a6-42dc-ba42-677b49d91aba tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:31.574042 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-460f63c7-50a6-42dc-ba42-677b49d91aba tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060610 Dec 15 12:44:31.574943 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 364/721] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:31 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:32.228024 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-491cb6ab-2263-43a8-a6e6-30dd90775b73 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:32.229083 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-491cb6ab-2263-43a8-a6e6-30dd90775b73 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:32.236148 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-491cb6ab-2263-43a8-a6e6-30dd90775b73 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:32.236680 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-491cb6ab-2263-43a8-a6e6-30dd90775b73 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:32.237453 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-491cb6ab-2263-43a8-a6e6-30dd90775b73 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:32.237905 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-491cb6ab-2263-43a8-a6e6-30dd90775b73 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:32.267872 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-491cb6ab-2263-43a8-a6e6-30dd90775b73 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043541 Dec 15 12:44:32.268432 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 358/722] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:32 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:32.456288 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-587361e7-7c6e-4a8b-a1cf-3c28cee2bef5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:32.457003 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-587361e7-7c6e-4a8b-a1cf-3c28cee2bef5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:32.463282 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-587361e7-7c6e-4a8b-a1cf-3c28cee2bef5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:32.463733 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-587361e7-7c6e-4a8b-a1cf-3c28cee2bef5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:32.464532 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-587361e7-7c6e-4a8b-a1cf-3c28cee2bef5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:32.464974 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-587361e7-7c6e-4a8b-a1cf-3c28cee2bef5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:32.586537 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5f81cc9b-a78d-4c97-9698-2218e2cece8b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:32.587507 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5f81cc9b-a78d-4c97-9698-2218e2cece8b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:32.594356 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5f81cc9b-a78d-4c97-9698-2218e2cece8b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:32.594784 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5f81cc9b-a78d-4c97-9698-2218e2cece8b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:32.595582 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5f81cc9b-a78d-4c97-9698-2218e2cece8b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:32.596100 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5f81cc9b-a78d-4c97-9698-2218e2cece8b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:32.607995 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-587361e7-7c6e-4a8b-a1cf-3c28cee2bef5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:32.616636 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-587361e7-7c6e-4a8b-a1cf-3c28cee2bef5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:32.618324 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-587361e7-7c6e-4a8b-a1cf-3c28cee2bef5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:32.619521 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-587361e7-7c6e-4a8b-a1cf-3c28cee2bef5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.167724 Dec 15 12:44:32.620241 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 365/723] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:32 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:32.627017 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5f81cc9b-a78d-4c97-9698-2218e2cece8b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044183 Dec 15 12:44:32.627671 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 359/724] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:32 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:44:33.282194 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b662021c-85d5-4430-bafd-50dbe2e3b8d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:33.283111 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b662021c-85d5-4430-bafd-50dbe2e3b8d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:33.293897 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b662021c-85d5-4430-bafd-50dbe2e3b8d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:33.302742 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b662021c-85d5-4430-bafd-50dbe2e3b8d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:33.302742 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b662021c-85d5-4430-bafd-50dbe2e3b8d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:33.302742 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b662021c-85d5-4430-bafd-50dbe2e3b8d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:33.332931 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b662021c-85d5-4430-bafd-50dbe2e3b8d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055130 Dec 15 12:44:33.335592 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 366/725] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:33 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:33.638290 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d1ea6752-7961-4d24-a8c0-cdd48f8d719c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:33.638953 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d1ea6752-7961-4d24-a8c0-cdd48f8d719c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:33.639246 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c5a7181a-8636-4a60-82e5-3dd822f8f6bd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:33.640188 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c5a7181a-8636-4a60-82e5-3dd822f8f6bd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:33.645591 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d1ea6752-7961-4d24-a8c0-cdd48f8d719c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:33.646045 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d1ea6752-7961-4d24-a8c0-cdd48f8d719c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:33.646330 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c5a7181a-8636-4a60-82e5-3dd822f8f6bd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:33.646772 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c5a7181a-8636-4a60-82e5-3dd822f8f6bd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:33.646877 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d1ea6752-7961-4d24-a8c0-cdd48f8d719c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:33.647263 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d1ea6752-7961-4d24-a8c0-cdd48f8d719c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:33.647545 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c5a7181a-8636-4a60-82e5-3dd822f8f6bd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:33.647973 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c5a7181a-8636-4a60-82e5-3dd822f8f6bd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:33.679166 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c5a7181a-8636-4a60-82e5-3dd822f8f6bd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043611 Dec 15 12:44:33.679736 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 367/726] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:33 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:44:33.783631 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d1ea6752-7961-4d24-a8c0-cdd48f8d719c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:33.799466 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d1ea6752-7961-4d24-a8c0-cdd48f8d719c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:33.801127 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d1ea6752-7961-4d24-a8c0-cdd48f8d719c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:33.802323 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d1ea6752-7961-4d24-a8c0-cdd48f8d719c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.168046 Dec 15 12:44:33.814553 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 360/727] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:33 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:34.344404 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a0562cd6-377f-40da-ba14-8d3140016444 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:34.345436 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a0562cd6-377f-40da-ba14-8d3140016444 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:34.351945 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a0562cd6-377f-40da-ba14-8d3140016444 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:34.352395 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a0562cd6-377f-40da-ba14-8d3140016444 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:34.353210 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a0562cd6-377f-40da-ba14-8d3140016444 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:34.353687 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a0562cd6-377f-40da-ba14-8d3140016444 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:34.385091 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a0562cd6-377f-40da-ba14-8d3140016444 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044677 Dec 15 12:44:34.385692 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 368/728] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:34 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:34.691259 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d48cd6c3-d9f4-4aec-b1d5-e3e83663fcd7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:34.692235 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d48cd6c3-d9f4-4aec-b1d5-e3e83663fcd7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:34.698499 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d48cd6c3-d9f4-4aec-b1d5-e3e83663fcd7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:34.698949 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d48cd6c3-d9f4-4aec-b1d5-e3e83663fcd7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:34.699740 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d48cd6c3-d9f4-4aec-b1d5-e3e83663fcd7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:34.700181 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d48cd6c3-d9f4-4aec-b1d5-e3e83663fcd7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:34.739360 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d48cd6c3-d9f4-4aec-b1d5-e3e83663fcd7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051732 Dec 15 12:44:34.740062 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 361/729] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:34 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:44:34.822342 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-81bb692a-ca2c-461f-b0db-3d239c2951ff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:34.823051 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-81bb692a-ca2c-461f-b0db-3d239c2951ff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:34.829547 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-81bb692a-ca2c-461f-b0db-3d239c2951ff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:34.830022 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-81bb692a-ca2c-461f-b0db-3d239c2951ff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:34.831259 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-81bb692a-ca2c-461f-b0db-3d239c2951ff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:34.831259 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-81bb692a-ca2c-461f-b0db-3d239c2951ff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:34.967369 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-81bb692a-ca2c-461f-b0db-3d239c2951ff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:34.979953 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-81bb692a-ca2c-461f-b0db-3d239c2951ff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:34.981454 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-81bb692a-ca2c-461f-b0db-3d239c2951ff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:34.982646 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-81bb692a-ca2c-461f-b0db-3d239c2951ff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.164024 Dec 15 12:44:34.983726 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 369/730] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:34 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:35.396599 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-29bae9d5-eea0-44e7-acee-5a06facf11ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:35.397528 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-29bae9d5-eea0-44e7-acee-5a06facf11ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:35.403448 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-29bae9d5-eea0-44e7-acee-5a06facf11ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:35.403895 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-29bae9d5-eea0-44e7-acee-5a06facf11ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:35.404681 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-29bae9d5-eea0-44e7-acee-5a06facf11ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:35.405943 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-29bae9d5-eea0-44e7-acee-5a06facf11ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:35.435899 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-29bae9d5-eea0-44e7-acee-5a06facf11ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043000 Dec 15 12:44:35.436700 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 362/731] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:35 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:35.854994 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-11536b39-1e79-47f0-a927-68544e593802 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:35.855955 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-11536b39-1e79-47f0-a927-68544e593802 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:35.862413 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-11536b39-1e79-47f0-a927-68544e593802 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:35.862865 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-11536b39-1e79-47f0-a927-68544e593802 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:35.863677 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-11536b39-1e79-47f0-a927-68544e593802 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:35.864114 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-11536b39-1e79-47f0-a927-68544e593802 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:35.899552 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-11536b39-1e79-47f0-a927-68544e593802 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152952 Dec 15 12:44:35.900131 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 370/732] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:35 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:36.001775 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8d289afc-bbe2-4416-934c-7decf8647c9a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:36.002390 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8d289afc-bbe2-4416-934c-7decf8647c9a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:36.009394 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8d289afc-bbe2-4416-934c-7decf8647c9a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:36.009874 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8d289afc-bbe2-4416-934c-7decf8647c9a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:36.010694 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8d289afc-bbe2-4416-934c-7decf8647c9a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:36.011159 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8d289afc-bbe2-4416-934c-7decf8647c9a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:36.260785 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8d289afc-bbe2-4416-934c-7decf8647c9a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:36.269297 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8d289afc-bbe2-4416-934c-7decf8647c9a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:36.270846 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8d289afc-bbe2-4416-934c-7decf8647c9a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:36.272006 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8d289afc-bbe2-4416-934c-7decf8647c9a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.274568 Dec 15 12:44:36.272583 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 363/733] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:35 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:36.447353 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8fdc32f1-17fb-47c0-b4a9-136a610c4bac tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:36.448249 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8fdc32f1-17fb-47c0-b4a9-136a610c4bac tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:36.454465 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8fdc32f1-17fb-47c0-b4a9-136a610c4bac tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:36.454974 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8fdc32f1-17fb-47c0-b4a9-136a610c4bac tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:36.455815 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8fdc32f1-17fb-47c0-b4a9-136a610c4bac tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:36.456249 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8fdc32f1-17fb-47c0-b4a9-136a610c4bac tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:36.487016 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8fdc32f1-17fb-47c0-b4a9-136a610c4bac tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043368 Dec 15 12:44:36.487620 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 371/734] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:36 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:36.911475 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c2159290-9084-4159-896b-331db13f60ca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:36.912379 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c2159290-9084-4159-896b-331db13f60ca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:36.918372 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2159290-9084-4159-896b-331db13f60ca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:36.918813 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2159290-9084-4159-896b-331db13f60ca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:36.919600 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2159290-9084-4159-896b-331db13f60ca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:36.920033 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2159290-9084-4159-896b-331db13f60ca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:36.954724 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c2159290-9084-4159-896b-331db13f60ca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046905 Dec 15 12:44:36.955491 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 364/735] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:36 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:37.294078 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d0c8b58c-01a8-493e-ac35-5236a691ee89 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:37.294678 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d0c8b58c-01a8-493e-ac35-5236a691ee89 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:37.301247 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d0c8b58c-01a8-493e-ac35-5236a691ee89 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:37.301725 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d0c8b58c-01a8-493e-ac35-5236a691ee89 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:37.302504 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d0c8b58c-01a8-493e-ac35-5236a691ee89 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:37.302932 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d0c8b58c-01a8-493e-ac35-5236a691ee89 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:37.495627 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d0c8b58c-01a8-493e-ac35-5236a691ee89 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:37.498370 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e4f7332e-10c6-4434-bc0e-82345c0ee40e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:37.499962 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e4f7332e-10c6-4434-bc0e-82345c0ee40e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:37.506262 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d0c8b58c-01a8-493e-ac35-5236a691ee89 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:37.506451 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e4f7332e-10c6-4434-bc0e-82345c0ee40e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:37.506782 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e4f7332e-10c6-4434-bc0e-82345c0ee40e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:37.507563 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e4f7332e-10c6-4434-bc0e-82345c0ee40e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:37.508064 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e4f7332e-10c6-4434-bc0e-82345c0ee40e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:37.508208 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d0c8b58c-01a8-493e-ac35-5236a691ee89 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:37.509345 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d0c8b58c-01a8-493e-ac35-5236a691ee89 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.218973 Dec 15 12:44:37.509933 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 372/736] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:37 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:37.542794 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e4f7332e-10c6-4434-bc0e-82345c0ee40e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048084 Dec 15 12:44:37.543359 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 365/737] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:37 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:44:37.967201 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a0d244db-4d11-4223-9f4c-3565c9c6803e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:37.968471 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a0d244db-4d11-4223-9f4c-3565c9c6803e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:37.974304 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a0d244db-4d11-4223-9f4c-3565c9c6803e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:37.974741 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a0d244db-4d11-4223-9f4c-3565c9c6803e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:37.975510 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a0d244db-4d11-4223-9f4c-3565c9c6803e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:37.975942 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a0d244db-4d11-4223-9f4c-3565c9c6803e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:38.008123 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a0d244db-4d11-4223-9f4c-3565c9c6803e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044623 Dec 15 12:44:38.011948 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 373/738] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:37 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:38.381982 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 12:44:38.382489 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 12:44:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 12:44:38.528069 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9a1d1e7e-d607-4e01-bd41-bc3e9b1aa06f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:38.528673 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9a1d1e7e-d607-4e01-bd41-bc3e9b1aa06f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:38.536163 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9a1d1e7e-d607-4e01-bd41-bc3e9b1aa06f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:38.536609 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9a1d1e7e-d607-4e01-bd41-bc3e9b1aa06f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:38.537597 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9a1d1e7e-d607-4e01-bd41-bc3e9b1aa06f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:38.538030 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9a1d1e7e-d607-4e01-bd41-bc3e9b1aa06f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:38.554813 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8e0351be-45e0-47e1-a959-493dd9558f55 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:38.555967 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8e0351be-45e0-47e1-a959-493dd9558f55 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:38.562357 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8e0351be-45e0-47e1-a959-493dd9558f55 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:38.562801 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8e0351be-45e0-47e1-a959-493dd9558f55 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:38.563642 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8e0351be-45e0-47e1-a959-493dd9558f55 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:38.564080 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8e0351be-45e0-47e1-a959-493dd9558f55 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:38.600105 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8e0351be-45e0-47e1-a959-493dd9558f55 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049836 Dec 15 12:44:38.600679 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 374/739] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:38 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:38.683826 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9a1d1e7e-d607-4e01-bd41-bc3e9b1aa06f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:38.692910 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9a1d1e7e-d607-4e01-bd41-bc3e9b1aa06f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:38.694727 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9a1d1e7e-d607-4e01-bd41-bc3e9b1aa06f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:38.695967 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9a1d1e7e-d607-4e01-bd41-bc3e9b1aa06f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.171630 Dec 15 12:44:38.696532 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 366/740] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:38 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:39.026562 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8331e30f-8524-4076-898b-3d59615bd676 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:39.028298 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8331e30f-8524-4076-898b-3d59615bd676 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:39.037496 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8331e30f-8524-4076-898b-3d59615bd676 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:39.038258 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8331e30f-8524-4076-898b-3d59615bd676 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:39.039490 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8331e30f-8524-4076-898b-3d59615bd676 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:39.040216 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8331e30f-8524-4076-898b-3d59615bd676 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:39.074980 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8331e30f-8524-4076-898b-3d59615bd676 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057792 Dec 15 12:44:39.075550 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 375/741] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:39 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:39.612575 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fa8c05f7-d66b-4437-bcc5-d1df17e5f293 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:39.613494 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fa8c05f7-d66b-4437-bcc5-d1df17e5f293 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:39.619879 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fa8c05f7-d66b-4437-bcc5-d1df17e5f293 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:39.620326 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fa8c05f7-d66b-4437-bcc5-d1df17e5f293 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:39.621116 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fa8c05f7-d66b-4437-bcc5-d1df17e5f293 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:39.621574 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fa8c05f7-d66b-4437-bcc5-d1df17e5f293 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:39.650316 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fa8c05f7-d66b-4437-bcc5-d1df17e5f293 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042168 Dec 15 12:44:39.650953 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 367/742] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:39 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:39.715790 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5270bd68-a64c-42c4-9ec8-847571c92b2a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:39.716462 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5270bd68-a64c-42c4-9ec8-847571c92b2a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:39.723934 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5270bd68-a64c-42c4-9ec8-847571c92b2a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:39.724387 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5270bd68-a64c-42c4-9ec8-847571c92b2a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:39.725294 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5270bd68-a64c-42c4-9ec8-847571c92b2a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:39.725831 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5270bd68-a64c-42c4-9ec8-847571c92b2a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:39.870955 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5270bd68-a64c-42c4-9ec8-847571c92b2a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:39.880047 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5270bd68-a64c-42c4-9ec8-847571c92b2a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:39.881617 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5270bd68-a64c-42c4-9ec8-847571c92b2a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:39.882717 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5270bd68-a64c-42c4-9ec8-847571c92b2a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.170667 Dec 15 12:44:39.883274 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 376/743] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:39 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:40.087459 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f4f6b687-7378-41d7-9197-553af7ffd1dc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:40.088642 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f4f6b687-7378-41d7-9197-553af7ffd1dc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:40.095010 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f4f6b687-7378-41d7-9197-553af7ffd1dc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:40.095575 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f4f6b687-7378-41d7-9197-553af7ffd1dc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:40.096649 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f4f6b687-7378-41d7-9197-553af7ffd1dc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:40.097077 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f4f6b687-7378-41d7-9197-553af7ffd1dc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:40.135483 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f4f6b687-7378-41d7-9197-553af7ffd1dc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051874 Dec 15 12:44:40.139716 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 368/744] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:40 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:40.668088 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0cd3a779-7c04-4bae-be7c-a68c0b4cff39 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:40.668991 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0cd3a779-7c04-4bae-be7c-a68c0b4cff39 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:40.675509 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0cd3a779-7c04-4bae-be7c-a68c0b4cff39 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:40.675945 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0cd3a779-7c04-4bae-be7c-a68c0b4cff39 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:40.676722 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0cd3a779-7c04-4bae-be7c-a68c0b4cff39 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:40.677144 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0cd3a779-7c04-4bae-be7c-a68c0b4cff39 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:40.707951 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0cd3a779-7c04-4bae-be7c-a68c0b4cff39 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043487 Dec 15 12:44:40.708532 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 377/745] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:40 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:40.901171 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6fae79b0-91f6-4646-84fd-7bb4043878f8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:40.901803 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6fae79b0-91f6-4646-84fd-7bb4043878f8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:40.908680 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6fae79b0-91f6-4646-84fd-7bb4043878f8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:40.909141 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6fae79b0-91f6-4646-84fd-7bb4043878f8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:40.910018 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6fae79b0-91f6-4646-84fd-7bb4043878f8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:40.910455 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6fae79b0-91f6-4646-84fd-7bb4043878f8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:41.057423 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6fae79b0-91f6-4646-84fd-7bb4043878f8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:41.067507 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6fae79b0-91f6-4646-84fd-7bb4043878f8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:41.069070 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6fae79b0-91f6-4646-84fd-7bb4043878f8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:41.070341 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6fae79b0-91f6-4646-84fd-7bb4043878f8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.172861 Dec 15 12:44:41.070925 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 369/746] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:40 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:41.147795 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d30b14b9-04ea-4207-accb-7e57d3e12b4f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:41.148616 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d30b14b9-04ea-4207-accb-7e57d3e12b4f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:41.154901 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d30b14b9-04ea-4207-accb-7e57d3e12b4f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:41.155523 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d30b14b9-04ea-4207-accb-7e57d3e12b4f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:41.156323 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d30b14b9-04ea-4207-accb-7e57d3e12b4f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:41.156756 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d30b14b9-04ea-4207-accb-7e57d3e12b4f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:41.188135 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d30b14b9-04ea-4207-accb-7e57d3e12b4f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044255 Dec 15 12:44:41.188870 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 378/747] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:41 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:41.719403 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9e978fea-ddc0-4699-94da-4741cd94c450 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:41.720316 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9e978fea-ddc0-4699-94da-4741cd94c450 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:41.727254 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9e978fea-ddc0-4699-94da-4741cd94c450 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:41.727723 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9e978fea-ddc0-4699-94da-4741cd94c450 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:41.728504 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9e978fea-ddc0-4699-94da-4741cd94c450 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:41.728961 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9e978fea-ddc0-4699-94da-4741cd94c450 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:41.761278 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9e978fea-ddc0-4699-94da-4741cd94c450 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045683 Dec 15 12:44:41.761877 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 370/748] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:41 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:42.089040 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-82429054-38a7-4c56-971f-799183b4d818 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:42.089667 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-82429054-38a7-4c56-971f-799183b4d818 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:42.096456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-82429054-38a7-4c56-971f-799183b4d818 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:42.096957 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-82429054-38a7-4c56-971f-799183b4d818 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:42.097897 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-82429054-38a7-4c56-971f-799183b4d818 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:42.098411 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-82429054-38a7-4c56-971f-799183b4d818 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:42.199220 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d27ee691-7221-42ca-a98f-2b3d4bb6ce05 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:42.200153 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d27ee691-7221-42ca-a98f-2b3d4bb6ce05 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:42.208647 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d27ee691-7221-42ca-a98f-2b3d4bb6ce05 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:42.213924 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d27ee691-7221-42ca-a98f-2b3d4bb6ce05 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:42.215040 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d27ee691-7221-42ca-a98f-2b3d4bb6ce05 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:42.215596 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d27ee691-7221-42ca-a98f-2b3d4bb6ce05 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:42.240357 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-82429054-38a7-4c56-971f-799183b4d818 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:42.247891 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d27ee691-7221-42ca-a98f-2b3d4bb6ce05 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052338 Dec 15 12:44:42.252151 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 371/749] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:42 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:44:42.252380 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-82429054-38a7-4c56-971f-799183b4d818 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:42.252380 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-82429054-38a7-4c56-971f-799183b4d818 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:42.252380 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-82429054-38a7-4c56-971f-799183b4d818 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.166850 Dec 15 12:44:42.253038 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 379/750] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:42 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:42.772218 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-880a81fc-fbf5-4169-b1b0-766e2f5b094f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:42.773235 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-880a81fc-fbf5-4169-b1b0-766e2f5b094f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:42.778974 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-880a81fc-fbf5-4169-b1b0-766e2f5b094f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:42.779420 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-880a81fc-fbf5-4169-b1b0-766e2f5b094f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:42.780208 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-880a81fc-fbf5-4169-b1b0-766e2f5b094f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:42.780645 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-880a81fc-fbf5-4169-b1b0-766e2f5b094f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:42.811493 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-880a81fc-fbf5-4169-b1b0-766e2f5b094f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043003 Dec 15 12:44:42.811970 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 372/751] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:42 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:43.260891 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1fd66f84-a3cb-4ade-bf0a-ab6d9b84b567 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:43.261758 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1fd66f84-a3cb-4ade-bf0a-ab6d9b84b567 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:43.268459 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1fd66f84-a3cb-4ade-bf0a-ab6d9b84b567 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:43.268907 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1fd66f84-a3cb-4ade-bf0a-ab6d9b84b567 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:43.269738 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1fd66f84-a3cb-4ade-bf0a-ab6d9b84b567 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:43.270173 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1fd66f84-a3cb-4ade-bf0a-ab6d9b84b567 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:43.272164 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e1d59442-94c2-4aad-b645-77a02923f990 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:43.272780 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e1d59442-94c2-4aad-b645-77a02923f990 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:43.279213 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e1d59442-94c2-4aad-b645-77a02923f990 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:43.279665 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e1d59442-94c2-4aad-b645-77a02923f990 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:43.280452 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e1d59442-94c2-4aad-b645-77a02923f990 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:43.280890 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e1d59442-94c2-4aad-b645-77a02923f990 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:43.306798 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1fd66f84-a3cb-4ade-bf0a-ab6d9b84b567 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050407 Dec 15 12:44:43.309448 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 380/752] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:43 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:43.426404 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e1d59442-94c2-4aad-b645-77a02923f990 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:43.434464 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e1d59442-94c2-4aad-b645-77a02923f990 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:43.435982 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e1d59442-94c2-4aad-b645-77a02923f990 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:43.437150 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e1d59442-94c2-4aad-b645-77a02923f990 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.168572 Dec 15 12:44:43.437765 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 373/753] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:43 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:43.823142 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-12df5278-33ba-4109-a675-fd9ee40af25b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:43.824077 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-12df5278-33ba-4109-a675-fd9ee40af25b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:43.830597 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-12df5278-33ba-4109-a675-fd9ee40af25b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:43.831045 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-12df5278-33ba-4109-a675-fd9ee40af25b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:43.831855 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-12df5278-33ba-4109-a675-fd9ee40af25b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:43.832289 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-12df5278-33ba-4109-a675-fd9ee40af25b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:43.861420 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-12df5278-33ba-4109-a675-fd9ee40af25b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041914 Dec 15 12:44:43.861999 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 381/754] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:43 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:44.323142 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-20a6042a-db42-4966-9516-d12e6e3083e5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:44.324044 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-20a6042a-db42-4966-9516-d12e6e3083e5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:44.330314 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-20a6042a-db42-4966-9516-d12e6e3083e5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:44.330856 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-20a6042a-db42-4966-9516-d12e6e3083e5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:44.331649 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-20a6042a-db42-4966-9516-d12e6e3083e5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:44.332074 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-20a6042a-db42-4966-9516-d12e6e3083e5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:44.363697 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-20a6042a-db42-4966-9516-d12e6e3083e5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044200 Dec 15 12:44:44.364261 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 374/755] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:44 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:44.562346 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6acb4fe8-85fb-425c-96d6-57ab3e2b6034 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:44.562883 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6acb4fe8-85fb-425c-96d6-57ab3e2b6034 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:44.568703 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6acb4fe8-85fb-425c-96d6-57ab3e2b6034 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:44.569147 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6acb4fe8-85fb-425c-96d6-57ab3e2b6034 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:44.569963 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6acb4fe8-85fb-425c-96d6-57ab3e2b6034 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:44.570388 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6acb4fe8-85fb-425c-96d6-57ab3e2b6034 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:44.704778 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6acb4fe8-85fb-425c-96d6-57ab3e2b6034 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:44.713915 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6acb4fe8-85fb-425c-96d6-57ab3e2b6034 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:44.715839 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6acb4fe8-85fb-425c-96d6-57ab3e2b6034 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:44.717238 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6acb4fe8-85fb-425c-96d6-57ab3e2b6034 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.265019 Dec 15 12:44:44.717940 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 382/756] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:44 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:44.972583 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0614dbcd-778d-4a54-9165-2a613cb9e25c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:44.973561 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0614dbcd-778d-4a54-9165-2a613cb9e25c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:44.979641 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0614dbcd-778d-4a54-9165-2a613cb9e25c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:44.980084 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0614dbcd-778d-4a54-9165-2a613cb9e25c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:44.980875 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0614dbcd-778d-4a54-9165-2a613cb9e25c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:44.981308 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0614dbcd-778d-4a54-9165-2a613cb9e25c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:45.010214 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0614dbcd-778d-4a54-9165-2a613cb9e25c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141624 Dec 15 12:44:45.010773 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 375/757] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:44 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:45.375008 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-500d4992-c5f8-4418-aa89-bab4f6085936 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:45.376551 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-500d4992-c5f8-4418-aa89-bab4f6085936 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:45.382564 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-500d4992-c5f8-4418-aa89-bab4f6085936 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:45.383020 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-500d4992-c5f8-4418-aa89-bab4f6085936 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:45.383810 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-500d4992-c5f8-4418-aa89-bab4f6085936 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:45.384250 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-500d4992-c5f8-4418-aa89-bab4f6085936 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:45.414428 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-500d4992-c5f8-4418-aa89-bab4f6085936 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043239 Dec 15 12:44:45.414983 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 383/758] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:45 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:45.738327 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bd21417c-4b12-45e8-adba-fa4d7c65fb6e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:45.738969 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bd21417c-4b12-45e8-adba-fa4d7c65fb6e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:45.745188 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd21417c-4b12-45e8-adba-fa4d7c65fb6e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:45.745670 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd21417c-4b12-45e8-adba-fa4d7c65fb6e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:45.746455 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd21417c-4b12-45e8-adba-fa4d7c65fb6e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:45.746892 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd21417c-4b12-45e8-adba-fa4d7c65fb6e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:45.880060 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bd21417c-4b12-45e8-adba-fa4d7c65fb6e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:45.888168 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bd21417c-4b12-45e8-adba-fa4d7c65fb6e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:45.889675 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bd21417c-4b12-45e8-adba-fa4d7c65fb6e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:45.890827 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bd21417c-4b12-45e8-adba-fa4d7c65fb6e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.157103 Dec 15 12:44:45.892036 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 376/759] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:45 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:46.022283 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-984e7d2a-86bd-4829-9747-124d638b9e77 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:46.023186 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-984e7d2a-86bd-4829-9747-124d638b9e77 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:46.029400 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-984e7d2a-86bd-4829-9747-124d638b9e77 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:46.029868 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-984e7d2a-86bd-4829-9747-124d638b9e77 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:46.030642 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-984e7d2a-86bd-4829-9747-124d638b9e77 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:46.031072 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-984e7d2a-86bd-4829-9747-124d638b9e77 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:46.060893 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-984e7d2a-86bd-4829-9747-124d638b9e77 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042429 Dec 15 12:44:46.061446 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 384/760] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:46 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:46.425445 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6847442b-c9d1-451d-b7fd-cd7a47888266 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:46.426427 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6847442b-c9d1-451d-b7fd-cd7a47888266 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:46.432203 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6847442b-c9d1-451d-b7fd-cd7a47888266 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:46.432785 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6847442b-c9d1-451d-b7fd-cd7a47888266 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:46.433858 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6847442b-c9d1-451d-b7fd-cd7a47888266 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:46.434307 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6847442b-c9d1-451d-b7fd-cd7a47888266 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:46.468533 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6847442b-c9d1-451d-b7fd-cd7a47888266 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047270 Dec 15 12:44:46.469145 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 377/761] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:46 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:46.910187 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ce48ad0d-5133-40b2-89ed-8e87c4258335 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:46.910599 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ce48ad0d-5133-40b2-89ed-8e87c4258335 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:46.916943 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce48ad0d-5133-40b2-89ed-8e87c4258335 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:46.917401 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce48ad0d-5133-40b2-89ed-8e87c4258335 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:46.918215 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce48ad0d-5133-40b2-89ed-8e87c4258335 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:46.918647 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce48ad0d-5133-40b2-89ed-8e87c4258335 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:47.052743 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ce48ad0d-5133-40b2-89ed-8e87c4258335 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:47.067936 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ce48ad0d-5133-40b2-89ed-8e87c4258335 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:47.069762 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ce48ad0d-5133-40b2-89ed-8e87c4258335 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:47.070971 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ce48ad0d-5133-40b2-89ed-8e87c4258335 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.164946 Dec 15 12:44:47.071641 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 385/762] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:46 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:47.076644 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-732dd8f7-4c84-4f34-bf20-4722c2e5269c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:47.077567 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-732dd8f7-4c84-4f34-bf20-4722c2e5269c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:47.083805 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-732dd8f7-4c84-4f34-bf20-4722c2e5269c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:47.084244 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-732dd8f7-4c84-4f34-bf20-4722c2e5269c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:47.085015 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-732dd8f7-4c84-4f34-bf20-4722c2e5269c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:47.085442 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-732dd8f7-4c84-4f34-bf20-4722c2e5269c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:47.114869 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-732dd8f7-4c84-4f34-bf20-4722c2e5269c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041857 Dec 15 12:44:47.115455 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 378/763] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:47 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:47.490732 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f5f74dbe-ac92-4f89-a110-c322d56ba22e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:47.491658 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f5f74dbe-ac92-4f89-a110-c322d56ba22e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:47.497531 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f5f74dbe-ac92-4f89-a110-c322d56ba22e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:47.498002 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f5f74dbe-ac92-4f89-a110-c322d56ba22e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:47.498796 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f5f74dbe-ac92-4f89-a110-c322d56ba22e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:47.499230 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f5f74dbe-ac92-4f89-a110-c322d56ba22e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:47.528667 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f5f74dbe-ac92-4f89-a110-c322d56ba22e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043897 Dec 15 12:44:47.529472 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 386/764] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:47 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:48.088749 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c3b1c2b0-1c44-4197-89d3-8f56f014af9b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:48.089362 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c3b1c2b0-1c44-4197-89d3-8f56f014af9b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:48.095893 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c3b1c2b0-1c44-4197-89d3-8f56f014af9b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:48.096340 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c3b1c2b0-1c44-4197-89d3-8f56f014af9b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:48.097119 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c3b1c2b0-1c44-4197-89d3-8f56f014af9b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:48.097588 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c3b1c2b0-1c44-4197-89d3-8f56f014af9b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:48.126775 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ef32da48-7852-47fa-a338-fabccd4a73a1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:48.127677 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ef32da48-7852-47fa-a338-fabccd4a73a1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:48.134305 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ef32da48-7852-47fa-a338-fabccd4a73a1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:48.134797 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ef32da48-7852-47fa-a338-fabccd4a73a1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:48.135592 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ef32da48-7852-47fa-a338-fabccd4a73a1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:48.136041 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ef32da48-7852-47fa-a338-fabccd4a73a1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:48.166165 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ef32da48-7852-47fa-a338-fabccd4a73a1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043497 Dec 15 12:44:48.166761 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 387/765] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:48 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:44:48.241172 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c3b1c2b0-1c44-4197-89d3-8f56f014af9b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:48.249314 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c3b1c2b0-1c44-4197-89d3-8f56f014af9b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:48.251631 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c3b1c2b0-1c44-4197-89d3-8f56f014af9b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:48.252775 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c3b1c2b0-1c44-4197-89d3-8f56f014af9b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.167744 Dec 15 12:44:48.253330 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 379/766] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:48 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:48.548362 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8c5bca23-0554-4259-9323-6fd8e0d8385d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:48.549445 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8c5bca23-0554-4259-9323-6fd8e0d8385d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:48.555445 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8c5bca23-0554-4259-9323-6fd8e0d8385d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:48.555893 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8c5bca23-0554-4259-9323-6fd8e0d8385d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:48.556678 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8c5bca23-0554-4259-9323-6fd8e0d8385d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:48.557110 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8c5bca23-0554-4259-9323-6fd8e0d8385d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:48.587011 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8c5bca23-0554-4259-9323-6fd8e0d8385d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043071 Dec 15 12:44:48.587577 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 388/767] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:48 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:44:49.177536 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c159c332-c28f-400f-a55b-f347af6b3aba tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:49.178441 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c159c332-c28f-400f-a55b-f347af6b3aba tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:49.184768 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c159c332-c28f-400f-a55b-f347af6b3aba tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:49.185207 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c159c332-c28f-400f-a55b-f347af6b3aba tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:49.186012 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c159c332-c28f-400f-a55b-f347af6b3aba tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:49.186439 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c159c332-c28f-400f-a55b-f347af6b3aba tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:49.218684 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c159c332-c28f-400f-a55b-f347af6b3aba tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044889 Dec 15 12:44:49.219956 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 380/768] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:49 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:49.271373 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5b4655e7-ea1b-4795-a571-7fa97f227e61 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:49.271915 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5b4655e7-ea1b-4795-a571-7fa97f227e61 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:49.278946 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5b4655e7-ea1b-4795-a571-7fa97f227e61 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:49.279412 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5b4655e7-ea1b-4795-a571-7fa97f227e61 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:49.280193 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5b4655e7-ea1b-4795-a571-7fa97f227e61 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:49.280635 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5b4655e7-ea1b-4795-a571-7fa97f227e61 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:49.410567 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5b4655e7-ea1b-4795-a571-7fa97f227e61 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:49.419262 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5b4655e7-ea1b-4795-a571-7fa97f227e61 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:49.420746 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5b4655e7-ea1b-4795-a571-7fa97f227e61 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:49.421924 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5b4655e7-ea1b-4795-a571-7fa97f227e61 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.154483 Dec 15 12:44:49.423266 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 389/769] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:49 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:49.598974 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fc45608f-38e5-4f7c-9c8d-7637a6e1b823 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:49.603090 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fc45608f-38e5-4f7c-9c8d-7637a6e1b823 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:49.605880 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fc45608f-38e5-4f7c-9c8d-7637a6e1b823 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:49.606323 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fc45608f-38e5-4f7c-9c8d-7637a6e1b823 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:49.607098 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fc45608f-38e5-4f7c-9c8d-7637a6e1b823 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:49.607530 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fc45608f-38e5-4f7c-9c8d-7637a6e1b823 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:49.639002 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fc45608f-38e5-4f7c-9c8d-7637a6e1b823 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043872 Dec 15 12:44:49.639561 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 381/770] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:49 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:50.230830 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4cf5e431-ee69-4c24-a0fb-605e82dbd727 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:50.231740 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4cf5e431-ee69-4c24-a0fb-605e82dbd727 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:50.237785 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4cf5e431-ee69-4c24-a0fb-605e82dbd727 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:50.238265 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4cf5e431-ee69-4c24-a0fb-605e82dbd727 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:50.239041 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4cf5e431-ee69-4c24-a0fb-605e82dbd727 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:50.239501 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4cf5e431-ee69-4c24-a0fb-605e82dbd727 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:50.270740 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4cf5e431-ee69-4c24-a0fb-605e82dbd727 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043585 Dec 15 12:44:50.271322 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 390/771] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:50 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:50.441625 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8dc7005e-6638-47de-90ef-c74984fb9646 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:50.442412 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8dc7005e-6638-47de-90ef-c74984fb9646 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:50.448594 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8dc7005e-6638-47de-90ef-c74984fb9646 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:50.449049 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8dc7005e-6638-47de-90ef-c74984fb9646 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:50.449863 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8dc7005e-6638-47de-90ef-c74984fb9646 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:50.450296 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8dc7005e-6638-47de-90ef-c74984fb9646 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:50.592525 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8dc7005e-6638-47de-90ef-c74984fb9646 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:50.601084 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8dc7005e-6638-47de-90ef-c74984fb9646 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:50.602696 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8dc7005e-6638-47de-90ef-c74984fb9646 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:50.603933 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8dc7005e-6638-47de-90ef-c74984fb9646 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.166490 Dec 15 12:44:50.613895 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 382/772] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:50 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:50.650963 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e5c94405-6262-485b-8a68-736d125588b9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:50.651894 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e5c94405-6262-485b-8a68-736d125588b9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:50.659233 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e5c94405-6262-485b-8a68-736d125588b9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:50.659673 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e5c94405-6262-485b-8a68-736d125588b9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:50.660452 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e5c94405-6262-485b-8a68-736d125588b9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:50.660880 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e5c94405-6262-485b-8a68-736d125588b9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:50.691484 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e5c94405-6262-485b-8a68-736d125588b9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044369 Dec 15 12:44:50.692107 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 391/773] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:50 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:51.282847 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-57b73d0a-6e01-441e-b3a4-20ac841734c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:51.283755 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-57b73d0a-6e01-441e-b3a4-20ac841734c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:51.289775 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-57b73d0a-6e01-441e-b3a4-20ac841734c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:51.290582 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-57b73d0a-6e01-441e-b3a4-20ac841734c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:51.291612 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-57b73d0a-6e01-441e-b3a4-20ac841734c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:51.291979 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-57b73d0a-6e01-441e-b3a4-20ac841734c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:51.321917 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-57b73d0a-6e01-441e-b3a4-20ac841734c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043507 Dec 15 12:44:51.322478 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 383/774] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:51 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:51.622729 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0958dfe5-d423-43f8-a25a-01803380147d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:51.623328 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0958dfe5-d423-43f8-a25a-01803380147d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:51.630174 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0958dfe5-d423-43f8-a25a-01803380147d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:51.630610 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0958dfe5-d423-43f8-a25a-01803380147d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:51.631378 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0958dfe5-d423-43f8-a25a-01803380147d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:51.631802 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0958dfe5-d423-43f8-a25a-01803380147d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:51.711828 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8b7a1f85-f711-4b91-8601-a1edf420b5a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:51.713094 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8b7a1f85-f711-4b91-8601-a1edf420b5a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:51.720624 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8b7a1f85-f711-4b91-8601-a1edf420b5a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:51.720624 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8b7a1f85-f711-4b91-8601-a1edf420b5a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:51.721232 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8b7a1f85-f711-4b91-8601-a1edf420b5a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:51.721735 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8b7a1f85-f711-4b91-8601-a1edf420b5a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:51.751526 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8b7a1f85-f711-4b91-8601-a1edf420b5a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051736 Dec 15 12:44:51.752273 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 384/775] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:51 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:51.782691 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0958dfe5-d423-43f8-a25a-01803380147d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:51.790905 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0958dfe5-d423-43f8-a25a-01803380147d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:51.792447 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0958dfe5-d423-43f8-a25a-01803380147d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:51.793627 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0958dfe5-d423-43f8-a25a-01803380147d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.174541 Dec 15 12:44:51.794193 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 392/776] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:51 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:52.333517 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-50c11c34-5a71-4d07-82c2-1e8de1c96441 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:52.334472 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-50c11c34-5a71-4d07-82c2-1e8de1c96441 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:52.340545 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-50c11c34-5a71-4d07-82c2-1e8de1c96441 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:52.340994 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-50c11c34-5a71-4d07-82c2-1e8de1c96441 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:52.341827 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-50c11c34-5a71-4d07-82c2-1e8de1c96441 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:52.342272 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-50c11c34-5a71-4d07-82c2-1e8de1c96441 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:52.371677 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-50c11c34-5a71-4d07-82c2-1e8de1c96441 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042090 Dec 15 12:44:52.372244 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 385/777] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:52 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:52.764225 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fb10206f-325d-429d-bd68-7cd3f6c384e4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:52.765162 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fb10206f-325d-429d-bd68-7cd3f6c384e4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:52.772119 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fb10206f-325d-429d-bd68-7cd3f6c384e4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:52.772568 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fb10206f-325d-429d-bd68-7cd3f6c384e4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:52.773375 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fb10206f-325d-429d-bd68-7cd3f6c384e4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:52.773835 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fb10206f-325d-429d-bd68-7cd3f6c384e4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:52.805457 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fb10206f-325d-429d-bd68-7cd3f6c384e4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044616 Dec 15 12:44:52.806402 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 393/778] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:52 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:52.813813 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0d2e09cf-bf03-4d03-b676-35343b6a05f6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:52.814427 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0d2e09cf-bf03-4d03-b676-35343b6a05f6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:52.822623 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0d2e09cf-bf03-4d03-b676-35343b6a05f6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:52.823331 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0d2e09cf-bf03-4d03-b676-35343b6a05f6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:52.824419 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0d2e09cf-bf03-4d03-b676-35343b6a05f6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:52.824855 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0d2e09cf-bf03-4d03-b676-35343b6a05f6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:52.963858 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0d2e09cf-bf03-4d03-b676-35343b6a05f6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:52.973146 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0d2e09cf-bf03-4d03-b676-35343b6a05f6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:52.974673 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0d2e09cf-bf03-4d03-b676-35343b6a05f6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:52.975835 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0d2e09cf-bf03-4d03-b676-35343b6a05f6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.167542 Dec 15 12:44:52.976402 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 386/779] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:52 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:53.383609 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e9fbda97-7a74-4279-b7b8-3a355fe567c5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:53.384521 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e9fbda97-7a74-4279-b7b8-3a355fe567c5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:53.390389 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e9fbda97-7a74-4279-b7b8-3a355fe567c5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:53.390942 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e9fbda97-7a74-4279-b7b8-3a355fe567c5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:53.391778 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e9fbda97-7a74-4279-b7b8-3a355fe567c5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:53.392208 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e9fbda97-7a74-4279-b7b8-3a355fe567c5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:53.419826 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e9fbda97-7a74-4279-b7b8-3a355fe567c5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039984 Dec 15 12:44:53.420377 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 394/780] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:53 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:53.816192 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8cb6fb1b-689c-4a70-979c-90545dc057f3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:53.817086 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8cb6fb1b-689c-4a70-979c-90545dc057f3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:53.823325 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8cb6fb1b-689c-4a70-979c-90545dc057f3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:53.823763 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8cb6fb1b-689c-4a70-979c-90545dc057f3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:53.824527 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8cb6fb1b-689c-4a70-979c-90545dc057f3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:53.824953 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8cb6fb1b-689c-4a70-979c-90545dc057f3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:53.854844 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8cb6fb1b-689c-4a70-979c-90545dc057f3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042416 Dec 15 12:44:53.855406 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 387/781] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:53 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:44:53.994055 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7ef1aa52-e8ac-4371-b3ef-7508b15f1cc5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:53.994663 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7ef1aa52-e8ac-4371-b3ef-7508b15f1cc5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:54.003540 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7ef1aa52-e8ac-4371-b3ef-7508b15f1cc5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:54.004477 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7ef1aa52-e8ac-4371-b3ef-7508b15f1cc5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:54.005773 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7ef1aa52-e8ac-4371-b3ef-7508b15f1cc5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:54.006400 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7ef1aa52-e8ac-4371-b3ef-7508b15f1cc5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:54.138621 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7ef1aa52-e8ac-4371-b3ef-7508b15f1cc5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:54.147224 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7ef1aa52-e8ac-4371-b3ef-7508b15f1cc5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:54.148749 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7ef1aa52-e8ac-4371-b3ef-7508b15f1cc5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:54.149886 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7ef1aa52-e8ac-4371-b3ef-7508b15f1cc5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.160068 Dec 15 12:44:54.150442 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 395/782] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:53 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:54.431942 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d41f8515-473d-4b36-bdc5-c3dda3fce06b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:54.432886 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d41f8515-473d-4b36-bdc5-c3dda3fce06b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:54.438900 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d41f8515-473d-4b36-bdc5-c3dda3fce06b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:54.439637 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d41f8515-473d-4b36-bdc5-c3dda3fce06b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:54.440123 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d41f8515-473d-4b36-bdc5-c3dda3fce06b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:54.440557 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d41f8515-473d-4b36-bdc5-c3dda3fce06b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:54.474408 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d41f8515-473d-4b36-bdc5-c3dda3fce06b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046203 Dec 15 12:44:54.474997 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 388/783] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:54 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:54.866657 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bf1976a3-5d49-4a12-a52d-70c66a2707b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:54.867557 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bf1976a3-5d49-4a12-a52d-70c66a2707b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:54.873376 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bf1976a3-5d49-4a12-a52d-70c66a2707b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:54.873857 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bf1976a3-5d49-4a12-a52d-70c66a2707b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:54.874646 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bf1976a3-5d49-4a12-a52d-70c66a2707b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:54.875680 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bf1976a3-5d49-4a12-a52d-70c66a2707b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:54.906171 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bf1976a3-5d49-4a12-a52d-70c66a2707b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043201 Dec 15 12:44:54.906890 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 396/784] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:54 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:55.168119 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c48c6654-d864-4a42-9c06-f8df89267ac5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:55.168706 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c48c6654-d864-4a42-9c06-f8df89267ac5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:55.175712 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c48c6654-d864-4a42-9c06-f8df89267ac5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:55.176160 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c48c6654-d864-4a42-9c06-f8df89267ac5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:55.176944 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c48c6654-d864-4a42-9c06-f8df89267ac5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:55.177382 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c48c6654-d864-4a42-9c06-f8df89267ac5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:55.319005 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c48c6654-d864-4a42-9c06-f8df89267ac5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:55.329385 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c48c6654-d864-4a42-9c06-f8df89267ac5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:55.330919 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c48c6654-d864-4a42-9c06-f8df89267ac5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:55.332072 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c48c6654-d864-4a42-9c06-f8df89267ac5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.167759 Dec 15 12:44:55.332621 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 389/785] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:55 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:55.486768 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0daad2bf-a210-492c-8aef-ada69094e7cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:55.487621 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0daad2bf-a210-492c-8aef-ada69094e7cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:55.493816 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0daad2bf-a210-492c-8aef-ada69094e7cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:55.494299 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0daad2bf-a210-492c-8aef-ada69094e7cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:55.495092 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0daad2bf-a210-492c-8aef-ada69094e7cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:55.495522 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0daad2bf-a210-492c-8aef-ada69094e7cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:55.525537 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0daad2bf-a210-492c-8aef-ada69094e7cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043244 Dec 15 12:44:55.526111 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 397/786] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:55 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:55.917543 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f67892bf-74f9-41a7-8c93-420bcf20e5f4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:55.918446 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f67892bf-74f9-41a7-8c93-420bcf20e5f4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:55.928065 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f67892bf-74f9-41a7-8c93-420bcf20e5f4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:55.928511 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f67892bf-74f9-41a7-8c93-420bcf20e5f4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:55.929321 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f67892bf-74f9-41a7-8c93-420bcf20e5f4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:55.929782 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f67892bf-74f9-41a7-8c93-420bcf20e5f4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:55.959018 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f67892bf-74f9-41a7-8c93-420bcf20e5f4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045159 Dec 15 12:44:55.959572 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 390/787] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:55 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:56.350486 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d93b544e-fe9b-4a2e-89b1-4819efd3771a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:56.351211 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d93b544e-fe9b-4a2e-89b1-4819efd3771a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:56.357406 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d93b544e-fe9b-4a2e-89b1-4819efd3771a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:56.357978 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d93b544e-fe9b-4a2e-89b1-4819efd3771a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:56.358778 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d93b544e-fe9b-4a2e-89b1-4819efd3771a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:56.359198 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d93b544e-fe9b-4a2e-89b1-4819efd3771a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:56.489779 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d93b544e-fe9b-4a2e-89b1-4819efd3771a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:56.500927 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d93b544e-fe9b-4a2e-89b1-4819efd3771a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:56.503415 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d93b544e-fe9b-4a2e-89b1-4819efd3771a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:56.506050 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d93b544e-fe9b-4a2e-89b1-4819efd3771a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.159019 Dec 15 12:44:56.506952 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 398/788] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:56 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:56.536419 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-902926eb-09c5-4169-8dd9-13114e5e5816 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:56.537331 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-902926eb-09c5-4169-8dd9-13114e5e5816 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:56.543612 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-902926eb-09c5-4169-8dd9-13114e5e5816 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:56.544063 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-902926eb-09c5-4169-8dd9-13114e5e5816 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:56.544835 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-902926eb-09c5-4169-8dd9-13114e5e5816 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:56.545271 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-902926eb-09c5-4169-8dd9-13114e5e5816 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:56.576752 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-902926eb-09c5-4169-8dd9-13114e5e5816 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043869 Dec 15 12:44:56.577246 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 391/789] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:56 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:56.976069 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ce53129c-6dc3-4dae-bc97-880f10e81301 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:56.977100 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ce53129c-6dc3-4dae-bc97-880f10e81301 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:56.983058 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce53129c-6dc3-4dae-bc97-880f10e81301 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:56.983509 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce53129c-6dc3-4dae-bc97-880f10e81301 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:56.984299 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce53129c-6dc3-4dae-bc97-880f10e81301 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:56.985360 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce53129c-6dc3-4dae-bc97-880f10e81301 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:57.013911 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ce53129c-6dc3-4dae-bc97-880f10e81301 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042600 Dec 15 12:44:57.014484 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 399/790] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:56 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:57.525339 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e0cf4259-fc71-49d6-a2df-ffa0fdddcd0b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:57.525969 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e0cf4259-fc71-49d6-a2df-ffa0fdddcd0b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:57.531956 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0cf4259-fc71-49d6-a2df-ffa0fdddcd0b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:57.532418 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0cf4259-fc71-49d6-a2df-ffa0fdddcd0b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:57.533405 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0cf4259-fc71-49d6-a2df-ffa0fdddcd0b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:57.533668 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0cf4259-fc71-49d6-a2df-ffa0fdddcd0b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:57.588245 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-74e415f9-e83a-4224-a625-f9e13760d3d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:57.589291 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-74e415f9-e83a-4224-a625-f9e13760d3d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:57.596461 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-74e415f9-e83a-4224-a625-f9e13760d3d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:57.597008 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-74e415f9-e83a-4224-a625-f9e13760d3d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:57.598269 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-74e415f9-e83a-4224-a625-f9e13760d3d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:57.598524 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-74e415f9-e83a-4224-a625-f9e13760d3d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:57.628350 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-74e415f9-e83a-4224-a625-f9e13760d3d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043890 Dec 15 12:44:57.628924 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 400/791] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:57 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:44:57.667850 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e0cf4259-fc71-49d6-a2df-ffa0fdddcd0b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:57.676130 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e0cf4259-fc71-49d6-a2df-ffa0fdddcd0b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:57.677628 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e0cf4259-fc71-49d6-a2df-ffa0fdddcd0b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:57.678803 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e0cf4259-fc71-49d6-a2df-ffa0fdddcd0b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.157475 Dec 15 12:44:57.679352 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 392/792] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:57 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:58.025523 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-408f2140-a5ce-4063-9b78-26d0fdcf83f4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:58.026460 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-408f2140-a5ce-4063-9b78-26d0fdcf83f4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:58.032274 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-408f2140-a5ce-4063-9b78-26d0fdcf83f4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:58.032723 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-408f2140-a5ce-4063-9b78-26d0fdcf83f4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:58.033501 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-408f2140-a5ce-4063-9b78-26d0fdcf83f4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:58.033959 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-408f2140-a5ce-4063-9b78-26d0fdcf83f4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:58.070773 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-408f2140-a5ce-4063-9b78-26d0fdcf83f4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048735 Dec 15 12:44:58.071632 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 401/793] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:58 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:58.640093 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0bcb8b25-5d61-4477-81f2-bef0f5425d8d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:58.641724 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0bcb8b25-5d61-4477-81f2-bef0f5425d8d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:58.648075 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0bcb8b25-5d61-4477-81f2-bef0f5425d8d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:58.648526 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0bcb8b25-5d61-4477-81f2-bef0f5425d8d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:58.649328 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0bcb8b25-5d61-4477-81f2-bef0f5425d8d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:58.649792 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0bcb8b25-5d61-4477-81f2-bef0f5425d8d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:58.679324 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0bcb8b25-5d61-4477-81f2-bef0f5425d8d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042983 Dec 15 12:44:58.679964 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 393/794] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:58 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:58.697411 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-54afc4e0-f05c-435c-a3d9-7770c292a1d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:58.698044 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-54afc4e0-f05c-435c-a3d9-7770c292a1d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:58.705772 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-54afc4e0-f05c-435c-a3d9-7770c292a1d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:58.706226 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-54afc4e0-f05c-435c-a3d9-7770c292a1d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:58.707025 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-54afc4e0-f05c-435c-a3d9-7770c292a1d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:58.707458 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-54afc4e0-f05c-435c-a3d9-7770c292a1d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:58.849648 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-54afc4e0-f05c-435c-a3d9-7770c292a1d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:58.858313 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-54afc4e0-f05c-435c-a3d9-7770c292a1d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:58.860587 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-54afc4e0-f05c-435c-a3d9-7770c292a1d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:44:58.862332 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-54afc4e0-f05c-435c-a3d9-7770c292a1d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.168347 Dec 15 12:44:58.873526 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 402/795] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:58 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:44:59.084442 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b67879e4-70ea-426f-a1be-a1ec1bcf2f64 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:59.085348 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b67879e4-70ea-426f-a1be-a1ec1bcf2f64 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:59.091275 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b67879e4-70ea-426f-a1be-a1ec1bcf2f64 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:59.091723 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b67879e4-70ea-426f-a1be-a1ec1bcf2f64 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:59.092499 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b67879e4-70ea-426f-a1be-a1ec1bcf2f64 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:59.092924 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b67879e4-70ea-426f-a1be-a1ec1bcf2f64 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:59.122836 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b67879e4-70ea-426f-a1be-a1ec1bcf2f64 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042082 Dec 15 12:44:59.123392 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 394/796] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:59 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:59.691299 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b987d666-3f6e-4724-9734-3e28fa50a3cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:59.692195 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b987d666-3f6e-4724-9734-3e28fa50a3cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:59.698122 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b987d666-3f6e-4724-9734-3e28fa50a3cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:59.698771 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b987d666-3f6e-4724-9734-3e28fa50a3cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:59.699317 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b987d666-3f6e-4724-9734-3e28fa50a3cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:59.699747 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b987d666-3f6e-4724-9734-3e28fa50a3cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:59.730339 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b987d666-3f6e-4724-9734-3e28fa50a3cc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042844 Dec 15 12:44:59.730925 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 403/797] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:44:59 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:44:59.881048 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-75b41801-5af2-4be0-8f4c-fda9808b98d8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:44:59.881780 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-75b41801-5af2-4be0-8f4c-fda9808b98d8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:44:59.888755 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-75b41801-5af2-4be0-8f4c-fda9808b98d8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:59.889189 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-75b41801-5af2-4be0-8f4c-fda9808b98d8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:44:59.890011 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-75b41801-5af2-4be0-8f4c-fda9808b98d8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:44:59.890442 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-75b41801-5af2-4be0-8f4c-fda9808b98d8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:00.029446 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-75b41801-5af2-4be0-8f4c-fda9808b98d8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:00.038879 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-75b41801-5af2-4be0-8f4c-fda9808b98d8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:00.041201 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-75b41801-5af2-4be0-8f4c-fda9808b98d8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:00.043233 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-75b41801-5af2-4be0-8f4c-fda9808b98d8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.165772 Dec 15 12:45:00.044174 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 395/798] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:44:59 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:00.134899 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b2bd119a-5e69-45b6-b547-924d7a86488f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:00.135793 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b2bd119a-5e69-45b6-b547-924d7a86488f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:00.141939 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b2bd119a-5e69-45b6-b547-924d7a86488f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:00.142390 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b2bd119a-5e69-45b6-b547-924d7a86488f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:00.143193 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b2bd119a-5e69-45b6-b547-924d7a86488f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:00.143635 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b2bd119a-5e69-45b6-b547-924d7a86488f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:00.174081 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b2bd119a-5e69-45b6-b547-924d7a86488f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042860 Dec 15 12:45:00.174639 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 404/799] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:00 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:00.742633 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4de2b55c-6639-4c6e-a79e-6ce7718475ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:00.743722 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4de2b55c-6639-4c6e-a79e-6ce7718475ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:00.749722 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4de2b55c-6639-4c6e-a79e-6ce7718475ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:00.750275 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4de2b55c-6639-4c6e-a79e-6ce7718475ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:00.751065 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4de2b55c-6639-4c6e-a79e-6ce7718475ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:00.751498 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4de2b55c-6639-4c6e-a79e-6ce7718475ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:00.786885 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4de2b55c-6639-4c6e-a79e-6ce7718475ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048959 Dec 15 12:45:00.787435 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 396/800] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:00 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:01.061428 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ecee1ac9-8f41-42bd-89b1-2d6be0b2610e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:01.062074 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ecee1ac9-8f41-42bd-89b1-2d6be0b2610e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:01.068290 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ecee1ac9-8f41-42bd-89b1-2d6be0b2610e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:01.068738 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ecee1ac9-8f41-42bd-89b1-2d6be0b2610e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:01.069526 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ecee1ac9-8f41-42bd-89b1-2d6be0b2610e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:01.069976 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ecee1ac9-8f41-42bd-89b1-2d6be0b2610e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:01.185553 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-707ee8da-63e7-4c06-a2ec-eb3e47f0989f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:01.186596 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-707ee8da-63e7-4c06-a2ec-eb3e47f0989f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:01.193443 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-707ee8da-63e7-4c06-a2ec-eb3e47f0989f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:01.193925 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-707ee8da-63e7-4c06-a2ec-eb3e47f0989f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:01.194706 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-707ee8da-63e7-4c06-a2ec-eb3e47f0989f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:01.195134 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-707ee8da-63e7-4c06-a2ec-eb3e47f0989f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:01.213121 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ecee1ac9-8f41-42bd-89b1-2d6be0b2610e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:01.222031 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ecee1ac9-8f41-42bd-89b1-2d6be0b2610e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:01.223613 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ecee1ac9-8f41-42bd-89b1-2d6be0b2610e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:01.224776 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-707ee8da-63e7-4c06-a2ec-eb3e47f0989f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043021 Dec 15 12:45:01.224894 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ecee1ac9-8f41-42bd-89b1-2d6be0b2610e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.167101 Dec 15 12:45:01.225587 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 397/801] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:01 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:01.225725 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 405/802] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:01 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:01.801073 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0db0ad5d-deb2-4bb3-a3fc-caf99eb436fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:01.802394 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0db0ad5d-deb2-4bb3-a3fc-caf99eb436fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:01.811379 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0db0ad5d-deb2-4bb3-a3fc-caf99eb436fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:01.812056 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0db0ad5d-deb2-4bb3-a3fc-caf99eb436fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:01.814002 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0db0ad5d-deb2-4bb3-a3fc-caf99eb436fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:01.814687 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0db0ad5d-deb2-4bb3-a3fc-caf99eb436fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:01.848541 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0db0ad5d-deb2-4bb3-a3fc-caf99eb436fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053323 Dec 15 12:45:01.849108 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 398/803] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:01 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:02.239713 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f8cc4d1e-5da9-4147-8268-69db703bcfd5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:02.240740 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f8cc4d1e-5da9-4147-8268-69db703bcfd5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:02.241874 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-50a2be64-57fa-4f1e-b30f-5f41429efc3c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:02.242512 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-50a2be64-57fa-4f1e-b30f-5f41429efc3c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:02.246988 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f8cc4d1e-5da9-4147-8268-69db703bcfd5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:02.247441 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f8cc4d1e-5da9-4147-8268-69db703bcfd5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:02.248228 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f8cc4d1e-5da9-4147-8268-69db703bcfd5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:02.248661 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f8cc4d1e-5da9-4147-8268-69db703bcfd5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:02.248767 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-50a2be64-57fa-4f1e-b30f-5f41429efc3c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:02.249163 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-50a2be64-57fa-4f1e-b30f-5f41429efc3c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:02.250107 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-50a2be64-57fa-4f1e-b30f-5f41429efc3c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:02.250550 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-50a2be64-57fa-4f1e-b30f-5f41429efc3c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:02.286105 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f8cc4d1e-5da9-4147-8268-69db703bcfd5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050061 Dec 15 12:45:02.286702 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 406/804] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:02 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:02.384409 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-50a2be64-57fa-4f1e-b30f-5f41429efc3c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:02.394334 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-50a2be64-57fa-4f1e-b30f-5f41429efc3c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:02.395735 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-50a2be64-57fa-4f1e-b30f-5f41429efc3c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:02.396902 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-50a2be64-57fa-4f1e-b30f-5f41429efc3c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.158638 Dec 15 12:45:02.397743 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 399/805] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:02 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:02.861656 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-54ababcd-4681-4c52-8bb2-3aa7164aa56c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:02.863259 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-54ababcd-4681-4c52-8bb2-3aa7164aa56c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:02.870345 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-54ababcd-4681-4c52-8bb2-3aa7164aa56c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:02.870795 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-54ababcd-4681-4c52-8bb2-3aa7164aa56c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:02.871602 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-54ababcd-4681-4c52-8bb2-3aa7164aa56c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:02.872041 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-54ababcd-4681-4c52-8bb2-3aa7164aa56c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:02.902027 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-54ababcd-4681-4c52-8bb2-3aa7164aa56c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045996 Dec 15 12:45:02.902581 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 407/806] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:02 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:03.296951 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3b9db90a-6530-423d-9938-4e3e4d364a54 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:03.297905 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3b9db90a-6530-423d-9938-4e3e4d364a54 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:03.304935 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3b9db90a-6530-423d-9938-4e3e4d364a54 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:03.305388 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3b9db90a-6530-423d-9938-4e3e4d364a54 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:03.306211 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3b9db90a-6530-423d-9938-4e3e4d364a54 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:03.306654 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3b9db90a-6530-423d-9938-4e3e4d364a54 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:03.340987 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3b9db90a-6530-423d-9938-4e3e4d364a54 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047869 Dec 15 12:45:03.341593 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 400/807] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:03 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:03.415022 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2b07c41e-7feb-4e7c-8cf8-dd762bd3e0ff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:03.415625 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2b07c41e-7feb-4e7c-8cf8-dd762bd3e0ff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:03.422014 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2b07c41e-7feb-4e7c-8cf8-dd762bd3e0ff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:03.422498 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2b07c41e-7feb-4e7c-8cf8-dd762bd3e0ff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:03.423275 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2b07c41e-7feb-4e7c-8cf8-dd762bd3e0ff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:03.424208 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2b07c41e-7feb-4e7c-8cf8-dd762bd3e0ff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:03.562043 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2b07c41e-7feb-4e7c-8cf8-dd762bd3e0ff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:03.570294 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2b07c41e-7feb-4e7c-8cf8-dd762bd3e0ff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:03.571793 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2b07c41e-7feb-4e7c-8cf8-dd762bd3e0ff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:03.572941 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2b07c41e-7feb-4e7c-8cf8-dd762bd3e0ff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.161688 Dec 15 12:45:03.573496 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 408/808] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:03 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:03.914026 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fcb0b966-acef-4fa1-80a0-7963899dd5a1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:03.914972 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fcb0b966-acef-4fa1-80a0-7963899dd5a1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:03.920965 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fcb0b966-acef-4fa1-80a0-7963899dd5a1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:03.921412 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fcb0b966-acef-4fa1-80a0-7963899dd5a1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:03.922216 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fcb0b966-acef-4fa1-80a0-7963899dd5a1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:03.922653 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fcb0b966-acef-4fa1-80a0-7963899dd5a1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:03.950787 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fcb0b966-acef-4fa1-80a0-7963899dd5a1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040477 Dec 15 12:45:03.951373 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 401/809] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:03 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:04.351781 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ee0fec7e-3d47-49f5-8ce8-a9aa91866d68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:04.352683 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ee0fec7e-3d47-49f5-8ce8-a9aa91866d68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:04.358570 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ee0fec7e-3d47-49f5-8ce8-a9aa91866d68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:04.359002 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ee0fec7e-3d47-49f5-8ce8-a9aa91866d68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:04.359769 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ee0fec7e-3d47-49f5-8ce8-a9aa91866d68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:04.360195 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ee0fec7e-3d47-49f5-8ce8-a9aa91866d68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:04.390575 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ee0fec7e-3d47-49f5-8ce8-a9aa91866d68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042433 Dec 15 12:45:04.391126 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 409/810] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:04 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:04.590688 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d56ef330-864c-4207-aeb9-2c62b37e85b7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:04.591214 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d56ef330-864c-4207-aeb9-2c62b37e85b7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:04.597526 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d56ef330-864c-4207-aeb9-2c62b37e85b7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:04.597980 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d56ef330-864c-4207-aeb9-2c62b37e85b7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:04.598808 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d56ef330-864c-4207-aeb9-2c62b37e85b7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:04.599240 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d56ef330-864c-4207-aeb9-2c62b37e85b7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:04.755194 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d56ef330-864c-4207-aeb9-2c62b37e85b7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:04.763548 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d56ef330-864c-4207-aeb9-2c62b37e85b7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:04.765111 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d56ef330-864c-4207-aeb9-2c62b37e85b7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:04.766392 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d56ef330-864c-4207-aeb9-2c62b37e85b7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.179477 Dec 15 12:45:04.767355 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 402/811] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:04 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:04.962377 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2c26570d-cfc4-4f38-b932-f88fde3c7c77 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:04.963460 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2c26570d-cfc4-4f38-b932-f88fde3c7c77 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:04.970025 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2c26570d-cfc4-4f38-b932-f88fde3c7c77 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:04.970958 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2c26570d-cfc4-4f38-b932-f88fde3c7c77 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:04.971743 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2c26570d-cfc4-4f38-b932-f88fde3c7c77 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:04.972167 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2c26570d-cfc4-4f38-b932-f88fde3c7c77 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:05.003185 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2c26570d-cfc4-4f38-b932-f88fde3c7c77 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044462 Dec 15 12:45:05.003757 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 410/812] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:04 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:05.403346 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b799248a-a1ae-4e93-97c3-7188dc4a3395 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:05.404261 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b799248a-a1ae-4e93-97c3-7188dc4a3395 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:05.412529 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b799248a-a1ae-4e93-97c3-7188dc4a3395 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:05.412998 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b799248a-a1ae-4e93-97c3-7188dc4a3395 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:05.413811 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b799248a-a1ae-4e93-97c3-7188dc4a3395 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:05.414249 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b799248a-a1ae-4e93-97c3-7188dc4a3395 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:05.442614 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b799248a-a1ae-4e93-97c3-7188dc4a3395 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043015 Dec 15 12:45:05.443162 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 403/813] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:05 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:05.784216 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-db7f9a26-f5ca-4cbe-ba18-78bb149597cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:05.784821 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-db7f9a26-f5ca-4cbe-ba18-78bb149597cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:05.790619 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-db7f9a26-f5ca-4cbe-ba18-78bb149597cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:05.791068 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-db7f9a26-f5ca-4cbe-ba18-78bb149597cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:05.791847 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-db7f9a26-f5ca-4cbe-ba18-78bb149597cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:05.792277 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-db7f9a26-f5ca-4cbe-ba18-78bb149597cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:05.927490 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-db7f9a26-f5ca-4cbe-ba18-78bb149597cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:05.937968 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-db7f9a26-f5ca-4cbe-ba18-78bb149597cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:05.940005 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-db7f9a26-f5ca-4cbe-ba18-78bb149597cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:05.941201 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-db7f9a26-f5ca-4cbe-ba18-78bb149597cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.160794 Dec 15 12:45:05.942005 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 411/814] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:05 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:06.014989 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-57df8340-4939-4942-9941-d7739f747664 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:06.015914 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-57df8340-4939-4942-9941-d7739f747664 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:06.022990 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-57df8340-4939-4942-9941-d7739f747664 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:06.023431 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-57df8340-4939-4942-9941-d7739f747664 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:06.024200 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-57df8340-4939-4942-9941-d7739f747664 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:06.024627 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-57df8340-4939-4942-9941-d7739f747664 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:06.054599 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-57df8340-4939-4942-9941-d7739f747664 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043251 Dec 15 12:45:06.055079 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 404/815] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:06 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:06.454460 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6c0f92b6-2381-4b05-99c3-50331a629a3a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:06.455674 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6c0f92b6-2381-4b05-99c3-50331a629a3a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:06.462139 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c0f92b6-2381-4b05-99c3-50331a629a3a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:06.462592 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c0f92b6-2381-4b05-99c3-50331a629a3a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:06.463382 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c0f92b6-2381-4b05-99c3-50331a629a3a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:06.463812 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c0f92b6-2381-4b05-99c3-50331a629a3a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:06.493434 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6c0f92b6-2381-4b05-99c3-50331a629a3a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042732 Dec 15 12:45:06.494022 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 412/816] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:06 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:06.960078 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c5be89a8-5a7f-429a-97b2-f3a4febb171b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:06.960681 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c5be89a8-5a7f-429a-97b2-f3a4febb171b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:06.967658 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c5be89a8-5a7f-429a-97b2-f3a4febb171b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:06.968113 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c5be89a8-5a7f-429a-97b2-f3a4febb171b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:06.968924 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c5be89a8-5a7f-429a-97b2-f3a4febb171b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:06.969374 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c5be89a8-5a7f-429a-97b2-f3a4febb171b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:07.065742 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b5bc7745-9c77-4e29-8c6a-ca1217a8961f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:07.066685 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b5bc7745-9c77-4e29-8c6a-ca1217a8961f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:07.072932 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5bc7745-9c77-4e29-8c6a-ca1217a8961f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:07.073400 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5bc7745-9c77-4e29-8c6a-ca1217a8961f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:07.074278 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5bc7745-9c77-4e29-8c6a-ca1217a8961f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:07.074721 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5bc7745-9c77-4e29-8c6a-ca1217a8961f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:07.105883 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b5bc7745-9c77-4e29-8c6a-ca1217a8961f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043727 Dec 15 12:45:07.106452 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 413/817] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:07 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:45:07.114666 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c5be89a8-5a7f-429a-97b2-f3a4febb171b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:07.123216 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c5be89a8-5a7f-429a-97b2-f3a4febb171b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:07.124714 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c5be89a8-5a7f-429a-97b2-f3a4febb171b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:07.125987 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c5be89a8-5a7f-429a-97b2-f3a4febb171b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.169554 Dec 15 12:45:07.126585 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 405/818] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:06 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:07.505255 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-92ef2fbf-975d-46d1-945d-5010e0c67195 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:07.506196 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-92ef2fbf-975d-46d1-945d-5010e0c67195 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:07.512433 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-92ef2fbf-975d-46d1-945d-5010e0c67195 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:07.512883 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-92ef2fbf-975d-46d1-945d-5010e0c67195 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:07.513809 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-92ef2fbf-975d-46d1-945d-5010e0c67195 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:07.514263 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-92ef2fbf-975d-46d1-945d-5010e0c67195 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:07.547128 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-92ef2fbf-975d-46d1-945d-5010e0c67195 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045905 Dec 15 12:45:07.547716 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 414/819] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:07 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:08.117657 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5d9780a2-0af5-46a7-a7fd-f6ade841c19c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:08.118531 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5d9780a2-0af5-46a7-a7fd-f6ade841c19c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:08.125578 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5d9780a2-0af5-46a7-a7fd-f6ade841c19c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:08.126018 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5d9780a2-0af5-46a7-a7fd-f6ade841c19c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:08.127300 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5d9780a2-0af5-46a7-a7fd-f6ade841c19c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:08.127730 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5d9780a2-0af5-46a7-a7fd-f6ade841c19c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:08.146874 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4fd372f9-9672-4472-a398-092c9202ec7b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:08.147839 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4fd372f9-9672-4472-a398-092c9202ec7b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:08.154381 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4fd372f9-9672-4472-a398-092c9202ec7b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:08.154831 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4fd372f9-9672-4472-a398-092c9202ec7b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:08.155630 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4fd372f9-9672-4472-a398-092c9202ec7b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:08.156114 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4fd372f9-9672-4472-a398-092c9202ec7b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:08.160137 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5d9780a2-0af5-46a7-a7fd-f6ade841c19c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046443 Dec 15 12:45:08.160718 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 406/820] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:08 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:08.297531 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4fd372f9-9672-4472-a398-092c9202ec7b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:08.306696 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4fd372f9-9672-4472-a398-092c9202ec7b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:08.308197 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4fd372f9-9672-4472-a398-092c9202ec7b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:08.309351 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4fd372f9-9672-4472-a398-092c9202ec7b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.167690 Dec 15 12:45:08.309947 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 415/821] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:08 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:45:08.558840 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-78096719-b1a8-4348-b6db-cc3f77285517 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:08.559743 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-78096719-b1a8-4348-b6db-cc3f77285517 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:08.566404 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-78096719-b1a8-4348-b6db-cc3f77285517 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:08.566847 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-78096719-b1a8-4348-b6db-cc3f77285517 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:08.567643 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-78096719-b1a8-4348-b6db-cc3f77285517 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:08.568070 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-78096719-b1a8-4348-b6db-cc3f77285517 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:08.598574 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-78096719-b1a8-4348-b6db-cc3f77285517 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043445 Dec 15 12:45:08.599162 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 407/822] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:08 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:09.172321 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-081a912a-c9ae-4c56-9ff5-301f37c2d9ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:09.173144 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-081a912a-c9ae-4c56-9ff5-301f37c2d9ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:09.179780 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-081a912a-c9ae-4c56-9ff5-301f37c2d9ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:09.180234 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-081a912a-c9ae-4c56-9ff5-301f37c2d9ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:09.181047 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-081a912a-c9ae-4c56-9ff5-301f37c2d9ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:09.181470 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-081a912a-c9ae-4c56-9ff5-301f37c2d9ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:09.215549 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-081a912a-c9ae-4c56-9ff5-301f37c2d9ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047134 Dec 15 12:45:09.216493 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 416/823] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:09 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:09.328236 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fa4de76c-00ba-4e2b-b779-eaee3298f4ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:09.328890 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fa4de76c-00ba-4e2b-b779-eaee3298f4ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:09.336458 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fa4de76c-00ba-4e2b-b779-eaee3298f4ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:09.337024 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fa4de76c-00ba-4e2b-b779-eaee3298f4ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:09.337864 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fa4de76c-00ba-4e2b-b779-eaee3298f4ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:09.338304 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fa4de76c-00ba-4e2b-b779-eaee3298f4ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:09.476850 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fa4de76c-00ba-4e2b-b779-eaee3298f4ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:09.490938 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fa4de76c-00ba-4e2b-b779-eaee3298f4ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:09.492457 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fa4de76c-00ba-4e2b-b779-eaee3298f4ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:09.493731 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fa4de76c-00ba-4e2b-b779-eaee3298f4ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.169359 Dec 15 12:45:09.506322 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 408/824] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:09 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:09.610124 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-00316c37-6573-4822-9b06-6a3acbbb381e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:09.611317 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-00316c37-6573-4822-9b06-6a3acbbb381e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:09.617352 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-00316c37-6573-4822-9b06-6a3acbbb381e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:09.617827 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-00316c37-6573-4822-9b06-6a3acbbb381e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:09.618627 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-00316c37-6573-4822-9b06-6a3acbbb381e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:09.619062 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-00316c37-6573-4822-9b06-6a3acbbb381e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:09.655171 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-00316c37-6573-4822-9b06-6a3acbbb381e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048753 Dec 15 12:45:09.655754 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 417/825] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:09 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:10.227007 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8832e865-1df0-407e-b53f-a6d1c893ac4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:10.227940 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8832e865-1df0-407e-b53f-a6d1c893ac4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:10.234055 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8832e865-1df0-407e-b53f-a6d1c893ac4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:10.234507 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8832e865-1df0-407e-b53f-a6d1c893ac4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:10.235310 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8832e865-1df0-407e-b53f-a6d1c893ac4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:10.235745 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8832e865-1df0-407e-b53f-a6d1c893ac4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:10.265261 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8832e865-1df0-407e-b53f-a6d1c893ac4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042073 Dec 15 12:45:10.265927 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 409/826] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:10 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:10.513470 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ea4b4a17-483f-44f0-b148-23166e450f2e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:10.514037 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ea4b4a17-483f-44f0-b148-23166e450f2e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:10.520728 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea4b4a17-483f-44f0-b148-23166e450f2e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:10.521168 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea4b4a17-483f-44f0-b148-23166e450f2e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:10.522036 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea4b4a17-483f-44f0-b148-23166e450f2e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:10.522463 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea4b4a17-483f-44f0-b148-23166e450f2e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:10.661792 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ea4b4a17-483f-44f0-b148-23166e450f2e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:10.666549 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c5b8597c-84bf-4171-acd5-bc4d980da615 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:10.667460 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c5b8597c-84bf-4171-acd5-bc4d980da615 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:10.670621 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ea4b4a17-483f-44f0-b148-23166e450f2e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:10.672125 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ea4b4a17-483f-44f0-b148-23166e450f2e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:10.673943 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ea4b4a17-483f-44f0-b148-23166e450f2e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.163623 Dec 15 12:45:10.674512 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 418/827] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:10 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:10.674919 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c5b8597c-84bf-4171-acd5-bc4d980da615 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:10.675368 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c5b8597c-84bf-4171-acd5-bc4d980da615 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:10.676157 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c5b8597c-84bf-4171-acd5-bc4d980da615 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:10.676590 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c5b8597c-84bf-4171-acd5-bc4d980da615 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:10.708736 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c5b8597c-84bf-4171-acd5-bc4d980da615 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045764 Dec 15 12:45:10.709316 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 410/828] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:10 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:45:11.276920 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-393b7541-9b57-4f65-95c5-ddbe2930f537 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:11.277772 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-393b7541-9b57-4f65-95c5-ddbe2930f537 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:11.284199 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-393b7541-9b57-4f65-95c5-ddbe2930f537 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:11.284646 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-393b7541-9b57-4f65-95c5-ddbe2930f537 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:11.285427 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-393b7541-9b57-4f65-95c5-ddbe2930f537 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:11.285891 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-393b7541-9b57-4f65-95c5-ddbe2930f537 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:11.320800 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-393b7541-9b57-4f65-95c5-ddbe2930f537 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047637 Dec 15 12:45:11.321403 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 419/829] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:11 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:11.693041 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-cc3c6ab7-7486-4e15-b009-591001c8a1ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:11.693683 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-cc3c6ab7-7486-4e15-b009-591001c8a1ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:11.699945 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc3c6ab7-7486-4e15-b009-591001c8a1ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:11.700396 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc3c6ab7-7486-4e15-b009-591001c8a1ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:11.701172 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc3c6ab7-7486-4e15-b009-591001c8a1ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:11.701622 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc3c6ab7-7486-4e15-b009-591001c8a1ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:11.720152 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3fa82556-696c-47c0-bc32-2d2db435cd78 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:11.721351 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3fa82556-696c-47c0-bc32-2d2db435cd78 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:11.728449 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3fa82556-696c-47c0-bc32-2d2db435cd78 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:11.728892 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3fa82556-696c-47c0-bc32-2d2db435cd78 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:11.729704 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3fa82556-696c-47c0-bc32-2d2db435cd78 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:11.730142 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3fa82556-696c-47c0-bc32-2d2db435cd78 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:11.760588 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3fa82556-696c-47c0-bc32-2d2db435cd78 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044126 Dec 15 12:45:11.761159 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 420/830] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:11 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:45:11.832865 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-cc3c6ab7-7486-4e15-b009-591001c8a1ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:11.840993 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-cc3c6ab7-7486-4e15-b009-591001c8a1ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:11.842683 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-cc3c6ab7-7486-4e15-b009-591001c8a1ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:11.843885 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cc3c6ab7-7486-4e15-b009-591001c8a1ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.155466 Dec 15 12:45:11.844452 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 411/831] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:11 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:12.332509 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4f984e66-eba4-434c-ab07-26072950cc95 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:12.333460 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4f984e66-eba4-434c-ab07-26072950cc95 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:12.339176 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4f984e66-eba4-434c-ab07-26072950cc95 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:12.339617 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4f984e66-eba4-434c-ab07-26072950cc95 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:12.340384 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4f984e66-eba4-434c-ab07-26072950cc95 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:12.340809 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4f984e66-eba4-434c-ab07-26072950cc95 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:12.370390 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4f984e66-eba4-434c-ab07-26072950cc95 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041745 Dec 15 12:45:12.370972 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 421/832] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:12 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:12.771941 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3abf18d1-4a15-4280-a734-d99ecd7f6d1d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:12.772842 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3abf18d1-4a15-4280-a734-d99ecd7f6d1d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:12.779531 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3abf18d1-4a15-4280-a734-d99ecd7f6d1d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:12.779978 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3abf18d1-4a15-4280-a734-d99ecd7f6d1d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:12.780760 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3abf18d1-4a15-4280-a734-d99ecd7f6d1d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:12.781194 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3abf18d1-4a15-4280-a734-d99ecd7f6d1d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:12.810957 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3abf18d1-4a15-4280-a734-d99ecd7f6d1d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042721 Dec 15 12:45:12.811516 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 412/833] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:12 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:12.862066 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0ff89c7c-9687-4899-9d48-51beb2605fbe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:12.862703 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0ff89c7c-9687-4899-9d48-51beb2605fbe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:12.868883 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0ff89c7c-9687-4899-9d48-51beb2605fbe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:12.869330 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0ff89c7c-9687-4899-9d48-51beb2605fbe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:12.870147 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0ff89c7c-9687-4899-9d48-51beb2605fbe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:12.870583 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0ff89c7c-9687-4899-9d48-51beb2605fbe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:13.020122 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0ff89c7c-9687-4899-9d48-51beb2605fbe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:13.028283 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0ff89c7c-9687-4899-9d48-51beb2605fbe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:13.029837 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0ff89c7c-9687-4899-9d48-51beb2605fbe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:13.030989 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0ff89c7c-9687-4899-9d48-51beb2605fbe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.172626 Dec 15 12:45:13.031553 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 422/834] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:12 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:13.381344 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c2cb4938-2544-46ec-b19d-89d031d7b020 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:13.382281 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c2cb4938-2544-46ec-b19d-89d031d7b020 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:13.388155 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2cb4938-2544-46ec-b19d-89d031d7b020 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:13.388598 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2cb4938-2544-46ec-b19d-89d031d7b020 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:13.389388 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2cb4938-2544-46ec-b19d-89d031d7b020 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:13.389855 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2cb4938-2544-46ec-b19d-89d031d7b020 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:13.421074 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c2cb4938-2544-46ec-b19d-89d031d7b020 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043666 Dec 15 12:45:13.421674 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 413/835] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:13 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:13.822213 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-02ab3bee-a958-4b19-a76e-3dd40bb38bc2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:13.823190 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-02ab3bee-a958-4b19-a76e-3dd40bb38bc2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:13.829202 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-02ab3bee-a958-4b19-a76e-3dd40bb38bc2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:13.830485 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-02ab3bee-a958-4b19-a76e-3dd40bb38bc2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:13.831448 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-02ab3bee-a958-4b19-a76e-3dd40bb38bc2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:13.831924 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-02ab3bee-a958-4b19-a76e-3dd40bb38bc2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:13.860540 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-02ab3bee-a958-4b19-a76e-3dd40bb38bc2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042105 Dec 15 12:45:13.861125 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 423/836] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:13 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:14.050146 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0c79be89-0dda-4377-94b2-617a218bd53e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:14.050699 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0c79be89-0dda-4377-94b2-617a218bd53e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:14.056826 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0c79be89-0dda-4377-94b2-617a218bd53e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:14.057267 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0c79be89-0dda-4377-94b2-617a218bd53e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:14.058071 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0c79be89-0dda-4377-94b2-617a218bd53e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:14.058503 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0c79be89-0dda-4377-94b2-617a218bd53e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:14.187933 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0c79be89-0dda-4377-94b2-617a218bd53e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:14.197390 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0c79be89-0dda-4377-94b2-617a218bd53e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:14.198926 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0c79be89-0dda-4377-94b2-617a218bd53e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:14.200084 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0c79be89-0dda-4377-94b2-617a218bd53e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.153786 Dec 15 12:45:14.200630 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 414/837] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:14 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:14.433342 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8649e404-993f-46f9-90a9-1de57f093a1f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:14.434287 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8649e404-993f-46f9-90a9-1de57f093a1f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:14.442784 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8649e404-993f-46f9-90a9-1de57f093a1f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:14.443422 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8649e404-993f-46f9-90a9-1de57f093a1f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:14.444567 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8649e404-993f-46f9-90a9-1de57f093a1f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:14.445188 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8649e404-993f-46f9-90a9-1de57f093a1f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:14.477614 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8649e404-993f-46f9-90a9-1de57f093a1f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047958 Dec 15 12:45:14.478178 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 424/838] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:14 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:14.871749 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2f7e67d5-0c86-4b32-bee4-e60164f00a85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:14.872684 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2f7e67d5-0c86-4b32-bee4-e60164f00a85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:14.878782 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2f7e67d5-0c86-4b32-bee4-e60164f00a85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:14.879223 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2f7e67d5-0c86-4b32-bee4-e60164f00a85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:14.880248 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2f7e67d5-0c86-4b32-bee4-e60164f00a85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:14.880674 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2f7e67d5-0c86-4b32-bee4-e60164f00a85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:14.911637 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2f7e67d5-0c86-4b32-bee4-e60164f00a85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043684 Dec 15 12:45:14.912213 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 415/839] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:14 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:15.218476 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-924b57de-a8d8-474f-aa84-f9684a4480f6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:15.219108 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-924b57de-a8d8-474f-aa84-f9684a4480f6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:15.226030 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-924b57de-a8d8-474f-aa84-f9684a4480f6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:15.226480 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-924b57de-a8d8-474f-aa84-f9684a4480f6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:15.227298 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-924b57de-a8d8-474f-aa84-f9684a4480f6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:15.227738 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-924b57de-a8d8-474f-aa84-f9684a4480f6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:15.361715 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-924b57de-a8d8-474f-aa84-f9684a4480f6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:15.369859 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-924b57de-a8d8-474f-aa84-f9684a4480f6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:15.371365 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-924b57de-a8d8-474f-aa84-f9684a4480f6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:15.372496 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-924b57de-a8d8-474f-aa84-f9684a4480f6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.157677 Dec 15 12:45:15.373053 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 425/840] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:15 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:15.489469 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6a6a4a5a-b2d9-4abc-9ac1-f72233bdf0c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:15.490350 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6a6a4a5a-b2d9-4abc-9ac1-f72233bdf0c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:15.496944 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6a6a4a5a-b2d9-4abc-9ac1-f72233bdf0c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:15.497380 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6a6a4a5a-b2d9-4abc-9ac1-f72233bdf0c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:15.498224 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6a6a4a5a-b2d9-4abc-9ac1-f72233bdf0c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:15.498658 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6a6a4a5a-b2d9-4abc-9ac1-f72233bdf0c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:15.528829 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6a6a4a5a-b2d9-4abc-9ac1-f72233bdf0c4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043260 Dec 15 12:45:15.529392 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 416/841] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:15 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:15.924107 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-76b158cd-c2c1-4978-b6ba-81e065abc888 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:15.925024 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-76b158cd-c2c1-4978-b6ba-81e065abc888 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:15.931388 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-76b158cd-c2c1-4978-b6ba-81e065abc888 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:15.931839 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-76b158cd-c2c1-4978-b6ba-81e065abc888 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:15.932620 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-76b158cd-c2c1-4978-b6ba-81e065abc888 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:15.933057 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-76b158cd-c2c1-4978-b6ba-81e065abc888 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:15.965400 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-76b158cd-c2c1-4978-b6ba-81e065abc888 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045442 Dec 15 12:45:15.966013 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 426/842] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:15 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:16.389827 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-795d35be-c288-402a-bc37-b500893b96c0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:16.390425 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-795d35be-c288-402a-bc37-b500893b96c0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:16.396370 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-795d35be-c288-402a-bc37-b500893b96c0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:16.396803 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-795d35be-c288-402a-bc37-b500893b96c0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:16.397606 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-795d35be-c288-402a-bc37-b500893b96c0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:16.398031 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-795d35be-c288-402a-bc37-b500893b96c0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:16.527904 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-795d35be-c288-402a-bc37-b500893b96c0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:16.537650 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-795d35be-c288-402a-bc37-b500893b96c0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:16.539140 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-795d35be-c288-402a-bc37-b500893b96c0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:16.540009 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7d15d5f2-2589-4bf3-a815-e4bbf3d44338 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:16.540288 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-795d35be-c288-402a-bc37-b500893b96c0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.154145 Dec 15 12:45:16.540839 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 417/843] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:16 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:16.540987 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7d15d5f2-2589-4bf3-a815-e4bbf3d44338 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:16.546787 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7d15d5f2-2589-4bf3-a815-e4bbf3d44338 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:16.547231 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7d15d5f2-2589-4bf3-a815-e4bbf3d44338 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:16.548021 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7d15d5f2-2589-4bf3-a815-e4bbf3d44338 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:16.548752 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7d15d5f2-2589-4bf3-a815-e4bbf3d44338 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:16.576676 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7d15d5f2-2589-4bf3-a815-e4bbf3d44338 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040354 Dec 15 12:45:16.577233 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 427/844] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:16 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:45:16.976948 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b2b8b0a8-d4ab-4800-a235-743e4b1634d2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:16.977899 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b2b8b0a8-d4ab-4800-a235-743e4b1634d2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:16.983690 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b2b8b0a8-d4ab-4800-a235-743e4b1634d2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:16.984132 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b2b8b0a8-d4ab-4800-a235-743e4b1634d2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:16.984902 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b2b8b0a8-d4ab-4800-a235-743e4b1634d2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:16.985331 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b2b8b0a8-d4ab-4800-a235-743e4b1634d2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:17.016408 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b2b8b0a8-d4ab-4800-a235-743e4b1634d2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043167 Dec 15 12:45:17.017576 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 418/845] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:16 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:17.558399 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-61351b5b-343f-49fa-be17-d73a93a6da80 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:17.558962 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-61351b5b-343f-49fa-be17-d73a93a6da80 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:17.565880 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-61351b5b-343f-49fa-be17-d73a93a6da80 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:17.566327 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-61351b5b-343f-49fa-be17-d73a93a6da80 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:17.567108 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-61351b5b-343f-49fa-be17-d73a93a6da80 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:17.567543 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-61351b5b-343f-49fa-be17-d73a93a6da80 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:17.595668 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bad9f1b8-ba3f-40de-ae97-68622c67af02 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:17.596583 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bad9f1b8-ba3f-40de-ae97-68622c67af02 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:17.603137 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bad9f1b8-ba3f-40de-ae97-68622c67af02 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:17.603617 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bad9f1b8-ba3f-40de-ae97-68622c67af02 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:17.604422 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bad9f1b8-ba3f-40de-ae97-68622c67af02 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:17.604854 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bad9f1b8-ba3f-40de-ae97-68622c67af02 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:17.637565 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bad9f1b8-ba3f-40de-ae97-68622c67af02 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045623 Dec 15 12:45:17.638166 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 419/846] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:17 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:45:17.703424 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-61351b5b-343f-49fa-be17-d73a93a6da80 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:17.711943 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-61351b5b-343f-49fa-be17-d73a93a6da80 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:17.713443 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-61351b5b-343f-49fa-be17-d73a93a6da80 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:17.714666 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-61351b5b-343f-49fa-be17-d73a93a6da80 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.160071 Dec 15 12:45:17.715219 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 428/847] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:17 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:18.027727 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-67445dca-0262-4b59-bd14-27d3ff40c1d8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:18.028625 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-67445dca-0262-4b59-bd14-27d3ff40c1d8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:18.035326 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-67445dca-0262-4b59-bd14-27d3ff40c1d8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:18.035770 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-67445dca-0262-4b59-bd14-27d3ff40c1d8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:18.036542 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-67445dca-0262-4b59-bd14-27d3ff40c1d8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:18.036973 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-67445dca-0262-4b59-bd14-27d3ff40c1d8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:18.068476 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-67445dca-0262-4b59-bd14-27d3ff40c1d8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044440 Dec 15 12:45:18.069045 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 420/848] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:18 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:18.650700 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-02a0c56e-a7a9-4af1-82b3-8548c74ded32 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:18.651632 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-02a0c56e-a7a9-4af1-82b3-8548c74ded32 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:18.658756 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-02a0c56e-a7a9-4af1-82b3-8548c74ded32 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:18.659210 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-02a0c56e-a7a9-4af1-82b3-8548c74ded32 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:18.659992 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-02a0c56e-a7a9-4af1-82b3-8548c74ded32 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:18.660423 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-02a0c56e-a7a9-4af1-82b3-8548c74ded32 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:18.690957 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-02a0c56e-a7a9-4af1-82b3-8548c74ded32 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043942 Dec 15 12:45:18.691525 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 429/849] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:18 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:18.738389 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-99402c9b-211d-45ee-a781-805b8900fefb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:18.738995 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-99402c9b-211d-45ee-a781-805b8900fefb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:18.745326 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-99402c9b-211d-45ee-a781-805b8900fefb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:18.745807 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-99402c9b-211d-45ee-a781-805b8900fefb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:18.746587 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-99402c9b-211d-45ee-a781-805b8900fefb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:18.747014 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-99402c9b-211d-45ee-a781-805b8900fefb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:18.879953 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-99402c9b-211d-45ee-a781-805b8900fefb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:18.888772 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-99402c9b-211d-45ee-a781-805b8900fefb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:18.890314 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-99402c9b-211d-45ee-a781-805b8900fefb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:18.891474 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-99402c9b-211d-45ee-a781-805b8900fefb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.157688 Dec 15 12:45:18.892766 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 421/850] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:18 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:19.080679 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ab4832b5-0e97-445e-849e-cdc86822dbe3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:19.081609 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ab4832b5-0e97-445e-849e-cdc86822dbe3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:19.087668 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ab4832b5-0e97-445e-849e-cdc86822dbe3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:19.088134 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ab4832b5-0e97-445e-849e-cdc86822dbe3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:19.088927 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ab4832b5-0e97-445e-849e-cdc86822dbe3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:19.089362 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ab4832b5-0e97-445e-849e-cdc86822dbe3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:19.119629 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ab4832b5-0e97-445e-849e-cdc86822dbe3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043290 Dec 15 12:45:19.120175 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 430/851] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:19 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:19.702551 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-64a462d2-8d04-42e0-ace1-cd4031a48d67 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:19.703488 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-64a462d2-8d04-42e0-ace1-cd4031a48d67 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:19.716336 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-64a462d2-8d04-42e0-ace1-cd4031a48d67 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:19.716783 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-64a462d2-8d04-42e0-ace1-cd4031a48d67 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:19.717622 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-64a462d2-8d04-42e0-ace1-cd4031a48d67 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:19.718055 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-64a462d2-8d04-42e0-ace1-cd4031a48d67 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:19.747723 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-64a462d2-8d04-42e0-ace1-cd4031a48d67 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048861 Dec 15 12:45:19.748404 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 422/852] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:19 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:19.910343 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-543dfeeb-ce0f-4fe2-aeb6-cab22297f5c4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:19.910947 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-543dfeeb-ce0f-4fe2-aeb6-cab22297f5c4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:19.917547 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-543dfeeb-ce0f-4fe2-aeb6-cab22297f5c4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:19.918011 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-543dfeeb-ce0f-4fe2-aeb6-cab22297f5c4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:19.918818 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-543dfeeb-ce0f-4fe2-aeb6-cab22297f5c4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:19.919256 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-543dfeeb-ce0f-4fe2-aeb6-cab22297f5c4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:20.053106 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-543dfeeb-ce0f-4fe2-aeb6-cab22297f5c4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:20.061218 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-543dfeeb-ce0f-4fe2-aeb6-cab22297f5c4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:20.062749 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-543dfeeb-ce0f-4fe2-aeb6-cab22297f5c4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:20.063891 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-543dfeeb-ce0f-4fe2-aeb6-cab22297f5c4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.157361 Dec 15 12:45:20.064448 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 431/853] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:19 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:20.131588 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ae8cc8ed-49b6-4872-a14a-bacddcc70e9a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:20.132552 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ae8cc8ed-49b6-4872-a14a-bacddcc70e9a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:20.138516 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ae8cc8ed-49b6-4872-a14a-bacddcc70e9a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:20.138963 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ae8cc8ed-49b6-4872-a14a-bacddcc70e9a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:20.139750 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ae8cc8ed-49b6-4872-a14a-bacddcc70e9a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:20.140197 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ae8cc8ed-49b6-4872-a14a-bacddcc70e9a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:20.169095 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ae8cc8ed-49b6-4872-a14a-bacddcc70e9a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041538 Dec 15 12:45:20.169605 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 423/854] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:20 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:20.760390 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a9d8c800-b840-4817-ab04-8ca539a028a2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:20.761327 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a9d8c800-b840-4817-ab04-8ca539a028a2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:20.767382 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a9d8c800-b840-4817-ab04-8ca539a028a2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:20.767831 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a9d8c800-b840-4817-ab04-8ca539a028a2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:20.768608 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a9d8c800-b840-4817-ab04-8ca539a028a2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:20.769040 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a9d8c800-b840-4817-ab04-8ca539a028a2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:20.798312 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a9d8c800-b840-4817-ab04-8ca539a028a2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041707 Dec 15 12:45:20.799492 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 432/855] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:20 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:45:21.082369 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-19dbb9b7-d6b2-44a0-97d3-6b9a60fe6102 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:21.082975 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-19dbb9b7-d6b2-44a0-97d3-6b9a60fe6102 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:21.089214 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-19dbb9b7-d6b2-44a0-97d3-6b9a60fe6102 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:21.089692 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-19dbb9b7-d6b2-44a0-97d3-6b9a60fe6102 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:21.090469 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-19dbb9b7-d6b2-44a0-97d3-6b9a60fe6102 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:21.090898 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-19dbb9b7-d6b2-44a0-97d3-6b9a60fe6102 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:21.180444 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-24c09f07-d7fd-4754-9ca9-54e1910e2b7b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:21.181343 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-24c09f07-d7fd-4754-9ca9-54e1910e2b7b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:21.187628 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-24c09f07-d7fd-4754-9ca9-54e1910e2b7b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:21.188069 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-24c09f07-d7fd-4754-9ca9-54e1910e2b7b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:21.188845 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-24c09f07-d7fd-4754-9ca9-54e1910e2b7b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:21.189930 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-24c09f07-d7fd-4754-9ca9-54e1910e2b7b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:21.219070 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-24c09f07-d7fd-4754-9ca9-54e1910e2b7b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042266 Dec 15 12:45:21.219656 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 433/856] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:21 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:45:21.225804 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-19dbb9b7-d6b2-44a0-97d3-6b9a60fe6102 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:21.234340 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-19dbb9b7-d6b2-44a0-97d3-6b9a60fe6102 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:21.235735 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-19dbb9b7-d6b2-44a0-97d3-6b9a60fe6102 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:21.237781 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-19dbb9b7-d6b2-44a0-97d3-6b9a60fe6102 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.159556 Dec 15 12:45:21.238336 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 424/857] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:21 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:21.810406 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-eca91d91-5b7c-4025-a6d2-b6e36c12bb3b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:21.811213 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-eca91d91-5b7c-4025-a6d2-b6e36c12bb3b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:21.817015 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eca91d91-5b7c-4025-a6d2-b6e36c12bb3b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:21.817451 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eca91d91-5b7c-4025-a6d2-b6e36c12bb3b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:21.818252 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eca91d91-5b7c-4025-a6d2-b6e36c12bb3b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:21.818676 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eca91d91-5b7c-4025-a6d2-b6e36c12bb3b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:21.847394 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-eca91d91-5b7c-4025-a6d2-b6e36c12bb3b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040788 Dec 15 12:45:21.847944 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 434/858] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:21 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:22.232324 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b9e57415-aba7-45b2-b21e-6534353266dc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:22.233235 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b9e57415-aba7-45b2-b21e-6534353266dc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:22.239614 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b9e57415-aba7-45b2-b21e-6534353266dc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:22.240062 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b9e57415-aba7-45b2-b21e-6534353266dc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:22.240844 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b9e57415-aba7-45b2-b21e-6534353266dc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:22.241284 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b9e57415-aba7-45b2-b21e-6534353266dc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:22.256583 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9872b21a-1cbd-484c-9b52-8636dcab1eed tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:22.257290 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9872b21a-1cbd-484c-9b52-8636dcab1eed tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:22.263537 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9872b21a-1cbd-484c-9b52-8636dcab1eed tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:22.263985 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9872b21a-1cbd-484c-9b52-8636dcab1eed tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:22.264828 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9872b21a-1cbd-484c-9b52-8636dcab1eed tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:22.265279 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9872b21a-1cbd-484c-9b52-8636dcab1eed tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:22.277886 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b9e57415-aba7-45b2-b21e-6534353266dc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049251 Dec 15 12:45:22.278477 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 425/859] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:22 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:22.400596 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9872b21a-1cbd-484c-9b52-8636dcab1eed tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:22.409017 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9872b21a-1cbd-484c-9b52-8636dcab1eed tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:22.410541 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9872b21a-1cbd-484c-9b52-8636dcab1eed tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:22.411682 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9872b21a-1cbd-484c-9b52-8636dcab1eed tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.159032 Dec 15 12:45:22.412247 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 435/860] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:22 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:45:22.859173 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b44e252b-d29c-431a-b560-30fcee9336d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:22.860080 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b44e252b-d29c-431a-b560-30fcee9336d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:22.866137 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b44e252b-d29c-431a-b560-30fcee9336d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:22.866583 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b44e252b-d29c-431a-b560-30fcee9336d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:22.867368 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b44e252b-d29c-431a-b560-30fcee9336d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:22.867801 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b44e252b-d29c-431a-b560-30fcee9336d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:22.902160 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b44e252b-d29c-431a-b560-30fcee9336d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046829 Dec 15 12:45:22.902749 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 426/861] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:22 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:23.289494 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f0da2f71-8d7c-439d-9c87-4b4c78412ae9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:23.290416 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f0da2f71-8d7c-439d-9c87-4b4c78412ae9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:23.296935 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f0da2f71-8d7c-439d-9c87-4b4c78412ae9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:23.297405 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f0da2f71-8d7c-439d-9c87-4b4c78412ae9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:23.298802 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f0da2f71-8d7c-439d-9c87-4b4c78412ae9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:23.299461 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f0da2f71-8d7c-439d-9c87-4b4c78412ae9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:23.330891 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f0da2f71-8d7c-439d-9c87-4b4c78412ae9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045138 Dec 15 12:45:23.331456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 436/862] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:23 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:23.430545 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c2737651-c23d-4027-945c-83688605b069 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:23.431261 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c2737651-c23d-4027-945c-83688605b069 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:23.437284 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2737651-c23d-4027-945c-83688605b069 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:23.437748 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2737651-c23d-4027-945c-83688605b069 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:23.438531 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2737651-c23d-4027-945c-83688605b069 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:23.439635 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2737651-c23d-4027-945c-83688605b069 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:23.580443 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c2737651-c23d-4027-945c-83688605b069 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:23.589470 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c2737651-c23d-4027-945c-83688605b069 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:23.590987 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c2737651-c23d-4027-945c-83688605b069 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:23.592143 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c2737651-c23d-4027-945c-83688605b069 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.165388 Dec 15 12:45:23.592713 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 427/863] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:23 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:23.914528 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-79619906-899e-4dd4-9625-1f0c30027b8f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:23.915427 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-79619906-899e-4dd4-9625-1f0c30027b8f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:23.921369 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-79619906-899e-4dd4-9625-1f0c30027b8f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:23.921842 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-79619906-899e-4dd4-9625-1f0c30027b8f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:23.922615 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-79619906-899e-4dd4-9625-1f0c30027b8f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:23.923047 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-79619906-899e-4dd4-9625-1f0c30027b8f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:23.954111 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-79619906-899e-4dd4-9625-1f0c30027b8f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043246 Dec 15 12:45:23.954833 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 437/864] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:23 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:24.342801 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-109e29c5-26d8-42d7-a755-26b777328589 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:24.343733 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-109e29c5-26d8-42d7-a755-26b777328589 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:24.350302 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-109e29c5-26d8-42d7-a755-26b777328589 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:24.350744 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-109e29c5-26d8-42d7-a755-26b777328589 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:24.351510 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-109e29c5-26d8-42d7-a755-26b777328589 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:24.351934 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-109e29c5-26d8-42d7-a755-26b777328589 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:24.381221 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-109e29c5-26d8-42d7-a755-26b777328589 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042368 Dec 15 12:45:24.381809 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 428/865] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:24 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:24.609867 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4b77cf29-2780-4f0a-acda-56e83532dfbf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:24.610428 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4b77cf29-2780-4f0a-acda-56e83532dfbf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:24.617003 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4b77cf29-2780-4f0a-acda-56e83532dfbf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:24.617461 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4b77cf29-2780-4f0a-acda-56e83532dfbf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:24.618313 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4b77cf29-2780-4f0a-acda-56e83532dfbf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:24.618745 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4b77cf29-2780-4f0a-acda-56e83532dfbf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:24.760481 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4b77cf29-2780-4f0a-acda-56e83532dfbf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:24.769493 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4b77cf29-2780-4f0a-acda-56e83532dfbf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:24.771022 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4b77cf29-2780-4f0a-acda-56e83532dfbf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:24.772176 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4b77cf29-2780-4f0a-acda-56e83532dfbf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.166108 Dec 15 12:45:24.773189 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 438/866] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:24 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:24.965361 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-420524ba-4583-4cae-a680-1d3343789f2e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:24.966319 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-420524ba-4583-4cae-a680-1d3343789f2e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:24.972520 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-420524ba-4583-4cae-a680-1d3343789f2e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:24.972954 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-420524ba-4583-4cae-a680-1d3343789f2e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:24.973760 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-420524ba-4583-4cae-a680-1d3343789f2e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:24.974189 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-420524ba-4583-4cae-a680-1d3343789f2e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:25.005102 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-420524ba-4583-4cae-a680-1d3343789f2e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043529 Dec 15 12:45:25.005699 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 429/867] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:24 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:25.392931 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9b869a4a-6a42-415c-af3c-af77279e5508 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:25.394053 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9b869a4a-6a42-415c-af3c-af77279e5508 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:25.402018 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9b869a4a-6a42-415c-af3c-af77279e5508 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:25.402607 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9b869a4a-6a42-415c-af3c-af77279e5508 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:25.403674 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9b869a4a-6a42-415c-af3c-af77279e5508 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:25.404098 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9b869a4a-6a42-415c-af3c-af77279e5508 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:25.434540 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9b869a4a-6a42-415c-af3c-af77279e5508 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045513 Dec 15 12:45:25.435091 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 439/868] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:25 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:25.791302 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-aae7e1a3-afc6-48e8-b0fe-d35a98764995 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:25.791908 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-aae7e1a3-afc6-48e8-b0fe-d35a98764995 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:25.797798 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aae7e1a3-afc6-48e8-b0fe-d35a98764995 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:25.798300 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aae7e1a3-afc6-48e8-b0fe-d35a98764995 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:25.799230 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aae7e1a3-afc6-48e8-b0fe-d35a98764995 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:25.799611 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aae7e1a3-afc6-48e8-b0fe-d35a98764995 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:25.936487 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-aae7e1a3-afc6-48e8-b0fe-d35a98764995 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:25.945903 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-aae7e1a3-afc6-48e8-b0fe-d35a98764995 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:25.947398 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-aae7e1a3-afc6-48e8-b0fe-d35a98764995 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:25.948551 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-aae7e1a3-afc6-48e8-b0fe-d35a98764995 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.160953 Dec 15 12:45:25.949115 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 430/869] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:25 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:26.016291 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b5041316-a160-4efd-bcbd-6b07df1e5891 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:26.017929 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b5041316-a160-4efd-bcbd-6b07df1e5891 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:26.031338 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5041316-a160-4efd-bcbd-6b07df1e5891 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:26.031775 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5041316-a160-4efd-bcbd-6b07df1e5891 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:26.032622 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5041316-a160-4efd-bcbd-6b07df1e5891 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:26.033055 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5041316-a160-4efd-bcbd-6b07df1e5891 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:26.062709 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b5041316-a160-4efd-bcbd-6b07df1e5891 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050135 Dec 15 12:45:26.063170 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 440/870] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:26 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:26.446480 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4c0094fc-e5da-4f80-bd32-f3ff121e41e0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:26.447404 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4c0094fc-e5da-4f80-bd32-f3ff121e41e0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:26.453792 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4c0094fc-e5da-4f80-bd32-f3ff121e41e0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:26.454238 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4c0094fc-e5da-4f80-bd32-f3ff121e41e0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:26.455315 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4c0094fc-e5da-4f80-bd32-f3ff121e41e0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:26.455866 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4c0094fc-e5da-4f80-bd32-f3ff121e41e0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:26.484705 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4c0094fc-e5da-4f80-bd32-f3ff121e41e0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042075 Dec 15 12:45:26.485268 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 431/871] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:26 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:26.968368 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f0887c51-7bee-4765-b8b7-ac3de17655c8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:26.968977 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f0887c51-7bee-4765-b8b7-ac3de17655c8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:26.975484 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f0887c51-7bee-4765-b8b7-ac3de17655c8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:26.975931 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f0887c51-7bee-4765-b8b7-ac3de17655c8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:26.976789 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f0887c51-7bee-4765-b8b7-ac3de17655c8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:26.977166 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f0887c51-7bee-4765-b8b7-ac3de17655c8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:27.074564 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c583ea4a-d26f-4ba5-a95e-083d61346029 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:27.075473 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c583ea4a-d26f-4ba5-a95e-083d61346029 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:27.082241 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c583ea4a-d26f-4ba5-a95e-083d61346029 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:27.082684 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c583ea4a-d26f-4ba5-a95e-083d61346029 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:27.083470 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c583ea4a-d26f-4ba5-a95e-083d61346029 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:27.083900 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c583ea4a-d26f-4ba5-a95e-083d61346029 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:27.116785 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c583ea4a-d26f-4ba5-a95e-083d61346029 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045796 Dec 15 12:45:27.117474 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 432/872] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:27 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:27.118698 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f0887c51-7bee-4765-b8b7-ac3de17655c8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:27.128970 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f0887c51-7bee-4765-b8b7-ac3de17655c8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:27.130802 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f0887c51-7bee-4765-b8b7-ac3de17655c8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:27.132001 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f0887c51-7bee-4765-b8b7-ac3de17655c8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.167976 Dec 15 12:45:27.132565 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 441/873] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:26 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:27.497591 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ba368c42-22bc-4bb4-8417-d63575d6414f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:27.498490 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ba368c42-22bc-4bb4-8417-d63575d6414f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:27.504877 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ba368c42-22bc-4bb4-8417-d63575d6414f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:27.505310 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ba368c42-22bc-4bb4-8417-d63575d6414f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:27.506115 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ba368c42-22bc-4bb4-8417-d63575d6414f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:27.506543 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ba368c42-22bc-4bb4-8417-d63575d6414f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:27.535958 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ba368c42-22bc-4bb4-8417-d63575d6414f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042021 Dec 15 12:45:27.536690 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 433/874] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:27 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:45:28.128549 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0eb5cf69-bc8a-400a-9ad9-e1f4d3da2aca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:28.129677 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0eb5cf69-bc8a-400a-9ad9-e1f4d3da2aca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:28.136098 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0eb5cf69-bc8a-400a-9ad9-e1f4d3da2aca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:28.136561 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0eb5cf69-bc8a-400a-9ad9-e1f4d3da2aca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:28.137318 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0eb5cf69-bc8a-400a-9ad9-e1f4d3da2aca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:28.137779 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0eb5cf69-bc8a-400a-9ad9-e1f4d3da2aca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:28.150818 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fcac7d26-6057-4a7a-b91e-14cc42ff0de3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:28.151438 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fcac7d26-6057-4a7a-b91e-14cc42ff0de3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:28.157264 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fcac7d26-6057-4a7a-b91e-14cc42ff0de3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:28.158424 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fcac7d26-6057-4a7a-b91e-14cc42ff0de3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:28.159262 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fcac7d26-6057-4a7a-b91e-14cc42ff0de3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:28.159699 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fcac7d26-6057-4a7a-b91e-14cc42ff0de3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:28.169070 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0eb5cf69-bc8a-400a-9ad9-e1f4d3da2aca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044258 Dec 15 12:45:28.169667 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 442/875] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:28 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:28.290985 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fcac7d26-6057-4a7a-b91e-14cc42ff0de3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:28.299355 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fcac7d26-6057-4a7a-b91e-14cc42ff0de3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:28.300867 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fcac7d26-6057-4a7a-b91e-14cc42ff0de3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:28.302070 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fcac7d26-6057-4a7a-b91e-14cc42ff0de3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.154903 Dec 15 12:45:28.302632 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 434/876] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:28 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:45:28.547610 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-55619193-bd73-4889-abdb-5ffa185f8779 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:28.549012 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-55619193-bd73-4889-abdb-5ffa185f8779 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:28.554832 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-55619193-bd73-4889-abdb-5ffa185f8779 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:28.555277 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-55619193-bd73-4889-abdb-5ffa185f8779 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:28.556056 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-55619193-bd73-4889-abdb-5ffa185f8779 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:28.556496 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-55619193-bd73-4889-abdb-5ffa185f8779 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:28.587722 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-55619193-bd73-4889-abdb-5ffa185f8779 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043773 Dec 15 12:45:28.588283 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 443/877] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:28 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:29.180706 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c9b9e3a7-4176-46e8-80b3-e95bdff7a6f7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:29.181687 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c9b9e3a7-4176-46e8-80b3-e95bdff7a6f7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:29.187910 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c9b9e3a7-4176-46e8-80b3-e95bdff7a6f7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:29.188353 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c9b9e3a7-4176-46e8-80b3-e95bdff7a6f7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:29.189129 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c9b9e3a7-4176-46e8-80b3-e95bdff7a6f7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:29.189582 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c9b9e3a7-4176-46e8-80b3-e95bdff7a6f7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:29.219228 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c9b9e3a7-4176-46e8-80b3-e95bdff7a6f7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042198 Dec 15 12:45:29.219804 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 435/878] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:29 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:29.319111 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1b07bd72-cd30-4491-b1c6-2dedfdf8ee69 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:29.319718 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1b07bd72-cd30-4491-b1c6-2dedfdf8ee69 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:29.326036 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1b07bd72-cd30-4491-b1c6-2dedfdf8ee69 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:29.326483 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1b07bd72-cd30-4491-b1c6-2dedfdf8ee69 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:29.327267 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1b07bd72-cd30-4491-b1c6-2dedfdf8ee69 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:29.327704 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1b07bd72-cd30-4491-b1c6-2dedfdf8ee69 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:29.465491 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1b07bd72-cd30-4491-b1c6-2dedfdf8ee69 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:29.475630 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1b07bd72-cd30-4491-b1c6-2dedfdf8ee69 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:29.477110 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1b07bd72-cd30-4491-b1c6-2dedfdf8ee69 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:29.478299 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1b07bd72-cd30-4491-b1c6-2dedfdf8ee69 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.162910 Dec 15 12:45:29.478828 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 444/879] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:29 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:45:29.601225 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-84a8a924-1730-4cca-9029-667962ce229f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:29.602391 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-84a8a924-1730-4cca-9029-667962ce229f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:29.608677 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-84a8a924-1730-4cca-9029-667962ce229f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:29.609126 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-84a8a924-1730-4cca-9029-667962ce229f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:29.609948 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-84a8a924-1730-4cca-9029-667962ce229f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:29.610389 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-84a8a924-1730-4cca-9029-667962ce229f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:29.643100 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-84a8a924-1730-4cca-9029-667962ce229f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045584 Dec 15 12:45:29.643672 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 436/880] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:29 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:30.231821 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-146d913e-668e-441d-b7a3-818e67b530c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:30.232658 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-146d913e-668e-441d-b7a3-818e67b530c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:30.239160 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-146d913e-668e-441d-b7a3-818e67b530c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:30.239602 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-146d913e-668e-441d-b7a3-818e67b530c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:30.240486 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-146d913e-668e-441d-b7a3-818e67b530c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:30.240858 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-146d913e-668e-441d-b7a3-818e67b530c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:30.272572 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-146d913e-668e-441d-b7a3-818e67b530c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044745 Dec 15 12:45:30.273126 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 445/881] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:30 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:30.502516 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fb92dfef-70fc-4582-9a52-23e6946e3d89 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:30.502516 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fb92dfef-70fc-4582-9a52-23e6946e3d89 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:30.505677 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fb92dfef-70fc-4582-9a52-23e6946e3d89 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:30.506322 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fb92dfef-70fc-4582-9a52-23e6946e3d89 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:30.507768 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fb92dfef-70fc-4582-9a52-23e6946e3d89 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:30.508457 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fb92dfef-70fc-4582-9a52-23e6946e3d89 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:30.644086 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fb92dfef-70fc-4582-9a52-23e6946e3d89 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:30.649162 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fb92dfef-70fc-4582-9a52-23e6946e3d89 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:30.650808 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fb92dfef-70fc-4582-9a52-23e6946e3d89 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:30.652354 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fb92dfef-70fc-4582-9a52-23e6946e3d89 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.159561 Dec 15 12:45:30.652901 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 437/882] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:30 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:30.658762 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d591a8ff-7ee3-456e-83d9-baa6dcc8e03b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:30.659838 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d591a8ff-7ee3-456e-83d9-baa6dcc8e03b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:30.666383 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d591a8ff-7ee3-456e-83d9-baa6dcc8e03b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:30.666828 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d591a8ff-7ee3-456e-83d9-baa6dcc8e03b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:30.667710 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d591a8ff-7ee3-456e-83d9-baa6dcc8e03b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:30.668146 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d591a8ff-7ee3-456e-83d9-baa6dcc8e03b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:30.698011 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d591a8ff-7ee3-456e-83d9-baa6dcc8e03b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043725 Dec 15 12:45:30.698578 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 446/883] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:30 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:31.283960 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c23b9d80-8e59-4130-9766-3b0bdd88c404 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:31.284874 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c23b9d80-8e59-4130-9766-3b0bdd88c404 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:31.291079 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c23b9d80-8e59-4130-9766-3b0bdd88c404 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:31.291518 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c23b9d80-8e59-4130-9766-3b0bdd88c404 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:31.292306 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c23b9d80-8e59-4130-9766-3b0bdd88c404 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:31.292736 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c23b9d80-8e59-4130-9766-3b0bdd88c404 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:31.322359 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c23b9d80-8e59-4130-9766-3b0bdd88c404 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042483 Dec 15 12:45:31.322920 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 438/884] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:31 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:31.671160 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fa7e04ca-e0c2-4210-8a93-22d2025bf021 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:31.671754 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fa7e04ca-e0c2-4210-8a93-22d2025bf021 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:31.678298 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fa7e04ca-e0c2-4210-8a93-22d2025bf021 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:31.678753 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fa7e04ca-e0c2-4210-8a93-22d2025bf021 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:31.679544 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fa7e04ca-e0c2-4210-8a93-22d2025bf021 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:31.679979 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fa7e04ca-e0c2-4210-8a93-22d2025bf021 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:31.710174 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4010c071-eee1-4bae-8dd0-ce89add1ba01 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:31.711143 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4010c071-eee1-4bae-8dd0-ce89add1ba01 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:31.717562 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4010c071-eee1-4bae-8dd0-ce89add1ba01 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:31.718004 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4010c071-eee1-4bae-8dd0-ce89add1ba01 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:31.718780 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4010c071-eee1-4bae-8dd0-ce89add1ba01 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:31.719206 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4010c071-eee1-4bae-8dd0-ce89add1ba01 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:31.749311 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4010c071-eee1-4bae-8dd0-ce89add1ba01 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042840 Dec 15 12:45:31.750015 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 439/885] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:31 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:45:31.809018 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-fa7e04ca-e0c2-4210-8a93-22d2025bf021 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:31.818032 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-fa7e04ca-e0c2-4210-8a93-22d2025bf021 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:31.819502 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-fa7e04ca-e0c2-4210-8a93-22d2025bf021 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:31.820656 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fa7e04ca-e0c2-4210-8a93-22d2025bf021 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.153252 Dec 15 12:45:31.821202 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 447/886] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:31 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:32.334231 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d20943a5-2443-40db-bb92-90ac4a7c13ac tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:32.335172 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d20943a5-2443-40db-bb92-90ac4a7c13ac tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:32.341157 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d20943a5-2443-40db-bb92-90ac4a7c13ac tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:32.341626 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d20943a5-2443-40db-bb92-90ac4a7c13ac tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:32.342415 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d20943a5-2443-40db-bb92-90ac4a7c13ac tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:32.342847 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d20943a5-2443-40db-bb92-90ac4a7c13ac tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:32.371231 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d20943a5-2443-40db-bb92-90ac4a7c13ac tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040880 Dec 15 12:45:32.371786 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 440/887] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:32 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:32.761843 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5cfd5146-80bc-4375-bee8-a83a43c2bbaa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:32.762978 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5cfd5146-80bc-4375-bee8-a83a43c2bbaa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:32.769709 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5cfd5146-80bc-4375-bee8-a83a43c2bbaa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:32.770468 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5cfd5146-80bc-4375-bee8-a83a43c2bbaa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:32.771750 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5cfd5146-80bc-4375-bee8-a83a43c2bbaa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:32.772444 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5cfd5146-80bc-4375-bee8-a83a43c2bbaa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:32.818332 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5cfd5146-80bc-4375-bee8-a83a43c2bbaa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060599 Dec 15 12:45:32.818832 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 448/888] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:32 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:32.839551 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-26a0c402-cf1f-41b2-acb4-0dea3035c72a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:32.840166 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-26a0c402-cf1f-41b2-acb4-0dea3035c72a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:32.847112 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-26a0c402-cf1f-41b2-acb4-0dea3035c72a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:32.847559 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-26a0c402-cf1f-41b2-acb4-0dea3035c72a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:32.848347 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-26a0c402-cf1f-41b2-acb4-0dea3035c72a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:32.848783 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-26a0c402-cf1f-41b2-acb4-0dea3035c72a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:32.993182 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-26a0c402-cf1f-41b2-acb4-0dea3035c72a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:33.003575 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-26a0c402-cf1f-41b2-acb4-0dea3035c72a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:33.006080 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-26a0c402-cf1f-41b2-acb4-0dea3035c72a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:33.007843 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-26a0c402-cf1f-41b2-acb4-0dea3035c72a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.171798 Dec 15 12:45:33.008668 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 441/889] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:32 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:33.383224 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c1739e59-2b98-4c69-a9cf-2e113014ab87 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:33.384123 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c1739e59-2b98-4c69-a9cf-2e113014ab87 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:33.389950 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c1739e59-2b98-4c69-a9cf-2e113014ab87 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:33.390391 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c1739e59-2b98-4c69-a9cf-2e113014ab87 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:33.391158 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c1739e59-2b98-4c69-a9cf-2e113014ab87 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:33.391584 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c1739e59-2b98-4c69-a9cf-2e113014ab87 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:33.421199 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c1739e59-2b98-4c69-a9cf-2e113014ab87 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041990 Dec 15 12:45:33.421787 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 449/890] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:33 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:33.830512 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b2eece51-9c8a-4193-a533-351dd149d536 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:33.831338 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b2eece51-9c8a-4193-a533-351dd149d536 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:33.837228 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b2eece51-9c8a-4193-a533-351dd149d536 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:33.837711 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b2eece51-9c8a-4193-a533-351dd149d536 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:33.838500 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b2eece51-9c8a-4193-a533-351dd149d536 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:33.838935 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b2eece51-9c8a-4193-a533-351dd149d536 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:33.872893 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b2eece51-9c8a-4193-a533-351dd149d536 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046197 Dec 15 12:45:33.873610 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 442/891] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:33 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:34.031408 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6e78cb73-46ac-497a-8b2e-f5a910a0ca29 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:34.032015 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6e78cb73-46ac-497a-8b2e-f5a910a0ca29 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:34.037993 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e78cb73-46ac-497a-8b2e-f5a910a0ca29 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:34.038448 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e78cb73-46ac-497a-8b2e-f5a910a0ca29 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:34.039231 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e78cb73-46ac-497a-8b2e-f5a910a0ca29 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:34.039667 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e78cb73-46ac-497a-8b2e-f5a910a0ca29 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:34.171477 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6e78cb73-46ac-497a-8b2e-f5a910a0ca29 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:34.180290 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6e78cb73-46ac-497a-8b2e-f5a910a0ca29 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:34.181821 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6e78cb73-46ac-497a-8b2e-f5a910a0ca29 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:34.182984 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6e78cb73-46ac-497a-8b2e-f5a910a0ca29 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.155792 Dec 15 12:45:34.183535 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 450/892] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:34 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:34.432326 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-20ea7eba-c444-4cd1-8ca5-8ab385be5a73 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:34.433243 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-20ea7eba-c444-4cd1-8ca5-8ab385be5a73 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:34.439110 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-20ea7eba-c444-4cd1-8ca5-8ab385be5a73 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:34.439554 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-20ea7eba-c444-4cd1-8ca5-8ab385be5a73 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:34.440336 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-20ea7eba-c444-4cd1-8ca5-8ab385be5a73 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:34.440779 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-20ea7eba-c444-4cd1-8ca5-8ab385be5a73 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:34.475567 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-20ea7eba-c444-4cd1-8ca5-8ab385be5a73 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046892 Dec 15 12:45:34.476156 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 443/893] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:34 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:34.884843 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-92dfcaef-d36a-439f-b1cf-ea21083d5065 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:34.885827 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-92dfcaef-d36a-439f-b1cf-ea21083d5065 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:34.892650 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-92dfcaef-d36a-439f-b1cf-ea21083d5065 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:34.893259 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-92dfcaef-d36a-439f-b1cf-ea21083d5065 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:34.894095 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-92dfcaef-d36a-439f-b1cf-ea21083d5065 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:34.894534 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-92dfcaef-d36a-439f-b1cf-ea21083d5065 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:34.923540 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-92dfcaef-d36a-439f-b1cf-ea21083d5065 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042662 Dec 15 12:45:34.924105 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 451/894] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:34 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:35.200688 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-756462bf-cc59-4757-9934-809db05a015f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:35.201285 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-756462bf-cc59-4757-9934-809db05a015f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:35.208935 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-756462bf-cc59-4757-9934-809db05a015f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:35.209393 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-756462bf-cc59-4757-9934-809db05a015f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:35.210221 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-756462bf-cc59-4757-9934-809db05a015f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:35.210661 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-756462bf-cc59-4757-9934-809db05a015f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:35.345905 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-756462bf-cc59-4757-9934-809db05a015f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:35.354790 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-756462bf-cc59-4757-9934-809db05a015f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:35.356318 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-756462bf-cc59-4757-9934-809db05a015f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:35.357543 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-756462bf-cc59-4757-9934-809db05a015f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.160651 Dec 15 12:45:35.358109 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 444/895] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:35 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:35.487350 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-16402bdb-f24b-4305-85c9-9111f141c799 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:35.488289 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-16402bdb-f24b-4305-85c9-9111f141c799 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:35.494478 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-16402bdb-f24b-4305-85c9-9111f141c799 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:35.494919 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-16402bdb-f24b-4305-85c9-9111f141c799 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:35.495691 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-16402bdb-f24b-4305-85c9-9111f141c799 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:35.496118 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-16402bdb-f24b-4305-85c9-9111f141c799 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:35.527405 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-16402bdb-f24b-4305-85c9-9111f141c799 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044774 Dec 15 12:45:35.527983 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 452/896] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:35 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:35.936152 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d86b06f4-afc7-4b41-b021-f07362b6516f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:35.936507 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d86b06f4-afc7-4b41-b021-f07362b6516f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:35.942676 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d86b06f4-afc7-4b41-b021-f07362b6516f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:35.942997 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d86b06f4-afc7-4b41-b021-f07362b6516f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:35.943794 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d86b06f4-afc7-4b41-b021-f07362b6516f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:35.944231 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d86b06f4-afc7-4b41-b021-f07362b6516f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:35.975999 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d86b06f4-afc7-4b41-b021-f07362b6516f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044746 Dec 15 12:45:35.976563 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 445/897] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:35 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:36.375966 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e73dbf73-0f6c-4dde-88ad-5bed58de0569 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:36.376575 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e73dbf73-0f6c-4dde-88ad-5bed58de0569 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:36.382726 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e73dbf73-0f6c-4dde-88ad-5bed58de0569 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:36.383174 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e73dbf73-0f6c-4dde-88ad-5bed58de0569 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:36.383952 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e73dbf73-0f6c-4dde-88ad-5bed58de0569 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:36.384389 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e73dbf73-0f6c-4dde-88ad-5bed58de0569 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:36.515527 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e73dbf73-0f6c-4dde-88ad-5bed58de0569 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:36.524442 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e73dbf73-0f6c-4dde-88ad-5bed58de0569 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:36.525977 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e73dbf73-0f6c-4dde-88ad-5bed58de0569 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:36.527160 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e73dbf73-0f6c-4dde-88ad-5bed58de0569 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.154857 Dec 15 12:45:36.527714 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 453/898] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:36 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:36.538733 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5aece826-6136-4e89-a448-74ca1cffebce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:36.539642 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5aece826-6136-4e89-a448-74ca1cffebce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:36.545890 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5aece826-6136-4e89-a448-74ca1cffebce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:36.546341 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5aece826-6136-4e89-a448-74ca1cffebce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:36.547124 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5aece826-6136-4e89-a448-74ca1cffebce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:36.547561 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5aece826-6136-4e89-a448-74ca1cffebce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:36.579090 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5aece826-6136-4e89-a448-74ca1cffebce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044002 Dec 15 12:45:36.580277 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 446/899] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:36 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:36.989999 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8f2106e9-d445-4533-a5ec-40f067ed1677 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:36.990905 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8f2106e9-d445-4533-a5ec-40f067ed1677 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:36.996802 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8f2106e9-d445-4533-a5ec-40f067ed1677 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:36.997188 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8f2106e9-d445-4533-a5ec-40f067ed1677 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:36.997989 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8f2106e9-d445-4533-a5ec-40f067ed1677 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:36.998420 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8f2106e9-d445-4533-a5ec-40f067ed1677 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:37.029037 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8f2106e9-d445-4533-a5ec-40f067ed1677 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043249 Dec 15 12:45:37.029639 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 454/900] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:36 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:37.545295 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-61bf67f8-d899-45d0-8e64-2f4c2a9658e0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:37.545864 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-61bf67f8-d899-45d0-8e64-2f4c2a9658e0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:37.552918 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-61bf67f8-d899-45d0-8e64-2f4c2a9658e0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:37.553358 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-61bf67f8-d899-45d0-8e64-2f4c2a9658e0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:37.554173 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-61bf67f8-d899-45d0-8e64-2f4c2a9658e0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:37.554606 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-61bf67f8-d899-45d0-8e64-2f4c2a9658e0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:37.591075 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c187e074-b5d8-4ed8-a728-e3b7455b4c37 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:37.591990 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c187e074-b5d8-4ed8-a728-e3b7455b4c37 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:37.599719 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c187e074-b5d8-4ed8-a728-e3b7455b4c37 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:37.600161 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c187e074-b5d8-4ed8-a728-e3b7455b4c37 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:37.600949 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c187e074-b5d8-4ed8-a728-e3b7455b4c37 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:37.601381 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c187e074-b5d8-4ed8-a728-e3b7455b4c37 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:37.632110 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c187e074-b5d8-4ed8-a728-e3b7455b4c37 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044815 Dec 15 12:45:37.633155 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 455/901] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:37 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:45:37.689059 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-61bf67f8-d899-45d0-8e64-2f4c2a9658e0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:37.697885 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-61bf67f8-d899-45d0-8e64-2f4c2a9658e0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:37.699456 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-61bf67f8-d899-45d0-8e64-2f4c2a9658e0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:37.700652 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-61bf67f8-d899-45d0-8e64-2f4c2a9658e0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.159340 Dec 15 12:45:37.701216 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 447/902] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:37 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:38.040204 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2f26707c-0938-4ed6-be97-774fbd33ab74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:38.041119 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2f26707c-0938-4ed6-be97-774fbd33ab74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:38.047034 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2f26707c-0938-4ed6-be97-774fbd33ab74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:38.047480 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2f26707c-0938-4ed6-be97-774fbd33ab74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:38.048406 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2f26707c-0938-4ed6-be97-774fbd33ab74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:38.048847 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2f26707c-0938-4ed6-be97-774fbd33ab74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:38.078888 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2f26707c-0938-4ed6-be97-774fbd33ab74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042291 Dec 15 12:45:38.079971 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 456/903] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:38 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:38.643646 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3654144b-b9e9-4aa0-8484-8515b94b6ff1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:38.644546 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3654144b-b9e9-4aa0-8484-8515b94b6ff1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:38.650872 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3654144b-b9e9-4aa0-8484-8515b94b6ff1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:38.651307 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3654144b-b9e9-4aa0-8484-8515b94b6ff1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:38.652210 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3654144b-b9e9-4aa0-8484-8515b94b6ff1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:38.652512 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3654144b-b9e9-4aa0-8484-8515b94b6ff1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:38.681483 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3654144b-b9e9-4aa0-8484-8515b94b6ff1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041641 Dec 15 12:45:38.682077 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 448/904] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:38 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:38.720583 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d67d74a0-7ced-46ed-bacb-672f683fa0b5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:38.721209 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d67d74a0-7ced-46ed-bacb-672f683fa0b5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:38.727672 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d67d74a0-7ced-46ed-bacb-672f683fa0b5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:38.728113 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d67d74a0-7ced-46ed-bacb-672f683fa0b5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:38.729062 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d67d74a0-7ced-46ed-bacb-672f683fa0b5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:38.729600 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d67d74a0-7ced-46ed-bacb-672f683fa0b5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:38.873724 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d67d74a0-7ced-46ed-bacb-672f683fa0b5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:38.883883 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d67d74a0-7ced-46ed-bacb-672f683fa0b5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:38.885395 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d67d74a0-7ced-46ed-bacb-672f683fa0b5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:38.886635 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d67d74a0-7ced-46ed-bacb-672f683fa0b5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.170329 Dec 15 12:45:38.887194 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 457/905] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:38 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:39.091262 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-faec5444-228e-4fa6-b65c-c5851a9e6be5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:39.092202 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-faec5444-228e-4fa6-b65c-c5851a9e6be5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:39.099659 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-faec5444-228e-4fa6-b65c-c5851a9e6be5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:39.100172 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-faec5444-228e-4fa6-b65c-c5851a9e6be5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:39.100898 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-faec5444-228e-4fa6-b65c-c5851a9e6be5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:39.101333 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-faec5444-228e-4fa6-b65c-c5851a9e6be5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:39.134430 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-faec5444-228e-4fa6-b65c-c5851a9e6be5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047116 Dec 15 12:45:39.135013 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 449/906] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:39 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:39.692238 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c636a435-e0d0-4720-bb01-a25dd894bd92 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:39.693185 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c636a435-e0d0-4720-bb01-a25dd894bd92 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:39.699085 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c636a435-e0d0-4720-bb01-a25dd894bd92 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:39.699532 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c636a435-e0d0-4720-bb01-a25dd894bd92 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:39.700307 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c636a435-e0d0-4720-bb01-a25dd894bd92 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:39.700741 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c636a435-e0d0-4720-bb01-a25dd894bd92 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:39.737182 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c636a435-e0d0-4720-bb01-a25dd894bd92 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048601 Dec 15 12:45:39.737913 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 458/907] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:39 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:39.905962 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9e7e6c75-af94-4932-8ccc-3135c77c12cb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:39.906825 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9e7e6c75-af94-4932-8ccc-3135c77c12cb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:39.913994 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9e7e6c75-af94-4932-8ccc-3135c77c12cb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:39.914479 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9e7e6c75-af94-4932-8ccc-3135c77c12cb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:39.915216 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9e7e6c75-af94-4932-8ccc-3135c77c12cb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:39.915649 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9e7e6c75-af94-4932-8ccc-3135c77c12cb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:40.044821 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9e7e6c75-af94-4932-8ccc-3135c77c12cb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:40.054312 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9e7e6c75-af94-4932-8ccc-3135c77c12cb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:40.055819 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9e7e6c75-af94-4932-8ccc-3135c77c12cb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:40.057106 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9e7e6c75-af94-4932-8ccc-3135c77c12cb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.155252 Dec 15 12:45:40.057698 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 450/908] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:39 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:40.146447 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-25ccf1c4-378c-4f3c-8678-ec2e624a89aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:40.147379 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-25ccf1c4-378c-4f3c-8678-ec2e624a89aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:40.154606 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-25ccf1c4-378c-4f3c-8678-ec2e624a89aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:40.155044 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-25ccf1c4-378c-4f3c-8678-ec2e624a89aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:40.155829 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-25ccf1c4-378c-4f3c-8678-ec2e624a89aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:40.156257 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-25ccf1c4-378c-4f3c-8678-ec2e624a89aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:40.187002 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-25ccf1c4-378c-4f3c-8678-ec2e624a89aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044514 Dec 15 12:45:40.187874 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 459/909] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:40 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:40.748090 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a6940ca4-f8d0-480a-8b7a-b39317c4c6ba tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:40.749001 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a6940ca4-f8d0-480a-8b7a-b39317c4c6ba tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:40.755468 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a6940ca4-f8d0-480a-8b7a-b39317c4c6ba tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:40.755910 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a6940ca4-f8d0-480a-8b7a-b39317c4c6ba tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:40.756687 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a6940ca4-f8d0-480a-8b7a-b39317c4c6ba tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:40.757108 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a6940ca4-f8d0-480a-8b7a-b39317c4c6ba tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:40.788898 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a6940ca4-f8d0-480a-8b7a-b39317c4c6ba tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044531 Dec 15 12:45:40.789453 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 451/910] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:40 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:41.075959 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ffe2861d-31d7-4ed0-8c20-44b11e44335b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:41.076818 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ffe2861d-31d7-4ed0-8c20-44b11e44335b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:41.090374 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ffe2861d-31d7-4ed0-8c20-44b11e44335b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:41.090819 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ffe2861d-31d7-4ed0-8c20-44b11e44335b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:41.091622 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ffe2861d-31d7-4ed0-8c20-44b11e44335b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:41.092054 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ffe2861d-31d7-4ed0-8c20-44b11e44335b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:41.202319 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-687301ca-530a-4ce6-9b54-4ad680e54a5a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:41.203157 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-687301ca-530a-4ce6-9b54-4ad680e54a5a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:41.210299 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-687301ca-530a-4ce6-9b54-4ad680e54a5a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:41.210747 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-687301ca-530a-4ce6-9b54-4ad680e54a5a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:41.211540 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-687301ca-530a-4ce6-9b54-4ad680e54a5a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:41.211976 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-687301ca-530a-4ce6-9b54-4ad680e54a5a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:41.231930 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ffe2861d-31d7-4ed0-8c20-44b11e44335b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:41.242189 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ffe2861d-31d7-4ed0-8c20-44b11e44335b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:41.244371 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ffe2861d-31d7-4ed0-8c20-44b11e44335b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:41.245865 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ffe2861d-31d7-4ed0-8c20-44b11e44335b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.173394 Dec 15 12:45:41.246410 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 460/911] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:41 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:45:41.249769 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-687301ca-530a-4ce6-9b54-4ad680e54a5a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051187 Dec 15 12:45:41.250346 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 452/912] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:41 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:41.800703 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8158cd40-2f08-4108-9ce0-150196cc27c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:41.801658 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8158cd40-2f08-4108-9ce0-150196cc27c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:41.807532 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8158cd40-2f08-4108-9ce0-150196cc27c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:41.807924 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8158cd40-2f08-4108-9ce0-150196cc27c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:41.814871 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8158cd40-2f08-4108-9ce0-150196cc27c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:41.815372 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8158cd40-2f08-4108-9ce0-150196cc27c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:41.845324 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8158cd40-2f08-4108-9ce0-150196cc27c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048411 Dec 15 12:45:41.846076 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 461/913] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:41 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:42.261918 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-22cd3dca-75c6-4764-b51e-6f0eb0566ab1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:42.262864 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-22cd3dca-75c6-4764-b51e-6f0eb0566ab1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:42.263851 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-39e010f4-8445-4a42-884e-536a6df56330 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:42.264466 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-39e010f4-8445-4a42-884e-536a6df56330 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:42.270068 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-22cd3dca-75c6-4764-b51e-6f0eb0566ab1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:42.270521 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-22cd3dca-75c6-4764-b51e-6f0eb0566ab1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:42.271297 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-39e010f4-8445-4a42-884e-536a6df56330 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:42.271441 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-22cd3dca-75c6-4764-b51e-6f0eb0566ab1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:42.271734 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-22cd3dca-75c6-4764-b51e-6f0eb0566ab1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:42.271863 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-39e010f4-8445-4a42-884e-536a6df56330 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:42.272516 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-39e010f4-8445-4a42-884e-536a6df56330 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:42.272946 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-39e010f4-8445-4a42-884e-536a6df56330 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:42.309979 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-22cd3dca-75c6-4764-b51e-6f0eb0566ab1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051790 Dec 15 12:45:42.310417 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 453/914] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:42 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:42.406427 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-39e010f4-8445-4a42-884e-536a6df56330 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:42.415222 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-39e010f4-8445-4a42-884e-536a6df56330 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:42.416739 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-39e010f4-8445-4a42-884e-536a6df56330 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:42.417932 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-39e010f4-8445-4a42-884e-536a6df56330 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.157765 Dec 15 12:45:42.418475 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 462/915] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:42 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:45:42.857209 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c9f9d1e9-8a26-4c48-b1b8-2a6fe063f032 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:42.858151 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c9f9d1e9-8a26-4c48-b1b8-2a6fe063f032 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:42.864643 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c9f9d1e9-8a26-4c48-b1b8-2a6fe063f032 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:42.865094 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c9f9d1e9-8a26-4c48-b1b8-2a6fe063f032 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:42.865914 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c9f9d1e9-8a26-4c48-b1b8-2a6fe063f032 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:42.866350 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c9f9d1e9-8a26-4c48-b1b8-2a6fe063f032 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:42.895545 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c9f9d1e9-8a26-4c48-b1b8-2a6fe063f032 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042202 Dec 15 12:45:42.896103 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 454/916] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:42 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:43.320489 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-61a55351-45dc-4396-a440-ccd4887d4185 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:43.321477 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-61a55351-45dc-4396-a440-ccd4887d4185 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:43.328112 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-61a55351-45dc-4396-a440-ccd4887d4185 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:43.328564 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-61a55351-45dc-4396-a440-ccd4887d4185 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:43.329396 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-61a55351-45dc-4396-a440-ccd4887d4185 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:43.329867 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-61a55351-45dc-4396-a440-ccd4887d4185 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:43.358722 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-61a55351-45dc-4396-a440-ccd4887d4185 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042117 Dec 15 12:45:43.359278 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 463/917] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:43 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:43.437113 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fc3f9be5-7c47-4b27-be0d-3a6127ed8369 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:43.437756 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fc3f9be5-7c47-4b27-be0d-3a6127ed8369 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:43.444039 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fc3f9be5-7c47-4b27-be0d-3a6127ed8369 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:43.444473 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fc3f9be5-7c47-4b27-be0d-3a6127ed8369 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:43.445264 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fc3f9be5-7c47-4b27-be0d-3a6127ed8369 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:43.445720 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fc3f9be5-7c47-4b27-be0d-3a6127ed8369 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:43.582714 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fc3f9be5-7c47-4b27-be0d-3a6127ed8369 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:43.591456 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fc3f9be5-7c47-4b27-be0d-3a6127ed8369 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:43.593067 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fc3f9be5-7c47-4b27-be0d-3a6127ed8369 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:43.594256 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fc3f9be5-7c47-4b27-be0d-3a6127ed8369 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.160853 Dec 15 12:45:43.595480 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 455/918] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:43 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:43.907030 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3f2cfef9-357c-4e74-ac7d-4e53100f0735 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:43.908525 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3f2cfef9-357c-4e74-ac7d-4e53100f0735 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:43.914405 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3f2cfef9-357c-4e74-ac7d-4e53100f0735 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:43.914855 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3f2cfef9-357c-4e74-ac7d-4e53100f0735 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:43.915632 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3f2cfef9-357c-4e74-ac7d-4e53100f0735 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:43.916064 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3f2cfef9-357c-4e74-ac7d-4e53100f0735 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:43.947824 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3f2cfef9-357c-4e74-ac7d-4e53100f0735 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044483 Dec 15 12:45:43.948399 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 464/919] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:43 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:44.370806 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-35f69a63-acf6-4995-8dc5-4aa72e40d1c4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:44.371720 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-35f69a63-acf6-4995-8dc5-4aa72e40d1c4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:44.378327 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-35f69a63-acf6-4995-8dc5-4aa72e40d1c4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:44.378771 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-35f69a63-acf6-4995-8dc5-4aa72e40d1c4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:44.379799 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-35f69a63-acf6-4995-8dc5-4aa72e40d1c4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:44.380233 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-35f69a63-acf6-4995-8dc5-4aa72e40d1c4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:44.408802 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-35f69a63-acf6-4995-8dc5-4aa72e40d1c4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041644 Dec 15 12:45:44.409397 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 456/920] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:44 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:44.612845 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e8de524b-c669-46ab-9395-46072664e630 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:44.613449 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e8de524b-c669-46ab-9395-46072664e630 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:44.620049 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e8de524b-c669-46ab-9395-46072664e630 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:44.620501 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e8de524b-c669-46ab-9395-46072664e630 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:44.621350 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e8de524b-c669-46ab-9395-46072664e630 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:44.621822 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e8de524b-c669-46ab-9395-46072664e630 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:44.769267 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e8de524b-c669-46ab-9395-46072664e630 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:44.784332 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e8de524b-c669-46ab-9395-46072664e630 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:44.785848 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e8de524b-c669-46ab-9395-46072664e630 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:44.787000 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e8de524b-c669-46ab-9395-46072664e630 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.178389 Dec 15 12:45:44.787549 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 465/921] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:44 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:44.959527 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a99e5c14-8717-4068-aa07-871e6e58dc25 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:44.960430 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a99e5c14-8717-4068-aa07-871e6e58dc25 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:44.967395 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a99e5c14-8717-4068-aa07-871e6e58dc25 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:44.967887 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a99e5c14-8717-4068-aa07-871e6e58dc25 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:44.968924 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a99e5c14-8717-4068-aa07-871e6e58dc25 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:44.969386 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a99e5c14-8717-4068-aa07-871e6e58dc25 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:45.003669 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a99e5c14-8717-4068-aa07-871e6e58dc25 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047853 Dec 15 12:45:45.004227 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 457/922] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:44 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:45.421735 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-39584ded-d244-446f-a2a3-a68cd22fb6a4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:45.422623 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-39584ded-d244-446f-a2a3-a68cd22fb6a4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:45.428802 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-39584ded-d244-446f-a2a3-a68cd22fb6a4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:45.429240 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-39584ded-d244-446f-a2a3-a68cd22fb6a4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:45.430027 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-39584ded-d244-446f-a2a3-a68cd22fb6a4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:45.430451 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-39584ded-d244-446f-a2a3-a68cd22fb6a4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:45.460361 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-39584ded-d244-446f-a2a3-a68cd22fb6a4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042373 Dec 15 12:45:45.460938 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 466/923] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:45 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:45.805133 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4b0e96f2-cc68-439a-ba8d-9fea669aff80 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:45.805767 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4b0e96f2-cc68-439a-ba8d-9fea669aff80 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:45.811629 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4b0e96f2-cc68-439a-ba8d-9fea669aff80 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:45.812025 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4b0e96f2-cc68-439a-ba8d-9fea669aff80 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:45.812812 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4b0e96f2-cc68-439a-ba8d-9fea669aff80 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:45.813273 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4b0e96f2-cc68-439a-ba8d-9fea669aff80 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:45.956061 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4b0e96f2-cc68-439a-ba8d-9fea669aff80 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:45.964397 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4b0e96f2-cc68-439a-ba8d-9fea669aff80 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:45.966209 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4b0e96f2-cc68-439a-ba8d-9fea669aff80 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:45.967614 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4b0e96f2-cc68-439a-ba8d-9fea669aff80 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.166110 Dec 15 12:45:45.968285 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 458/924] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:45 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:46.015803 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2304be48-2836-449c-927a-9f3203a0bfb2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:46.017235 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2304be48-2836-449c-927a-9f3203a0bfb2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:46.023816 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2304be48-2836-449c-927a-9f3203a0bfb2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:46.024265 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2304be48-2836-449c-927a-9f3203a0bfb2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:46.025075 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2304be48-2836-449c-927a-9f3203a0bfb2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:46.025534 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2304be48-2836-449c-927a-9f3203a0bfb2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:46.055653 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2304be48-2836-449c-927a-9f3203a0bfb2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043518 Dec 15 12:45:46.056219 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 467/925] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:46 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:46.471752 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9823bfa7-fec1-4f4c-a8aa-1c29c5cb5e8c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:46.472916 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9823bfa7-fec1-4f4c-a8aa-1c29c5cb5e8c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:46.479267 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9823bfa7-fec1-4f4c-a8aa-1c29c5cb5e8c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:46.479709 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9823bfa7-fec1-4f4c-a8aa-1c29c5cb5e8c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:46.480480 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9823bfa7-fec1-4f4c-a8aa-1c29c5cb5e8c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:46.480909 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9823bfa7-fec1-4f4c-a8aa-1c29c5cb5e8c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:46.511685 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9823bfa7-fec1-4f4c-a8aa-1c29c5cb5e8c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043781 Dec 15 12:45:46.512246 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 459/926] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:46 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:46.990965 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d9de44f7-a224-4ce7-bc6d-d33077abe31f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:46.991690 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d9de44f7-a224-4ce7-bc6d-d33077abe31f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:46.997463 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d9de44f7-a224-4ce7-bc6d-d33077abe31f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:46.997925 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d9de44f7-a224-4ce7-bc6d-d33077abe31f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:46.998694 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d9de44f7-a224-4ce7-bc6d-d33077abe31f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:46.999122 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d9de44f7-a224-4ce7-bc6d-d33077abe31f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:47.067428 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-44d6cee9-dbbc-4c47-baf8-ae44240cc130 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:47.068445 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-44d6cee9-dbbc-4c47-baf8-ae44240cc130 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:47.074729 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-44d6cee9-dbbc-4c47-baf8-ae44240cc130 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:47.075178 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-44d6cee9-dbbc-4c47-baf8-ae44240cc130 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:47.075961 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-44d6cee9-dbbc-4c47-baf8-ae44240cc130 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:47.076388 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-44d6cee9-dbbc-4c47-baf8-ae44240cc130 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:47.106119 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-44d6cee9-dbbc-4c47-baf8-ae44240cc130 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042773 Dec 15 12:45:47.106684 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 460/927] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:47 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:47.144657 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d9de44f7-a224-4ce7-bc6d-d33077abe31f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:47.152811 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d9de44f7-a224-4ce7-bc6d-d33077abe31f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:47.154344 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d9de44f7-a224-4ce7-bc6d-d33077abe31f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:47.155490 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d9de44f7-a224-4ce7-bc6d-d33077abe31f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.168335 Dec 15 12:45:47.156058 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 468/928] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:46 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:47.523729 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5c0fdc0e-b974-41cb-8ed8-d20d52651c71 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:47.524564 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5c0fdc0e-b974-41cb-8ed8-d20d52651c71 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:47.530769 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5c0fdc0e-b974-41cb-8ed8-d20d52651c71 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:47.531207 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5c0fdc0e-b974-41cb-8ed8-d20d52651c71 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:47.531973 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5c0fdc0e-b974-41cb-8ed8-d20d52651c71 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:47.532999 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5c0fdc0e-b974-41cb-8ed8-d20d52651c71 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:47.562972 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5c0fdc0e-b974-41cb-8ed8-d20d52651c71 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042950 Dec 15 12:45:47.563537 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 461/929] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:47 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:48.118195 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-101c4d9c-c751-4bc3-91c2-f2c00fdf3d4e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:48.119115 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-101c4d9c-c751-4bc3-91c2-f2c00fdf3d4e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:48.126452 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-101c4d9c-c751-4bc3-91c2-f2c00fdf3d4e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:48.126896 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-101c4d9c-c751-4bc3-91c2-f2c00fdf3d4e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:48.127690 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-101c4d9c-c751-4bc3-91c2-f2c00fdf3d4e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:48.128125 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-101c4d9c-c751-4bc3-91c2-f2c00fdf3d4e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:48.156947 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-101c4d9c-c751-4bc3-91c2-f2c00fdf3d4e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042588 Dec 15 12:45:48.158343 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 469/930] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:48 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:48.174268 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-500ab0de-bbe6-4ae3-8271-ccf9d6527d97 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:48.174900 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-500ab0de-bbe6-4ae3-8271-ccf9d6527d97 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:48.180713 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-500ab0de-bbe6-4ae3-8271-ccf9d6527d97 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:48.181160 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-500ab0de-bbe6-4ae3-8271-ccf9d6527d97 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:48.181964 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-500ab0de-bbe6-4ae3-8271-ccf9d6527d97 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:48.182395 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-500ab0de-bbe6-4ae3-8271-ccf9d6527d97 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:48.314652 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-500ab0de-bbe6-4ae3-8271-ccf9d6527d97 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:48.324536 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-500ab0de-bbe6-4ae3-8271-ccf9d6527d97 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:48.326520 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-500ab0de-bbe6-4ae3-8271-ccf9d6527d97 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:48.327690 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-500ab0de-bbe6-4ae3-8271-ccf9d6527d97 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.157485 Dec 15 12:45:48.328257 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 462/931] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:48 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:48.574544 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8fa0e8ad-129f-4e6e-b08e-fa984cb85107 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:48.575438 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8fa0e8ad-129f-4e6e-b08e-fa984cb85107 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:48.582556 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8fa0e8ad-129f-4e6e-b08e-fa984cb85107 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:48.582999 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8fa0e8ad-129f-4e6e-b08e-fa984cb85107 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:48.583799 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8fa0e8ad-129f-4e6e-b08e-fa984cb85107 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:48.584225 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8fa0e8ad-129f-4e6e-b08e-fa984cb85107 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:48.613611 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8fa0e8ad-129f-4e6e-b08e-fa984cb85107 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042682 Dec 15 12:45:48.614159 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 470/932] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:48 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:49.169432 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-442aee48-d6ba-4b7c-b3a7-1fb8736b2bb9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:49.170370 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-442aee48-d6ba-4b7c-b3a7-1fb8736b2bb9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:49.177703 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-442aee48-d6ba-4b7c-b3a7-1fb8736b2bb9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:49.178321 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-442aee48-d6ba-4b7c-b3a7-1fb8736b2bb9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:49.178915 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-442aee48-d6ba-4b7c-b3a7-1fb8736b2bb9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:49.179349 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-442aee48-d6ba-4b7c-b3a7-1fb8736b2bb9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:49.210194 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-442aee48-d6ba-4b7c-b3a7-1fb8736b2bb9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044460 Dec 15 12:45:49.210793 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 463/933] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:49 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:49.347366 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-370f28e8-2af8-4673-85b7-677e99557da5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:49.347974 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-370f28e8-2af8-4673-85b7-677e99557da5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:49.354602 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-370f28e8-2af8-4673-85b7-677e99557da5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:49.355053 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-370f28e8-2af8-4673-85b7-677e99557da5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:49.355832 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-370f28e8-2af8-4673-85b7-677e99557da5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:49.356262 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-370f28e8-2af8-4673-85b7-677e99557da5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:49.494192 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-370f28e8-2af8-4673-85b7-677e99557da5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:49.504142 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-370f28e8-2af8-4673-85b7-677e99557da5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:49.506140 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-370f28e8-2af8-4673-85b7-677e99557da5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:49.507293 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-370f28e8-2af8-4673-85b7-677e99557da5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.164441 Dec 15 12:45:49.507849 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 471/934] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:49 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:49.625786 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-29fb8bfc-d276-41b3-8144-28680cd7cbea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:49.626951 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-29fb8bfc-d276-41b3-8144-28680cd7cbea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:49.633398 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-29fb8bfc-d276-41b3-8144-28680cd7cbea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:49.633904 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-29fb8bfc-d276-41b3-8144-28680cd7cbea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:49.634689 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-29fb8bfc-d276-41b3-8144-28680cd7cbea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:49.635118 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-29fb8bfc-d276-41b3-8144-28680cd7cbea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:49.664868 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-29fb8bfc-d276-41b3-8144-28680cd7cbea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042931 Dec 15 12:45:49.665420 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 464/935] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:49 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:50.221934 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0cdf6735-1024-45ba-95e2-917afe32cf11 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:50.222876 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0cdf6735-1024-45ba-95e2-917afe32cf11 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:50.228687 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0cdf6735-1024-45ba-95e2-917afe32cf11 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:50.229134 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0cdf6735-1024-45ba-95e2-917afe32cf11 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:50.229951 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0cdf6735-1024-45ba-95e2-917afe32cf11 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:50.230389 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0cdf6735-1024-45ba-95e2-917afe32cf11 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:50.260334 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0cdf6735-1024-45ba-95e2-917afe32cf11 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042275 Dec 15 12:45:50.260930 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 472/936] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:50 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:50.525926 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ce323242-60d7-424b-a8e0-28bfd1691d6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:50.526448 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ce323242-60d7-424b-a8e0-28bfd1691d6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:50.532537 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ce323242-60d7-424b-a8e0-28bfd1691d6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:50.533106 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ce323242-60d7-424b-a8e0-28bfd1691d6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:50.533765 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ce323242-60d7-424b-a8e0-28bfd1691d6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:50.534279 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ce323242-60d7-424b-a8e0-28bfd1691d6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:50.677184 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7d39901a-e194-49bc-b33f-f0cfb0957e89 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:50.678154 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7d39901a-e194-49bc-b33f-f0cfb0957e89 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:50.684922 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7d39901a-e194-49bc-b33f-f0cfb0957e89 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:50.685384 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7d39901a-e194-49bc-b33f-f0cfb0957e89 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:50.685727 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ce323242-60d7-424b-a8e0-28bfd1691d6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:50.686321 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7d39901a-e194-49bc-b33f-f0cfb0957e89 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:50.686672 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7d39901a-e194-49bc-b33f-f0cfb0957e89 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:50.695044 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ce323242-60d7-424b-a8e0-28bfd1691d6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:50.696553 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ce323242-60d7-424b-a8e0-28bfd1691d6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:50.697748 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ce323242-60d7-424b-a8e0-28bfd1691d6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.175578 Dec 15 12:45:50.698341 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 465/937] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:50 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:50.717353 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7d39901a-e194-49bc-b33f-f0cfb0957e89 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045125 Dec 15 12:45:50.724383 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 473/938] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:50 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:45:51.272876 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7d7d0c25-e6e7-447d-81e7-ab14bb36ace7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:51.273816 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7d7d0c25-e6e7-447d-81e7-ab14bb36ace7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:51.279695 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7d7d0c25-e6e7-447d-81e7-ab14bb36ace7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:51.280139 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7d7d0c25-e6e7-447d-81e7-ab14bb36ace7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:51.280908 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7d7d0c25-e6e7-447d-81e7-ab14bb36ace7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:51.281342 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7d7d0c25-e6e7-447d-81e7-ab14bb36ace7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:51.313773 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7d7d0c25-e6e7-447d-81e7-ab14bb36ace7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044608 Dec 15 12:45:51.314331 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 466/939] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:51 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:51.715958 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-51c91c89-f1a0-4277-8d0b-3dc0232ace81 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:51.716609 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-51c91c89-f1a0-4277-8d0b-3dc0232ace81 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:51.723103 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-51c91c89-f1a0-4277-8d0b-3dc0232ace81 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:51.723550 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-51c91c89-f1a0-4277-8d0b-3dc0232ace81 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:51.724336 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-51c91c89-f1a0-4277-8d0b-3dc0232ace81 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:51.724770 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-51c91c89-f1a0-4277-8d0b-3dc0232ace81 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:51.734601 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-81da69c6-afcf-4767-8473-0d9d95928e64 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:51.735516 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-81da69c6-afcf-4767-8473-0d9d95928e64 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:51.741887 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-81da69c6-afcf-4767-8473-0d9d95928e64 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:51.742337 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-81da69c6-afcf-4767-8473-0d9d95928e64 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:51.743124 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-81da69c6-afcf-4767-8473-0d9d95928e64 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:51.743558 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-81da69c6-afcf-4767-8473-0d9d95928e64 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:51.782286 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-81da69c6-afcf-4767-8473-0d9d95928e64 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051353 Dec 15 12:45:51.782862 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 467/940] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:51 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:45:51.862377 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-51c91c89-f1a0-4277-8d0b-3dc0232ace81 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:51.871185 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-51c91c89-f1a0-4277-8d0b-3dc0232ace81 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:51.872683 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-51c91c89-f1a0-4277-8d0b-3dc0232ace81 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:51.873907 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-51c91c89-f1a0-4277-8d0b-3dc0232ace81 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.161714 Dec 15 12:45:51.874465 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 474/941] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:51 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:52.324081 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f5b94362-51ee-495c-a7d7-87c6563d743b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:52.324986 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f5b94362-51ee-495c-a7d7-87c6563d743b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:52.331533 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f5b94362-51ee-495c-a7d7-87c6563d743b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:52.331974 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f5b94362-51ee-495c-a7d7-87c6563d743b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:52.335961 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f5b94362-51ee-495c-a7d7-87c6563d743b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:52.336412 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f5b94362-51ee-495c-a7d7-87c6563d743b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:52.366748 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f5b94362-51ee-495c-a7d7-87c6563d743b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046285 Dec 15 12:45:52.367298 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 468/942] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:52 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:52.793831 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4e31ef0f-e97b-4c6d-9fe4-6c20d4702b3a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:52.794750 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4e31ef0f-e97b-4c6d-9fe4-6c20d4702b3a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:52.809026 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4e31ef0f-e97b-4c6d-9fe4-6c20d4702b3a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:52.809475 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4e31ef0f-e97b-4c6d-9fe4-6c20d4702b3a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:52.810326 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4e31ef0f-e97b-4c6d-9fe4-6c20d4702b3a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:52.810761 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4e31ef0f-e97b-4c6d-9fe4-6c20d4702b3a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:52.840674 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4e31ef0f-e97b-4c6d-9fe4-6c20d4702b3a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050556 Dec 15 12:45:52.841211 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 475/943] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:52 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:52.892493 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3c2e19a6-12a5-4b7a-9347-7603bd30aedd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:52.893249 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3c2e19a6-12a5-4b7a-9347-7603bd30aedd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:52.899510 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c2e19a6-12a5-4b7a-9347-7603bd30aedd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:52.899948 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c2e19a6-12a5-4b7a-9347-7603bd30aedd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:52.900711 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c2e19a6-12a5-4b7a-9347-7603bd30aedd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:52.901136 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c2e19a6-12a5-4b7a-9347-7603bd30aedd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:53.035472 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3c2e19a6-12a5-4b7a-9347-7603bd30aedd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:53.043992 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3c2e19a6-12a5-4b7a-9347-7603bd30aedd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:53.045426 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3c2e19a6-12a5-4b7a-9347-7603bd30aedd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:53.046597 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3c2e19a6-12a5-4b7a-9347-7603bd30aedd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.157781 Dec 15 12:45:53.047148 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 469/944] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:52 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:53.378504 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bb417753-af6c-4a5e-82c7-4fa05adf68d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:53.379453 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bb417753-af6c-4a5e-82c7-4fa05adf68d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:53.385661 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bb417753-af6c-4a5e-82c7-4fa05adf68d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:53.386110 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bb417753-af6c-4a5e-82c7-4fa05adf68d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:53.386905 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bb417753-af6c-4a5e-82c7-4fa05adf68d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:53.387338 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bb417753-af6c-4a5e-82c7-4fa05adf68d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:53.416986 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bb417753-af6c-4a5e-82c7-4fa05adf68d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042322 Dec 15 12:45:53.417560 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 476/945] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:53 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:53.853044 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-91b6d6a9-a36a-406a-b4a6-9599919e7346 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:53.853922 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-91b6d6a9-a36a-406a-b4a6-9599919e7346 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:53.859823 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-91b6d6a9-a36a-406a-b4a6-9599919e7346 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:53.860264 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-91b6d6a9-a36a-406a-b4a6-9599919e7346 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:53.861033 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-91b6d6a9-a36a-406a-b4a6-9599919e7346 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:53.862171 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-91b6d6a9-a36a-406a-b4a6-9599919e7346 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:53.890711 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-91b6d6a9-a36a-406a-b4a6-9599919e7346 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041451 Dec 15 12:45:53.891258 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 470/946] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:53 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:54.065494 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3ea01e47-eb1b-47e1-97fb-23909c4bc1d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:54.066197 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3ea01e47-eb1b-47e1-97fb-23909c4bc1d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:54.072416 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3ea01e47-eb1b-47e1-97fb-23909c4bc1d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:54.072952 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3ea01e47-eb1b-47e1-97fb-23909c4bc1d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:54.073672 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3ea01e47-eb1b-47e1-97fb-23909c4bc1d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:54.074103 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3ea01e47-eb1b-47e1-97fb-23909c4bc1d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:54.211969 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3ea01e47-eb1b-47e1-97fb-23909c4bc1d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:54.220421 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3ea01e47-eb1b-47e1-97fb-23909c4bc1d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:54.222154 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3ea01e47-eb1b-47e1-97fb-23909c4bc1d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:54.223306 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3ea01e47-eb1b-47e1-97fb-23909c4bc1d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.161681 Dec 15 12:45:54.223866 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 477/947] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:54 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:54.429420 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7d5e4d6f-8129-4840-9f19-02422814e3c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:54.430290 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7d5e4d6f-8129-4840-9f19-02422814e3c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:54.436535 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7d5e4d6f-8129-4840-9f19-02422814e3c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:54.436971 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7d5e4d6f-8129-4840-9f19-02422814e3c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:54.437800 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7d5e4d6f-8129-4840-9f19-02422814e3c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:54.438227 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7d5e4d6f-8129-4840-9f19-02422814e3c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:54.467041 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7d5e4d6f-8129-4840-9f19-02422814e3c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042041 Dec 15 12:45:54.467614 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 471/948] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:54 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:54.902259 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-28455d87-7b5b-4880-ac35-057c6c197033 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:54.903175 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-28455d87-7b5b-4880-ac35-057c6c197033 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:54.909815 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-28455d87-7b5b-4880-ac35-057c6c197033 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:54.910260 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-28455d87-7b5b-4880-ac35-057c6c197033 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:54.911038 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-28455d87-7b5b-4880-ac35-057c6c197033 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:54.911476 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-28455d87-7b5b-4880-ac35-057c6c197033 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:54.939421 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-28455d87-7b5b-4880-ac35-057c6c197033 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040824 Dec 15 12:45:54.940298 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 478/949] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:54 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:55.242417 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1f67d352-8f5e-4840-831c-502838314985 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:55.243028 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1f67d352-8f5e-4840-831c-502838314985 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:55.249329 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1f67d352-8f5e-4840-831c-502838314985 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:55.250147 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1f67d352-8f5e-4840-831c-502838314985 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:55.251302 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1f67d352-8f5e-4840-831c-502838314985 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:55.252430 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1f67d352-8f5e-4840-831c-502838314985 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:55.388972 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1f67d352-8f5e-4840-831c-502838314985 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:55.397723 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1f67d352-8f5e-4840-831c-502838314985 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:55.399218 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1f67d352-8f5e-4840-831c-502838314985 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:55.400370 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1f67d352-8f5e-4840-831c-502838314985 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.161685 Dec 15 12:45:55.400937 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 472/950] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:55 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:55.479285 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ab1abe39-41ed-482b-a554-75a64cc3cd56 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:55.480195 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ab1abe39-41ed-482b-a554-75a64cc3cd56 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:55.486658 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ab1abe39-41ed-482b-a554-75a64cc3cd56 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:55.487108 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ab1abe39-41ed-482b-a554-75a64cc3cd56 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:55.487896 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ab1abe39-41ed-482b-a554-75a64cc3cd56 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:55.488331 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ab1abe39-41ed-482b-a554-75a64cc3cd56 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:55.519427 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ab1abe39-41ed-482b-a554-75a64cc3cd56 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043785 Dec 15 12:45:55.520007 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 479/951] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:55 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:55.951175 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5ab6ebd1-2b25-4ed1-969c-2f5aa1492464 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:55.952090 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5ab6ebd1-2b25-4ed1-969c-2f5aa1492464 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:55.958508 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ab6ebd1-2b25-4ed1-969c-2f5aa1492464 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:55.958957 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ab6ebd1-2b25-4ed1-969c-2f5aa1492464 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:55.959735 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ab6ebd1-2b25-4ed1-969c-2f5aa1492464 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:55.960165 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ab6ebd1-2b25-4ed1-969c-2f5aa1492464 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:55.992611 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5ab6ebd1-2b25-4ed1-969c-2f5aa1492464 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045105 Dec 15 12:45:55.993188 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 473/952] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:55 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:56.418213 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bd494a87-2e4d-4aa5-91cf-2a59f279eae9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:56.418805 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bd494a87-2e4d-4aa5-91cf-2a59f279eae9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:56.425292 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bd494a87-2e4d-4aa5-91cf-2a59f279eae9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:56.425757 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bd494a87-2e4d-4aa5-91cf-2a59f279eae9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:56.426522 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bd494a87-2e4d-4aa5-91cf-2a59f279eae9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:56.426955 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bd494a87-2e4d-4aa5-91cf-2a59f279eae9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:56.530875 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6733976a-2f9b-4ebe-ba53-584645fe77de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:56.531812 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6733976a-2f9b-4ebe-ba53-584645fe77de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:56.537668 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6733976a-2f9b-4ebe-ba53-584645fe77de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:56.538116 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6733976a-2f9b-4ebe-ba53-584645fe77de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:56.538896 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6733976a-2f9b-4ebe-ba53-584645fe77de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:56.539324 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6733976a-2f9b-4ebe-ba53-584645fe77de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:56.558654 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-bd494a87-2e4d-4aa5-91cf-2a59f279eae9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:56.567462 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-bd494a87-2e4d-4aa5-91cf-2a59f279eae9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:56.568962 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-bd494a87-2e4d-4aa5-91cf-2a59f279eae9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:56.570153 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bd494a87-2e4d-4aa5-91cf-2a59f279eae9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.155613 Dec 15 12:45:56.570534 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6733976a-2f9b-4ebe-ba53-584645fe77de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043474 Dec 15 12:45:56.574107 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 480/953] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:56 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:56.574262 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 474/954] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:56 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:45:57.004165 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2a23624e-7c0e-4429-a6e9-4b5baeb3fe1d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:57.005327 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2a23624e-7c0e-4429-a6e9-4b5baeb3fe1d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:57.011223 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2a23624e-7c0e-4429-a6e9-4b5baeb3fe1d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:57.011675 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2a23624e-7c0e-4429-a6e9-4b5baeb3fe1d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:57.012461 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2a23624e-7c0e-4429-a6e9-4b5baeb3fe1d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:57.012900 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2a23624e-7c0e-4429-a6e9-4b5baeb3fe1d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:57.044050 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2a23624e-7c0e-4429-a6e9-4b5baeb3fe1d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043780 Dec 15 12:45:57.044619 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 481/955] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:56 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:57.582200 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0257f25d-23d7-4fce-ba1e-2af1e4ef49b1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:57.583114 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0257f25d-23d7-4fce-ba1e-2af1e4ef49b1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:57.587638 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ab05d2c1-4c2f-4bbd-bbf3-d7e5dec9d397 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:57.588247 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ab05d2c1-4c2f-4bbd-bbf3-d7e5dec9d397 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:57.589180 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0257f25d-23d7-4fce-ba1e-2af1e4ef49b1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:57.589690 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0257f25d-23d7-4fce-ba1e-2af1e4ef49b1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:57.590517 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0257f25d-23d7-4fce-ba1e-2af1e4ef49b1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:57.590951 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0257f25d-23d7-4fce-ba1e-2af1e4ef49b1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:57.594960 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ab05d2c1-4c2f-4bbd-bbf3-d7e5dec9d397 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:57.595425 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ab05d2c1-4c2f-4bbd-bbf3-d7e5dec9d397 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:57.596312 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ab05d2c1-4c2f-4bbd-bbf3-d7e5dec9d397 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:57.596749 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ab05d2c1-4c2f-4bbd-bbf3-d7e5dec9d397 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:57.620519 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0257f25d-23d7-4fce-ba1e-2af1e4ef49b1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042831 Dec 15 12:45:57.621087 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 475/956] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:57 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:57.732303 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ab05d2c1-4c2f-4bbd-bbf3-d7e5dec9d397 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:57.740569 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ab05d2c1-4c2f-4bbd-bbf3-d7e5dec9d397 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:57.742114 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ab05d2c1-4c2f-4bbd-bbf3-d7e5dec9d397 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:57.743280 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ab05d2c1-4c2f-4bbd-bbf3-d7e5dec9d397 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.159267 Dec 15 12:45:57.744201 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 482/957] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:57 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:45:58.055659 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-26caa3e2-2afc-4d3d-b5cc-b876a686c1fa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:58.056572 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-26caa3e2-2afc-4d3d-b5cc-b876a686c1fa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:58.062847 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-26caa3e2-2afc-4d3d-b5cc-b876a686c1fa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:58.063295 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-26caa3e2-2afc-4d3d-b5cc-b876a686c1fa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:58.064106 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-26caa3e2-2afc-4d3d-b5cc-b876a686c1fa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:58.065291 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-26caa3e2-2afc-4d3d-b5cc-b876a686c1fa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:58.094268 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-26caa3e2-2afc-4d3d-b5cc-b876a686c1fa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042301 Dec 15 12:45:58.094823 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 476/958] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:58 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:58.632589 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8e136403-af86-4e50-a23c-4e33ceeda03e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:58.633612 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8e136403-af86-4e50-a23c-4e33ceeda03e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:58.640103 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8e136403-af86-4e50-a23c-4e33ceeda03e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:58.640559 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8e136403-af86-4e50-a23c-4e33ceeda03e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:58.641357 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8e136403-af86-4e50-a23c-4e33ceeda03e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:58.641861 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8e136403-af86-4e50-a23c-4e33ceeda03e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:58.672079 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8e136403-af86-4e50-a23c-4e33ceeda03e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043667 Dec 15 12:45:58.672647 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 483/959] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:58 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:45:58.761815 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-591ec113-ef2c-4aec-87f4-3088368a9815 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:58.762401 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-591ec113-ef2c-4aec-87f4-3088368a9815 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:58.769147 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-591ec113-ef2c-4aec-87f4-3088368a9815 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:58.769617 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-591ec113-ef2c-4aec-87f4-3088368a9815 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:58.770393 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-591ec113-ef2c-4aec-87f4-3088368a9815 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:58.770818 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-591ec113-ef2c-4aec-87f4-3088368a9815 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:58.904917 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-591ec113-ef2c-4aec-87f4-3088368a9815 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:58.913424 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-591ec113-ef2c-4aec-87f4-3088368a9815 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:58.914955 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-591ec113-ef2c-4aec-87f4-3088368a9815 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:45:58.916113 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-591ec113-ef2c-4aec-87f4-3088368a9815 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.157986 Dec 15 12:45:58.916660 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 477/960] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:58 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:45:59.105997 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-28737ca1-318a-45da-a71f-58426393b9ca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:59.106904 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-28737ca1-318a-45da-a71f-58426393b9ca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:59.112983 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-28737ca1-318a-45da-a71f-58426393b9ca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:59.113431 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-28737ca1-318a-45da-a71f-58426393b9ca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:59.114243 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-28737ca1-318a-45da-a71f-58426393b9ca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:59.114678 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-28737ca1-318a-45da-a71f-58426393b9ca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:59.146146 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-28737ca1-318a-45da-a71f-58426393b9ca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043759 Dec 15 12:45:59.146633 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 484/961] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:59 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:59.684110 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e900f8cf-285f-453c-a05b-80a95442237f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:59.684956 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e900f8cf-285f-453c-a05b-80a95442237f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:59.691033 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e900f8cf-285f-453c-a05b-80a95442237f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:59.691478 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e900f8cf-285f-453c-a05b-80a95442237f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:59.692257 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e900f8cf-285f-453c-a05b-80a95442237f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:59.692687 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e900f8cf-285f-453c-a05b-80a95442237f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:59.722960 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e900f8cf-285f-453c-a05b-80a95442237f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042695 Dec 15 12:45:59.723534 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 478/962] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:45:59 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:45:59.936702 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ba4c6271-0af8-46e8-bd5a-6bbb44e712f5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:45:59.937253 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ba4c6271-0af8-46e8-bd5a-6bbb44e712f5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:45:59.944076 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ba4c6271-0af8-46e8-bd5a-6bbb44e712f5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:59.944531 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ba4c6271-0af8-46e8-bd5a-6bbb44e712f5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:45:59.945323 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ba4c6271-0af8-46e8-bd5a-6bbb44e712f5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:45:59.945789 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ba4c6271-0af8-46e8-bd5a-6bbb44e712f5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:00.075896 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ba4c6271-0af8-46e8-bd5a-6bbb44e712f5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:00.084657 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ba4c6271-0af8-46e8-bd5a-6bbb44e712f5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:00.086186 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ba4c6271-0af8-46e8-bd5a-6bbb44e712f5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:00.087342 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ba4c6271-0af8-46e8-bd5a-6bbb44e712f5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.156873 Dec 15 12:46:00.087894 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 485/963] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:45:59 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:00.157780 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ab708c58-8817-4b0f-98f8-8a9b2a0c0250 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:00.159261 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ab708c58-8817-4b0f-98f8-8a9b2a0c0250 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:00.165461 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ab708c58-8817-4b0f-98f8-8a9b2a0c0250 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:00.165966 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ab708c58-8817-4b0f-98f8-8a9b2a0c0250 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:00.166780 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ab708c58-8817-4b0f-98f8-8a9b2a0c0250 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:00.167216 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ab708c58-8817-4b0f-98f8-8a9b2a0c0250 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:00.204211 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ab708c58-8817-4b0f-98f8-8a9b2a0c0250 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050176 Dec 15 12:46:00.205606 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 479/964] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:00 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:00.735238 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-16e30955-e9e9-4249-b14b-b187661c381a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:00.736104 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-16e30955-e9e9-4249-b14b-b187661c381a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:00.742202 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-16e30955-e9e9-4249-b14b-b187661c381a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:00.742647 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-16e30955-e9e9-4249-b14b-b187661c381a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:00.743423 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-16e30955-e9e9-4249-b14b-b187661c381a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:00.743852 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-16e30955-e9e9-4249-b14b-b187661c381a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:00.773775 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-16e30955-e9e9-4249-b14b-b187661c381a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042224 Dec 15 12:46:00.774368 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 486/965] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:00 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:01.106939 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-16cb32fb-ff22-42c7-a05d-57341cb633d4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:01.107452 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-16cb32fb-ff22-42c7-a05d-57341cb633d4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:01.114196 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-16cb32fb-ff22-42c7-a05d-57341cb633d4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:01.114673 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-16cb32fb-ff22-42c7-a05d-57341cb633d4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:01.115473 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-16cb32fb-ff22-42c7-a05d-57341cb633d4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:01.115905 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-16cb32fb-ff22-42c7-a05d-57341cb633d4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:01.215946 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-741cbbfe-0bd2-4973-ba08-d0c0c5384116 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:01.217004 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-741cbbfe-0bd2-4973-ba08-d0c0c5384116 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:01.224137 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-741cbbfe-0bd2-4973-ba08-d0c0c5384116 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:01.224668 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-741cbbfe-0bd2-4973-ba08-d0c0c5384116 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:01.225554 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-741cbbfe-0bd2-4973-ba08-d0c0c5384116 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:01.226068 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-741cbbfe-0bd2-4973-ba08-d0c0c5384116 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:01.259919 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-16cb32fb-ff22-42c7-a05d-57341cb633d4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:01.263896 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-741cbbfe-0bd2-4973-ba08-d0c0c5384116 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051575 Dec 15 12:46:01.264719 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 487/966] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:01 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:46:01.269350 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-16cb32fb-ff22-42c7-a05d-57341cb633d4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:01.270911 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-16cb32fb-ff22-42c7-a05d-57341cb633d4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:01.272075 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-16cb32fb-ff22-42c7-a05d-57341cb633d4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.168983 Dec 15 12:46:01.272623 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 480/967] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:01 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:01.785687 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8da95ff8-1c29-4914-9091-c09f8bddbe4d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:01.786423 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8da95ff8-1c29-4914-9091-c09f8bddbe4d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:01.792198 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8da95ff8-1c29-4914-9091-c09f8bddbe4d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:01.792637 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8da95ff8-1c29-4914-9091-c09f8bddbe4d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:01.793405 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8da95ff8-1c29-4914-9091-c09f8bddbe4d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:01.793875 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8da95ff8-1c29-4914-9091-c09f8bddbe4d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:01.822580 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8da95ff8-1c29-4914-9091-c09f8bddbe4d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041352 Dec 15 12:46:01.823172 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 488/968] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:01 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:02.274820 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-237a3e09-9f13-44d8-b4fc-14da37e02c1a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:02.275765 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-237a3e09-9f13-44d8-b4fc-14da37e02c1a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:02.287682 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-237a3e09-9f13-44d8-b4fc-14da37e02c1a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:02.288134 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-237a3e09-9f13-44d8-b4fc-14da37e02c1a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:02.288969 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-237a3e09-9f13-44d8-b4fc-14da37e02c1a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:02.289138 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-edc2cbc8-52f8-4f6e-a5c0-208c8b47a85c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:02.289822 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-237a3e09-9f13-44d8-b4fc-14da37e02c1a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:02.289946 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-edc2cbc8-52f8-4f6e-a5c0-208c8b47a85c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:02.296858 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-edc2cbc8-52f8-4f6e-a5c0-208c8b47a85c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:02.297301 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-edc2cbc8-52f8-4f6e-a5c0-208c8b47a85c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:02.298140 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-edc2cbc8-52f8-4f6e-a5c0-208c8b47a85c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:02.299116 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-edc2cbc8-52f8-4f6e-a5c0-208c8b47a85c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:02.322927 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-237a3e09-9f13-44d8-b4fc-14da37e02c1a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051806 Dec 15 12:46:02.323495 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 481/969] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:02 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:02.435953 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-edc2cbc8-52f8-4f6e-a5c0-208c8b47a85c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:02.445196 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-edc2cbc8-52f8-4f6e-a5c0-208c8b47a85c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:02.446819 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-edc2cbc8-52f8-4f6e-a5c0-208c8b47a85c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:02.448038 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-edc2cbc8-52f8-4f6e-a5c0-208c8b47a85c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.162640 Dec 15 12:46:02.448610 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 489/970] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:02 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:46:02.834562 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bce98243-6d4c-4bd4-ad6c-06291b0d92bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:02.835390 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bce98243-6d4c-4bd4-ad6c-06291b0d92bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:02.841236 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bce98243-6d4c-4bd4-ad6c-06291b0d92bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:02.841798 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bce98243-6d4c-4bd4-ad6c-06291b0d92bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:02.842580 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bce98243-6d4c-4bd4-ad6c-06291b0d92bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:02.843016 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bce98243-6d4c-4bd4-ad6c-06291b0d92bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:02.874173 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bce98243-6d4c-4bd4-ad6c-06291b0d92bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043382 Dec 15 12:46:02.874748 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 482/971] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:02 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:03.337029 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f4d691ad-c4ad-45bd-bd89-68fec01b79d1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:03.338402 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f4d691ad-c4ad-45bd-bd89-68fec01b79d1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:03.347144 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4d691ad-c4ad-45bd-bd89-68fec01b79d1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:03.347524 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4d691ad-c4ad-45bd-bd89-68fec01b79d1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:03.348326 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4d691ad-c4ad-45bd-bd89-68fec01b79d1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:03.348758 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4d691ad-c4ad-45bd-bd89-68fec01b79d1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:03.377410 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f4d691ad-c4ad-45bd-bd89-68fec01b79d1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045817 Dec 15 12:46:03.378004 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 490/972] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:03 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:03.468315 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-09340f0f-cf81-4b0f-8e6e-acc5c44efde5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:03.468916 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-09340f0f-cf81-4b0f-8e6e-acc5c44efde5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:03.475169 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-09340f0f-cf81-4b0f-8e6e-acc5c44efde5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:03.475618 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-09340f0f-cf81-4b0f-8e6e-acc5c44efde5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:03.476385 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-09340f0f-cf81-4b0f-8e6e-acc5c44efde5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:03.476810 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-09340f0f-cf81-4b0f-8e6e-acc5c44efde5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:03.628132 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-09340f0f-cf81-4b0f-8e6e-acc5c44efde5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:03.638691 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-09340f0f-cf81-4b0f-8e6e-acc5c44efde5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:03.640201 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-09340f0f-cf81-4b0f-8e6e-acc5c44efde5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:03.641357 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-09340f0f-cf81-4b0f-8e6e-acc5c44efde5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.176741 Dec 15 12:46:03.642110 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 483/973] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:03 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:03.886214 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b3ee32d6-7db1-42c4-bd1f-ceb219745f7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:03.887113 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b3ee32d6-7db1-42c4-bd1f-ceb219745f7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:03.893061 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b3ee32d6-7db1-42c4-bd1f-ceb219745f7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:03.893514 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b3ee32d6-7db1-42c4-bd1f-ceb219745f7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:03.894295 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b3ee32d6-7db1-42c4-bd1f-ceb219745f7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:03.894729 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b3ee32d6-7db1-42c4-bd1f-ceb219745f7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:03.926539 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b3ee32d6-7db1-42c4-bd1f-ceb219745f7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043987 Dec 15 12:46:03.927096 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 491/974] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:03 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:04.389566 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bb8f89e0-23cf-4623-bb35-eb9e4eff192e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:04.390496 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bb8f89e0-23cf-4623-bb35-eb9e4eff192e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:04.396373 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bb8f89e0-23cf-4623-bb35-eb9e4eff192e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:04.396812 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bb8f89e0-23cf-4623-bb35-eb9e4eff192e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:04.397602 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bb8f89e0-23cf-4623-bb35-eb9e4eff192e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:04.398032 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bb8f89e0-23cf-4623-bb35-eb9e4eff192e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:04.427166 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bb8f89e0-23cf-4623-bb35-eb9e4eff192e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041246 Dec 15 12:46:04.427746 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 484/975] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:04 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:04.664906 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2c206ffb-bf96-4d22-ae40-4f76608ebf22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:04.665641 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2c206ffb-bf96-4d22-ae40-4f76608ebf22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:04.671857 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2c206ffb-bf96-4d22-ae40-4f76608ebf22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:04.672306 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2c206ffb-bf96-4d22-ae40-4f76608ebf22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:04.673094 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2c206ffb-bf96-4d22-ae40-4f76608ebf22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:04.673559 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2c206ffb-bf96-4d22-ae40-4f76608ebf22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:04.811004 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2c206ffb-bf96-4d22-ae40-4f76608ebf22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:04.819426 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2c206ffb-bf96-4d22-ae40-4f76608ebf22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:04.820923 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2c206ffb-bf96-4d22-ae40-4f76608ebf22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:04.822104 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2c206ffb-bf96-4d22-ae40-4f76608ebf22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.160878 Dec 15 12:46:04.822654 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 492/976] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:04 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:04.938098 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-61b26a26-b0a4-4783-8a7b-b3698c8b2f54 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:04.938947 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-61b26a26-b0a4-4783-8a7b-b3698c8b2f54 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:04.946275 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-61b26a26-b0a4-4783-8a7b-b3698c8b2f54 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:04.946734 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-61b26a26-b0a4-4783-8a7b-b3698c8b2f54 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:04.947539 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-61b26a26-b0a4-4783-8a7b-b3698c8b2f54 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:04.947975 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-61b26a26-b0a4-4783-8a7b-b3698c8b2f54 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:04.979234 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-61b26a26-b0a4-4783-8a7b-b3698c8b2f54 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044929 Dec 15 12:46:04.979794 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 485/977] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:04 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:46:05.438922 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-77cecf75-cf0d-433d-91c5-77ba98a07967 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:05.440592 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-77cecf75-cf0d-433d-91c5-77ba98a07967 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:05.446444 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-77cecf75-cf0d-433d-91c5-77ba98a07967 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:05.446894 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-77cecf75-cf0d-433d-91c5-77ba98a07967 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:05.447675 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-77cecf75-cf0d-433d-91c5-77ba98a07967 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:05.448111 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-77cecf75-cf0d-433d-91c5-77ba98a07967 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:05.485473 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-77cecf75-cf0d-433d-91c5-77ba98a07967 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049834 Dec 15 12:46:05.486646 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 493/978] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:05 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:05.840820 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2370a425-db5d-4053-a11d-848593e5985e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:05.841360 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2370a425-db5d-4053-a11d-848593e5985e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:05.847602 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2370a425-db5d-4053-a11d-848593e5985e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:05.848043 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2370a425-db5d-4053-a11d-848593e5985e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:05.848825 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2370a425-db5d-4053-a11d-848593e5985e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:05.849253 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2370a425-db5d-4053-a11d-848593e5985e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:05.987472 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2370a425-db5d-4053-a11d-848593e5985e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:05.989737 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-34931627-1035-4861-97ae-8df9f446c686 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:05.990665 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-34931627-1035-4861-97ae-8df9f446c686 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:05.997295 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-34931627-1035-4861-97ae-8df9f446c686 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:05.997773 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-34931627-1035-4861-97ae-8df9f446c686 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:05.998798 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-34931627-1035-4861-97ae-8df9f446c686 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:05.999234 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-34931627-1035-4861-97ae-8df9f446c686 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:06.002381 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2370a425-db5d-4053-a11d-848593e5985e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:06.003890 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2370a425-db5d-4053-a11d-848593e5985e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:06.005320 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2370a425-db5d-4053-a11d-848593e5985e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.168431 Dec 15 12:46:06.006000 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 486/979] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:05 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:06.031307 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-34931627-1035-4861-97ae-8df9f446c686 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045296 Dec 15 12:46:06.031871 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 494/980] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:05 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:46:06.497720 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1f7d5e8d-4539-4ed6-ab30-628d2cb9bd7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:06.498620 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1f7d5e8d-4539-4ed6-ab30-628d2cb9bd7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:06.504446 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1f7d5e8d-4539-4ed6-ab30-628d2cb9bd7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:06.505140 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1f7d5e8d-4539-4ed6-ab30-628d2cb9bd7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:06.505943 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1f7d5e8d-4539-4ed6-ab30-628d2cb9bd7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:06.506372 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1f7d5e8d-4539-4ed6-ab30-628d2cb9bd7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:06.536975 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1f7d5e8d-4539-4ed6-ab30-628d2cb9bd7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042971 Dec 15 12:46:06.537556 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 487/981] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:06 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:07.024057 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f7aad8f9-22d1-417e-a758-6e4eb51eecef tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:07.024582 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f7aad8f9-22d1-417e-a758-6e4eb51eecef tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:07.030787 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f7aad8f9-22d1-417e-a758-6e4eb51eecef tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:07.031238 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f7aad8f9-22d1-417e-a758-6e4eb51eecef tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:07.032019 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f7aad8f9-22d1-417e-a758-6e4eb51eecef tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:07.032456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f7aad8f9-22d1-417e-a758-6e4eb51eecef tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:07.042763 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bd7e831c-87c4-4fee-bd87-10d7cdb05805 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:07.043719 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bd7e831c-87c4-4fee-bd87-10d7cdb05805 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:07.050658 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd7e831c-87c4-4fee-bd87-10d7cdb05805 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:07.051101 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd7e831c-87c4-4fee-bd87-10d7cdb05805 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:07.051894 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd7e831c-87c4-4fee-bd87-10d7cdb05805 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:07.052324 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd7e831c-87c4-4fee-bd87-10d7cdb05805 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:07.083744 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bd7e831c-87c4-4fee-bd87-10d7cdb05805 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044773 Dec 15 12:46:07.084354 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 488/982] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:07 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:46:07.169565 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f7aad8f9-22d1-417e-a758-6e4eb51eecef tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:07.178166 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f7aad8f9-22d1-417e-a758-6e4eb51eecef tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:07.179653 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f7aad8f9-22d1-417e-a758-6e4eb51eecef tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:07.180797 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f7aad8f9-22d1-417e-a758-6e4eb51eecef tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.160570 Dec 15 12:46:07.181350 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 495/983] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:07 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:07.549610 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-995664f9-6f35-40ea-9a8f-ba53f018eff3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:07.550458 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-995664f9-6f35-40ea-9a8f-ba53f018eff3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:07.556335 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-995664f9-6f35-40ea-9a8f-ba53f018eff3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:07.556780 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-995664f9-6f35-40ea-9a8f-ba53f018eff3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:07.557589 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-995664f9-6f35-40ea-9a8f-ba53f018eff3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:07.558027 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-995664f9-6f35-40ea-9a8f-ba53f018eff3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:07.588332 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-995664f9-6f35-40ea-9a8f-ba53f018eff3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043327 Dec 15 12:46:07.588892 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 489/984] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:07 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:08.096766 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-30eee3cc-7f06-4b46-9dea-89dae2b052af tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:08.097623 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-30eee3cc-7f06-4b46-9dea-89dae2b052af tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:08.103891 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-30eee3cc-7f06-4b46-9dea-89dae2b052af tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:08.104340 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-30eee3cc-7f06-4b46-9dea-89dae2b052af tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:08.105120 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-30eee3cc-7f06-4b46-9dea-89dae2b052af tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:08.105585 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-30eee3cc-7f06-4b46-9dea-89dae2b052af tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:08.134383 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-30eee3cc-7f06-4b46-9dea-89dae2b052af tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042042 Dec 15 12:46:08.134934 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 496/985] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:08 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:08.199225 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-56e81d27-ece4-4916-b0bf-5f8d4f674dee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:08.199824 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-56e81d27-ece4-4916-b0bf-5f8d4f674dee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:08.206841 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-56e81d27-ece4-4916-b0bf-5f8d4f674dee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:08.207289 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-56e81d27-ece4-4916-b0bf-5f8d4f674dee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:08.208067 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-56e81d27-ece4-4916-b0bf-5f8d4f674dee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:08.208504 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-56e81d27-ece4-4916-b0bf-5f8d4f674dee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:08.340863 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-56e81d27-ece4-4916-b0bf-5f8d4f674dee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:08.352408 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-56e81d27-ece4-4916-b0bf-5f8d4f674dee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:08.353837 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-56e81d27-ece4-4916-b0bf-5f8d4f674dee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:08.355194 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-56e81d27-ece4-4916-b0bf-5f8d4f674dee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.159605 Dec 15 12:46:08.355917 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 490/986] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:08 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:08.599752 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7763edb6-d3b7-4212-a422-93227c39686a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:08.601278 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7763edb6-d3b7-4212-a422-93227c39686a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:08.607677 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7763edb6-d3b7-4212-a422-93227c39686a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:08.608039 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7763edb6-d3b7-4212-a422-93227c39686a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:08.608843 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7763edb6-d3b7-4212-a422-93227c39686a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:08.609290 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7763edb6-d3b7-4212-a422-93227c39686a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:08.647599 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7763edb6-d3b7-4212-a422-93227c39686a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051555 Dec 15 12:46:08.648190 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 497/987] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:08 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:09.145369 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-41ffe158-d761-46b9-b69e-7b47fbccd2db tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:09.146473 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-41ffe158-d761-46b9-b69e-7b47fbccd2db tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:09.152605 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-41ffe158-d761-46b9-b69e-7b47fbccd2db tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:09.153051 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-41ffe158-d761-46b9-b69e-7b47fbccd2db tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:09.153860 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-41ffe158-d761-46b9-b69e-7b47fbccd2db tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:09.154304 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-41ffe158-d761-46b9-b69e-7b47fbccd2db tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:09.188844 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-41ffe158-d761-46b9-b69e-7b47fbccd2db tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047166 Dec 15 12:46:09.190046 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 491/988] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:09 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:09.373958 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6397362c-2bbc-48bb-ad14-a72c491f9b13 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:09.374547 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6397362c-2bbc-48bb-ad14-a72c491f9b13 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:09.381743 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6397362c-2bbc-48bb-ad14-a72c491f9b13 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:09.382193 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6397362c-2bbc-48bb-ad14-a72c491f9b13 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:09.382974 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6397362c-2bbc-48bb-ad14-a72c491f9b13 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:09.383406 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6397362c-2bbc-48bb-ad14-a72c491f9b13 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:09.660511 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7aeb2dda-e550-41cd-abdd-486aa0c9d7e1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:09.661467 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7aeb2dda-e550-41cd-abdd-486aa0c9d7e1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:09.667906 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7aeb2dda-e550-41cd-abdd-486aa0c9d7e1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:09.668352 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7aeb2dda-e550-41cd-abdd-486aa0c9d7e1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:09.669139 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7aeb2dda-e550-41cd-abdd-486aa0c9d7e1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:09.669615 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7aeb2dda-e550-41cd-abdd-486aa0c9d7e1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:09.699941 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7aeb2dda-e550-41cd-abdd-486aa0c9d7e1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044449 Dec 15 12:46:09.700531 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 492/989] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:09 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:46:09.710618 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6397362c-2bbc-48bb-ad14-a72c491f9b13 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:09.718903 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6397362c-2bbc-48bb-ad14-a72c491f9b13 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:09.721135 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6397362c-2bbc-48bb-ad14-a72c491f9b13 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:09.722487 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6397362c-2bbc-48bb-ad14-a72c491f9b13 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.352331 Dec 15 12:46:09.723134 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 498/990] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:09 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:10.201734 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0ffdc9b9-fe78-4321-9987-c50b662e9e97 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:10.202644 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0ffdc9b9-fe78-4321-9987-c50b662e9e97 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:10.209061 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0ffdc9b9-fe78-4321-9987-c50b662e9e97 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:10.209518 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0ffdc9b9-fe78-4321-9987-c50b662e9e97 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:10.210305 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0ffdc9b9-fe78-4321-9987-c50b662e9e97 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:10.210736 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0ffdc9b9-fe78-4321-9987-c50b662e9e97 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:10.244784 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0ffdc9b9-fe78-4321-9987-c50b662e9e97 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046751 Dec 15 12:46:10.245352 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 493/991] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:10 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:10.711449 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-14c4e8f0-8180-49f0-b2b0-78cd10605813 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:10.712351 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-14c4e8f0-8180-49f0-b2b0-78cd10605813 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:10.718667 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-14c4e8f0-8180-49f0-b2b0-78cd10605813 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:10.719115 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-14c4e8f0-8180-49f0-b2b0-78cd10605813 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:10.719899 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-14c4e8f0-8180-49f0-b2b0-78cd10605813 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:10.720399 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-14c4e8f0-8180-49f0-b2b0-78cd10605813 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:10.743468 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0929da96-f43a-451b-acad-46472980dc6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:10.744230 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0929da96-f43a-451b-acad-46472980dc6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:10.751244 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0929da96-f43a-451b-acad-46472980dc6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:10.752273 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0929da96-f43a-451b-acad-46472980dc6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:10.752968 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-14c4e8f0-8180-49f0-b2b0-78cd10605813 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045078 Dec 15 12:46:10.753112 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0929da96-f43a-451b-acad-46472980dc6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:10.753837 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0929da96-f43a-451b-acad-46472980dc6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:10.753962 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 499/992] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:10 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:10.886634 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0929da96-f43a-451b-acad-46472980dc6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:10.894850 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0929da96-f43a-451b-acad-46472980dc6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:10.896343 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0929da96-f43a-451b-acad-46472980dc6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:10.897487 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0929da96-f43a-451b-acad-46472980dc6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.160589 Dec 15 12:46:10.898072 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 494/993] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:10 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:46:11.256592 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c9b80af7-95b5-4644-8b7c-8de02a6ff72f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:11.257496 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c9b80af7-95b5-4644-8b7c-8de02a6ff72f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:11.263472 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c9b80af7-95b5-4644-8b7c-8de02a6ff72f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:11.263923 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c9b80af7-95b5-4644-8b7c-8de02a6ff72f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:11.272298 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c9b80af7-95b5-4644-8b7c-8de02a6ff72f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:11.272863 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c9b80af7-95b5-4644-8b7c-8de02a6ff72f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:11.303909 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c9b80af7-95b5-4644-8b7c-8de02a6ff72f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051309 Dec 15 12:46:11.304484 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 500/994] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:11 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:11.765294 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f12a94e4-7bc7-4a8f-891c-61e8eabdc09b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:11.766247 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f12a94e4-7bc7-4a8f-891c-61e8eabdc09b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:11.773462 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f12a94e4-7bc7-4a8f-891c-61e8eabdc09b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:11.773943 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f12a94e4-7bc7-4a8f-891c-61e8eabdc09b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:11.774722 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f12a94e4-7bc7-4a8f-891c-61e8eabdc09b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:11.775154 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f12a94e4-7bc7-4a8f-891c-61e8eabdc09b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:11.805014 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f12a94e4-7bc7-4a8f-891c-61e8eabdc09b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043424 Dec 15 12:46:11.805597 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 495/995] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:11 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:11.916356 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-986167d7-6752-4a25-b702-685d1f4bce9f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:11.916935 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-986167d7-6752-4a25-b702-685d1f4bce9f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:11.923315 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-986167d7-6752-4a25-b702-685d1f4bce9f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:11.923766 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-986167d7-6752-4a25-b702-685d1f4bce9f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:11.924552 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-986167d7-6752-4a25-b702-685d1f4bce9f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:11.924977 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-986167d7-6752-4a25-b702-685d1f4bce9f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:12.066605 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-986167d7-6752-4a25-b702-685d1f4bce9f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:12.074827 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-986167d7-6752-4a25-b702-685d1f4bce9f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:12.076333 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-986167d7-6752-4a25-b702-685d1f4bce9f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:12.077489 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-986167d7-6752-4a25-b702-685d1f4bce9f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.164828 Dec 15 12:46:12.078072 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 501/996] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:11 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:12.316311 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-aece7dc3-041e-40fd-a52b-9063797d4ce8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:12.317205 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-aece7dc3-041e-40fd-a52b-9063797d4ce8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:12.323106 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aece7dc3-041e-40fd-a52b-9063797d4ce8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:12.323545 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aece7dc3-041e-40fd-a52b-9063797d4ce8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:12.324328 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aece7dc3-041e-40fd-a52b-9063797d4ce8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:12.324759 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aece7dc3-041e-40fd-a52b-9063797d4ce8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:12.353247 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-aece7dc3-041e-40fd-a52b-9063797d4ce8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041329 Dec 15 12:46:12.353871 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 496/997] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:12 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:12.816371 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-aee6911a-e0e5-4b14-b56d-77fd9c44d288 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:12.817294 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-aee6911a-e0e5-4b14-b56d-77fd9c44d288 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:12.823260 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aee6911a-e0e5-4b14-b56d-77fd9c44d288 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:12.823703 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aee6911a-e0e5-4b14-b56d-77fd9c44d288 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:12.824477 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aee6911a-e0e5-4b14-b56d-77fd9c44d288 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:12.824904 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aee6911a-e0e5-4b14-b56d-77fd9c44d288 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:12.858586 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-aee6911a-e0e5-4b14-b56d-77fd9c44d288 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045913 Dec 15 12:46:12.859145 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 502/998] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:12 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:13.096745 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-487447cb-fa09-402d-b675-37a2b665e067 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:13.097357 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-487447cb-fa09-402d-b675-37a2b665e067 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:13.104462 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-487447cb-fa09-402d-b675-37a2b665e067 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:13.104905 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-487447cb-fa09-402d-b675-37a2b665e067 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:13.105752 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-487447cb-fa09-402d-b675-37a2b665e067 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:13.106188 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-487447cb-fa09-402d-b675-37a2b665e067 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:13.247949 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-487447cb-fa09-402d-b675-37a2b665e067 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:13.258037 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-487447cb-fa09-402d-b675-37a2b665e067 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:13.259528 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-487447cb-fa09-402d-b675-37a2b665e067 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:13.260719 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-487447cb-fa09-402d-b675-37a2b665e067 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.168895 Dec 15 12:46:13.261453 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 497/999] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:13 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:13.365978 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a728e604-c758-4eb6-b8a6-a9c7a38bc7ab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:13.366804 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a728e604-c758-4eb6-b8a6-a9c7a38bc7ab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:13.373144 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a728e604-c758-4eb6-b8a6-a9c7a38bc7ab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:13.373622 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a728e604-c758-4eb6-b8a6-a9c7a38bc7ab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:13.374412 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a728e604-c758-4eb6-b8a6-a9c7a38bc7ab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:13.374846 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a728e604-c758-4eb6-b8a6-a9c7a38bc7ab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:13.405382 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a728e604-c758-4eb6-b8a6-a9c7a38bc7ab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043607 Dec 15 12:46:13.406363 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 503/1000] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:13 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:13.869882 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c3510e2c-6b24-486a-a6ab-8842e779eb57 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:13.870794 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c3510e2c-6b24-486a-a6ab-8842e779eb57 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:13.876650 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c3510e2c-6b24-486a-a6ab-8842e779eb57 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:13.877199 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c3510e2c-6b24-486a-a6ab-8842e779eb57 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:13.878010 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c3510e2c-6b24-486a-a6ab-8842e779eb57 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:13.878444 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c3510e2c-6b24-486a-a6ab-8842e779eb57 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:13.915853 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c3510e2c-6b24-486a-a6ab-8842e779eb57 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049649 Dec 15 12:46:13.916420 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 498/1001] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:13 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:14.278583 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bb11a321-30dc-4135-8f49-33a18e57991f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:14.279223 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bb11a321-30dc-4135-8f49-33a18e57991f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:14.285177 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bb11a321-30dc-4135-8f49-33a18e57991f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:14.285657 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bb11a321-30dc-4135-8f49-33a18e57991f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:14.286445 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bb11a321-30dc-4135-8f49-33a18e57991f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:14.286887 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bb11a321-30dc-4135-8f49-33a18e57991f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:14.418024 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a87647d7-f4c7-4c75-812b-5d9d21a1269e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:14.418926 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a87647d7-f4c7-4c75-812b-5d9d21a1269e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:14.425877 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a87647d7-f4c7-4c75-812b-5d9d21a1269e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:14.426324 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a87647d7-f4c7-4c75-812b-5d9d21a1269e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:14.427113 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a87647d7-f4c7-4c75-812b-5d9d21a1269e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:14.427320 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-bb11a321-30dc-4135-8f49-33a18e57991f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:14.427746 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a87647d7-f4c7-4c75-812b-5d9d21a1269e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:14.436191 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-bb11a321-30dc-4135-8f49-33a18e57991f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:14.437710 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-bb11a321-30dc-4135-8f49-33a18e57991f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:14.438871 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bb11a321-30dc-4135-8f49-33a18e57991f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.163999 Dec 15 12:46:14.440023 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 504/1002] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:14 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:14.457951 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a87647d7-f4c7-4c75-812b-5d9d21a1269e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043510 Dec 15 12:46:14.458550 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 499/1003] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:14 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:46:14.928284 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4ff14d6a-3caa-460b-82df-ec0f994aeb89 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:14.929208 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4ff14d6a-3caa-460b-82df-ec0f994aeb89 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:14.935114 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4ff14d6a-3caa-460b-82df-ec0f994aeb89 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:14.935552 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4ff14d6a-3caa-460b-82df-ec0f994aeb89 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:14.936363 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4ff14d6a-3caa-460b-82df-ec0f994aeb89 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:14.936761 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4ff14d6a-3caa-460b-82df-ec0f994aeb89 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:14.965106 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4ff14d6a-3caa-460b-82df-ec0f994aeb89 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041392 Dec 15 12:46:14.965679 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 505/1004] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:14 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:15.458302 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8be183d0-0ab6-4aee-9aeb-233833e7b9ee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:15.459020 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8be183d0-0ab6-4aee-9aeb-233833e7b9ee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:15.465436 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8be183d0-0ab6-4aee-9aeb-233833e7b9ee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:15.465917 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8be183d0-0ab6-4aee-9aeb-233833e7b9ee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:15.466699 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8be183d0-0ab6-4aee-9aeb-233833e7b9ee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:15.467131 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8be183d0-0ab6-4aee-9aeb-233833e7b9ee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:15.468738 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8aa995b6-17e0-4ddd-b076-7cfecd8dd7ca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:15.469667 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8aa995b6-17e0-4ddd-b076-7cfecd8dd7ca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:15.475960 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8aa995b6-17e0-4ddd-b076-7cfecd8dd7ca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:15.476408 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8aa995b6-17e0-4ddd-b076-7cfecd8dd7ca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:15.477200 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8aa995b6-17e0-4ddd-b076-7cfecd8dd7ca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:15.477671 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8aa995b6-17e0-4ddd-b076-7cfecd8dd7ca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:15.515282 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8aa995b6-17e0-4ddd-b076-7cfecd8dd7ca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050217 Dec 15 12:46:15.515850 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 506/1005] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:15 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:46:15.602103 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8be183d0-0ab6-4aee-9aeb-233833e7b9ee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:15.614961 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8be183d0-0ab6-4aee-9aeb-233833e7b9ee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:15.616441 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8be183d0-0ab6-4aee-9aeb-233833e7b9ee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:15.617627 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8be183d0-0ab6-4aee-9aeb-233833e7b9ee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.163845 Dec 15 12:46:15.618182 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 500/1006] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:15 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:15.977191 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-38e1ee2c-112c-42cd-95a2-47aebfc65e49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:15.978119 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-38e1ee2c-112c-42cd-95a2-47aebfc65e49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:15.983906 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-38e1ee2c-112c-42cd-95a2-47aebfc65e49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:15.984352 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-38e1ee2c-112c-42cd-95a2-47aebfc65e49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:15.985125 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-38e1ee2c-112c-42cd-95a2-47aebfc65e49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:15.985586 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-38e1ee2c-112c-42cd-95a2-47aebfc65e49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:16.016069 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-38e1ee2c-112c-42cd-95a2-47aebfc65e49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042579 Dec 15 12:46:16.016648 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 507/1007] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:15 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:16.527556 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-729a7da0-7895-43d6-941d-bd572fc1ae6d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:16.528473 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-729a7da0-7895-43d6-941d-bd572fc1ae6d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:16.536938 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-729a7da0-7895-43d6-941d-bd572fc1ae6d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:16.537616 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-729a7da0-7895-43d6-941d-bd572fc1ae6d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:16.538767 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-729a7da0-7895-43d6-941d-bd572fc1ae6d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:16.539681 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-729a7da0-7895-43d6-941d-bd572fc1ae6d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:16.569960 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-729a7da0-7895-43d6-941d-bd572fc1ae6d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045972 Dec 15 12:46:16.570440 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 501/1008] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:16 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:16.636006 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8050b6cb-a11a-4ccb-8e54-9e294ee29517 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:16.639284 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8050b6cb-a11a-4ccb-8e54-9e294ee29517 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:16.646417 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8050b6cb-a11a-4ccb-8e54-9e294ee29517 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:16.646875 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8050b6cb-a11a-4ccb-8e54-9e294ee29517 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:16.647686 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8050b6cb-a11a-4ccb-8e54-9e294ee29517 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:16.648144 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8050b6cb-a11a-4ccb-8e54-9e294ee29517 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:16.781046 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-8050b6cb-a11a-4ccb-8e54-9e294ee29517 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:16.789284 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-8050b6cb-a11a-4ccb-8e54-9e294ee29517 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:16.790795 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-8050b6cb-a11a-4ccb-8e54-9e294ee29517 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:16.791935 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8050b6cb-a11a-4ccb-8e54-9e294ee29517 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.159594 Dec 15 12:46:16.792487 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 508/1009] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:16 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:17.027776 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4e788668-9c61-4ab0-85ce-55e138af0ba1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:17.028672 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4e788668-9c61-4ab0-85ce-55e138af0ba1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:17.035444 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e788668-9c61-4ab0-85ce-55e138af0ba1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:17.035887 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e788668-9c61-4ab0-85ce-55e138af0ba1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:17.036657 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e788668-9c61-4ab0-85ce-55e138af0ba1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:17.037102 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e788668-9c61-4ab0-85ce-55e138af0ba1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:17.067668 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4e788668-9c61-4ab0-85ce-55e138af0ba1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043553 Dec 15 12:46:17.068232 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 502/1010] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:17 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:17.582976 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bccbb5dd-f3a6-4301-aefa-53f6d9f5fc2b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:17.583920 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bccbb5dd-f3a6-4301-aefa-53f6d9f5fc2b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:17.590102 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bccbb5dd-f3a6-4301-aefa-53f6d9f5fc2b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:17.590554 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bccbb5dd-f3a6-4301-aefa-53f6d9f5fc2b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:17.591352 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bccbb5dd-f3a6-4301-aefa-53f6d9f5fc2b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:17.591791 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bccbb5dd-f3a6-4301-aefa-53f6d9f5fc2b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:17.641593 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bccbb5dd-f3a6-4301-aefa-53f6d9f5fc2b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063336 Dec 15 12:46:17.642776 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 509/1011] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:17 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:17.810970 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a460c4a5-5cd5-44cd-a665-d51ef88d0c3a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:17.811580 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a460c4a5-5cd5-44cd-a665-d51ef88d0c3a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:17.818408 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a460c4a5-5cd5-44cd-a665-d51ef88d0c3a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:17.818854 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a460c4a5-5cd5-44cd-a665-d51ef88d0c3a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:17.819635 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a460c4a5-5cd5-44cd-a665-d51ef88d0c3a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:17.820077 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a460c4a5-5cd5-44cd-a665-d51ef88d0c3a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:17.975880 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a460c4a5-5cd5-44cd-a665-d51ef88d0c3a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:17.984405 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a460c4a5-5cd5-44cd-a665-d51ef88d0c3a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:17.985990 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a460c4a5-5cd5-44cd-a665-d51ef88d0c3a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:17.987270 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a460c4a5-5cd5-44cd-a665-d51ef88d0c3a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.180020 Dec 15 12:46:17.987838 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 503/1012] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:17 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:18.079054 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6db43e95-19e9-4ef1-8090-dc4fd0119c8e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:18.079980 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6db43e95-19e9-4ef1-8090-dc4fd0119c8e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:18.086240 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6db43e95-19e9-4ef1-8090-dc4fd0119c8e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:18.086685 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6db43e95-19e9-4ef1-8090-dc4fd0119c8e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:18.087464 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6db43e95-19e9-4ef1-8090-dc4fd0119c8e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:18.087892 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6db43e95-19e9-4ef1-8090-dc4fd0119c8e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:18.118414 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6db43e95-19e9-4ef1-8090-dc4fd0119c8e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043087 Dec 15 12:46:18.118980 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 510/1013] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:18 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:18.286807 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 12:46:18.287076 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 12:46:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 12:46:18.653921 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8186216e-44c8-4cc0-acee-8d32a07b0db2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:18.654844 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8186216e-44c8-4cc0-acee-8d32a07b0db2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:18.661751 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8186216e-44c8-4cc0-acee-8d32a07b0db2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:18.662209 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8186216e-44c8-4cc0-acee-8d32a07b0db2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:18.663004 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8186216e-44c8-4cc0-acee-8d32a07b0db2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:18.663438 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8186216e-44c8-4cc0-acee-8d32a07b0db2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:18.698484 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8186216e-44c8-4cc0-acee-8d32a07b0db2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048491 Dec 15 12:46:18.699036 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 504/1014] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:18 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:19.005981 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5a1dcd23-4bdb-448a-9c4a-bd1ecaf173f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:19.006594 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5a1dcd23-4bdb-448a-9c4a-bd1ecaf173f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:19.013388 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5a1dcd23-4bdb-448a-9c4a-bd1ecaf173f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:19.013871 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5a1dcd23-4bdb-448a-9c4a-bd1ecaf173f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:19.014832 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5a1dcd23-4bdb-448a-9c4a-bd1ecaf173f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:19.015262 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5a1dcd23-4bdb-448a-9c4a-bd1ecaf173f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:19.130168 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e3a13c73-911d-4db9-90cd-e1b4d827b6b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:19.131082 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e3a13c73-911d-4db9-90cd-e1b4d827b6b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:19.137411 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e3a13c73-911d-4db9-90cd-e1b4d827b6b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:19.137978 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e3a13c73-911d-4db9-90cd-e1b4d827b6b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:19.138713 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e3a13c73-911d-4db9-90cd-e1b4d827b6b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:19.139143 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e3a13c73-911d-4db9-90cd-e1b4d827b6b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:19.151522 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5a1dcd23-4bdb-448a-9c4a-bd1ecaf173f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:19.160157 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5a1dcd23-4bdb-448a-9c4a-bd1ecaf173f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:19.161704 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5a1dcd23-4bdb-448a-9c4a-bd1ecaf173f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:19.162867 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5a1dcd23-4bdb-448a-9c4a-bd1ecaf173f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.161023 Dec 15 12:46:19.163425 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 511/1015] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:19 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:19.169750 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e3a13c73-911d-4db9-90cd-e1b4d827b6b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044091 Dec 15 12:46:19.170294 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 505/1016] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:19 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:46:19.709220 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d3316353-ea41-45f3-ba69-6bf097b4e271 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:19.710157 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d3316353-ea41-45f3-ba69-6bf097b4e271 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:19.723394 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d3316353-ea41-45f3-ba69-6bf097b4e271 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:19.723837 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d3316353-ea41-45f3-ba69-6bf097b4e271 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:19.724622 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d3316353-ea41-45f3-ba69-6bf097b4e271 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:19.725048 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d3316353-ea41-45f3-ba69-6bf097b4e271 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:19.755540 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d3316353-ea41-45f3-ba69-6bf097b4e271 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050034 Dec 15 12:46:19.756098 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 512/1017] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:19 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:20.181595 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e5fb5c67-b706-437d-9154-247f73aa0988 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:20.182205 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-26dde168-d51d-4493-a43d-c439f231eb31 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:20.182613 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e5fb5c67-b706-437d-9154-247f73aa0988 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:20.182719 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-26dde168-d51d-4493-a43d-c439f231eb31 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:20.190310 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-26dde168-d51d-4493-a43d-c439f231eb31 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:20.190756 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-26dde168-d51d-4493-a43d-c439f231eb31 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:20.191769 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-26dde168-d51d-4493-a43d-c439f231eb31 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:20.191982 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-26dde168-d51d-4493-a43d-c439f231eb31 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:20.196677 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e5fb5c67-b706-437d-9154-247f73aa0988 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:20.197215 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e5fb5c67-b706-437d-9154-247f73aa0988 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:20.198042 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e5fb5c67-b706-437d-9154-247f73aa0988 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:20.198571 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e5fb5c67-b706-437d-9154-247f73aa0988 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:20.221731 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-26dde168-d51d-4493-a43d-c439f231eb31 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043646 Dec 15 12:46:20.222180 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 513/1018] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:20 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:20.332778 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e5fb5c67-b706-437d-9154-247f73aa0988 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:20.341344 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e5fb5c67-b706-437d-9154-247f73aa0988 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:20.342969 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e5fb5c67-b706-437d-9154-247f73aa0988 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:20.344141 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e5fb5c67-b706-437d-9154-247f73aa0988 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.166338 Dec 15 12:46:20.344721 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 506/1019] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:20 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:20.768043 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3831740b-1230-4f6d-b953-37e873e815a8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:20.768854 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3831740b-1230-4f6d-b953-37e873e815a8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:20.774844 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3831740b-1230-4f6d-b953-37e873e815a8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:20.775295 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3831740b-1230-4f6d-b953-37e873e815a8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:20.776081 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3831740b-1230-4f6d-b953-37e873e815a8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:20.776519 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3831740b-1230-4f6d-b953-37e873e815a8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:20.807604 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3831740b-1230-4f6d-b953-37e873e815a8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044464 Dec 15 12:46:20.808169 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 514/1020] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:20 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:21.232251 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-49e7a72e-0454-4860-83c1-7802377e66b3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:21.233187 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-49e7a72e-0454-4860-83c1-7802377e66b3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:21.240067 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-49e7a72e-0454-4860-83c1-7802377e66b3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:21.240505 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-49e7a72e-0454-4860-83c1-7802377e66b3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:21.241277 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-49e7a72e-0454-4860-83c1-7802377e66b3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:21.241740 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-49e7a72e-0454-4860-83c1-7802377e66b3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:21.270785 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-49e7a72e-0454-4860-83c1-7802377e66b3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042329 Dec 15 12:46:21.271338 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 507/1021] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:21 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:21.363988 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9b6b2332-bbf9-4a2e-ad18-04b37fc7573a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:21.364572 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9b6b2332-bbf9-4a2e-ad18-04b37fc7573a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:21.370831 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9b6b2332-bbf9-4a2e-ad18-04b37fc7573a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:21.371281 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9b6b2332-bbf9-4a2e-ad18-04b37fc7573a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:21.372058 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9b6b2332-bbf9-4a2e-ad18-04b37fc7573a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:21.372493 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9b6b2332-bbf9-4a2e-ad18-04b37fc7573a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:21.510661 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9b6b2332-bbf9-4a2e-ad18-04b37fc7573a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:21.518936 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9b6b2332-bbf9-4a2e-ad18-04b37fc7573a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:21.520441 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9b6b2332-bbf9-4a2e-ad18-04b37fc7573a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:21.521619 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9b6b2332-bbf9-4a2e-ad18-04b37fc7573a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.161918 Dec 15 12:46:21.522178 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 515/1022] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:21 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:21.819493 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-86f3fe84-c503-497c-8c80-a24cd7aee375 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:21.820314 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-86f3fe84-c503-497c-8c80-a24cd7aee375 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:21.826222 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-86f3fe84-c503-497c-8c80-a24cd7aee375 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:21.826670 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-86f3fe84-c503-497c-8c80-a24cd7aee375 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:21.827443 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-86f3fe84-c503-497c-8c80-a24cd7aee375 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:21.827874 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-86f3fe84-c503-497c-8c80-a24cd7aee375 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:21.858094 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-86f3fe84-c503-497c-8c80-a24cd7aee375 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042357 Dec 15 12:46:21.869525 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 508/1023] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:21 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:46:22.281352 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-88fff94a-f22a-455c-b8fe-408443e83eea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:22.282313 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-88fff94a-f22a-455c-b8fe-408443e83eea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:22.288476 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-88fff94a-f22a-455c-b8fe-408443e83eea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:22.288919 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-88fff94a-f22a-455c-b8fe-408443e83eea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:22.289723 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-88fff94a-f22a-455c-b8fe-408443e83eea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:22.290150 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-88fff94a-f22a-455c-b8fe-408443e83eea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:22.319823 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-88fff94a-f22a-455c-b8fe-408443e83eea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042119 Dec 15 12:46:22.320405 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 516/1024] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:22 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:22.539588 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-cbac856c-48e7-4ed1-93d9-dd9078d97475 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:22.540137 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-cbac856c-48e7-4ed1-93d9-dd9078d97475 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:22.546287 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cbac856c-48e7-4ed1-93d9-dd9078d97475 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:22.546723 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cbac856c-48e7-4ed1-93d9-dd9078d97475 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:22.547495 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cbac856c-48e7-4ed1-93d9-dd9078d97475 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:22.547926 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cbac856c-48e7-4ed1-93d9-dd9078d97475 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:22.683161 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-cbac856c-48e7-4ed1-93d9-dd9078d97475 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:22.692585 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-cbac856c-48e7-4ed1-93d9-dd9078d97475 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:22.694098 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-cbac856c-48e7-4ed1-93d9-dd9078d97475 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:22.695242 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cbac856c-48e7-4ed1-93d9-dd9078d97475 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.159421 Dec 15 12:46:22.695795 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 509/1025] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:22 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:22.870075 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-cec37373-b6cd-4d6c-b33f-23dec16c40d4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:22.870895 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-cec37373-b6cd-4d6c-b33f-23dec16c40d4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:22.877703 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cec37373-b6cd-4d6c-b33f-23dec16c40d4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:22.878128 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cec37373-b6cd-4d6c-b33f-23dec16c40d4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:22.878896 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cec37373-b6cd-4d6c-b33f-23dec16c40d4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:22.879318 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cec37373-b6cd-4d6c-b33f-23dec16c40d4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:22.913037 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-cec37373-b6cd-4d6c-b33f-23dec16c40d4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046754 Dec 15 12:46:22.914242 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 517/1026] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:22 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:23.332360 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-66b4b1b4-538c-4d39-a9fb-ac2154cac7a1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:23.333319 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-66b4b1b4-538c-4d39-a9fb-ac2154cac7a1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:23.339251 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66b4b1b4-538c-4d39-a9fb-ac2154cac7a1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:23.339701 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66b4b1b4-538c-4d39-a9fb-ac2154cac7a1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:23.340480 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66b4b1b4-538c-4d39-a9fb-ac2154cac7a1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:23.340918 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66b4b1b4-538c-4d39-a9fb-ac2154cac7a1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:23.371576 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-66b4b1b4-538c-4d39-a9fb-ac2154cac7a1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043653 Dec 15 12:46:23.372141 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 510/1027] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:23 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:23.713589 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-47f747e2-c0e8-421e-9f3a-f1f62e5c694c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:23.714184 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-47f747e2-c0e8-421e-9f3a-f1f62e5c694c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:23.719935 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-47f747e2-c0e8-421e-9f3a-f1f62e5c694c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:23.720374 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-47f747e2-c0e8-421e-9f3a-f1f62e5c694c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:23.721135 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-47f747e2-c0e8-421e-9f3a-f1f62e5c694c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:23.721585 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-47f747e2-c0e8-421e-9f3a-f1f62e5c694c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:23.855231 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-47f747e2-c0e8-421e-9f3a-f1f62e5c694c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:23.863685 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-47f747e2-c0e8-421e-9f3a-f1f62e5c694c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:23.865218 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-47f747e2-c0e8-421e-9f3a-f1f62e5c694c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:23.866415 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-47f747e2-c0e8-421e-9f3a-f1f62e5c694c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.156552 Dec 15 12:46:23.866975 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 518/1028] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:23 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:23.924182 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b8ab0a4f-3d74-4130-ad85-2c1735711d7a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:23.925073 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b8ab0a4f-3d74-4130-ad85-2c1735711d7a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:23.931308 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b8ab0a4f-3d74-4130-ad85-2c1735711d7a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:23.931749 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b8ab0a4f-3d74-4130-ad85-2c1735711d7a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:23.932511 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b8ab0a4f-3d74-4130-ad85-2c1735711d7a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:23.932986 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b8ab0a4f-3d74-4130-ad85-2c1735711d7a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:23.964462 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b8ab0a4f-3d74-4130-ad85-2c1735711d7a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044034 Dec 15 12:46:23.965023 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 511/1029] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:23 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:24.176398 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 12:46:24.176999 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 12:46:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 12:46:24.383019 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-dffeef9b-cb3a-45a8-b6e2-75ee0011f57b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:24.383941 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-dffeef9b-cb3a-45a8-b6e2-75ee0011f57b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:24.390398 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dffeef9b-cb3a-45a8-b6e2-75ee0011f57b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:24.390848 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dffeef9b-cb3a-45a8-b6e2-75ee0011f57b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:24.391628 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dffeef9b-cb3a-45a8-b6e2-75ee0011f57b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:24.392556 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dffeef9b-cb3a-45a8-b6e2-75ee0011f57b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:24.423554 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-dffeef9b-cb3a-45a8-b6e2-75ee0011f57b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044402 Dec 15 12:46:24.424220 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 519/1030] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:24 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:24.884487 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-adb2c17c-01dc-4978-856b-89c0cf913520 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:24.885113 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-adb2c17c-01dc-4978-856b-89c0cf913520 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:24.891118 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-adb2c17c-01dc-4978-856b-89c0cf913520 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:24.891568 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-adb2c17c-01dc-4978-856b-89c0cf913520 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:24.892429 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-adb2c17c-01dc-4978-856b-89c0cf913520 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:24.892889 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-adb2c17c-01dc-4978-856b-89c0cf913520 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:24.976229 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a4223858-fb08-4b2c-9c10-05f3bb8e4774 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:24.977470 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a4223858-fb08-4b2c-9c10-05f3bb8e4774 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:24.984277 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a4223858-fb08-4b2c-9c10-05f3bb8e4774 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:24.984730 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a4223858-fb08-4b2c-9c10-05f3bb8e4774 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:24.986120 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a4223858-fb08-4b2c-9c10-05f3bb8e4774 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:24.986583 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a4223858-fb08-4b2c-9c10-05f3bb8e4774 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:25.018259 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a4223858-fb08-4b2c-9c10-05f3bb8e4774 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045664 Dec 15 12:46:25.019145 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 520/1031] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:24 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:46:25.035400 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-adb2c17c-01dc-4978-856b-89c0cf913520 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:25.044537 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-adb2c17c-01dc-4978-856b-89c0cf913520 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:25.046053 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-adb2c17c-01dc-4978-856b-89c0cf913520 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:25.047200 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-adb2c17c-01dc-4978-856b-89c0cf913520 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.166630 Dec 15 12:46:25.047742 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 512/1032] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:24 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:25.434720 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6bd5313f-01d8-4fb7-8f64-e1598081d3f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:25.435691 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6bd5313f-01d8-4fb7-8f64-e1598081d3f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:25.443124 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6bd5313f-01d8-4fb7-8f64-e1598081d3f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:25.443574 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6bd5313f-01d8-4fb7-8f64-e1598081d3f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:25.444355 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6bd5313f-01d8-4fb7-8f64-e1598081d3f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:25.444790 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6bd5313f-01d8-4fb7-8f64-e1598081d3f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:25.477059 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6bd5313f-01d8-4fb7-8f64-e1598081d3f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046356 Dec 15 12:46:25.477750 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 521/1033] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:25 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:26.029727 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ecb9e297-f3fe-45f1-abbe-6c44c1ce1e99 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:26.030645 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ecb9e297-f3fe-45f1-abbe-6c44c1ce1e99 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:26.037553 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ecb9e297-f3fe-45f1-abbe-6c44c1ce1e99 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:26.038176 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ecb9e297-f3fe-45f1-abbe-6c44c1ce1e99 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:26.038777 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ecb9e297-f3fe-45f1-abbe-6c44c1ce1e99 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:26.039211 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ecb9e297-f3fe-45f1-abbe-6c44c1ce1e99 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:26.065797 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f37a0571-88a8-4d7e-ac35-1e2c15224284 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:26.066714 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f37a0571-88a8-4d7e-ac35-1e2c15224284 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:26.069413 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ecb9e297-f3fe-45f1-abbe-6c44c1ce1e99 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043476 Dec 15 12:46:26.073270 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 513/1034] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:26 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:26.073866 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f37a0571-88a8-4d7e-ac35-1e2c15224284 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:26.074530 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f37a0571-88a8-4d7e-ac35-1e2c15224284 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:26.075708 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f37a0571-88a8-4d7e-ac35-1e2c15224284 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:26.076332 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f37a0571-88a8-4d7e-ac35-1e2c15224284 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:26.213918 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f37a0571-88a8-4d7e-ac35-1e2c15224284 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:26.222845 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f37a0571-88a8-4d7e-ac35-1e2c15224284 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:26.224492 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f37a0571-88a8-4d7e-ac35-1e2c15224284 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:26.225681 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f37a0571-88a8-4d7e-ac35-1e2c15224284 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.163838 Dec 15 12:46:26.226244 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 522/1035] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:26 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:26.488639 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6b512f9f-67ab-4b46-96c1-cc3287027b3e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:26.489554 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6b512f9f-67ab-4b46-96c1-cc3287027b3e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:26.495437 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6b512f9f-67ab-4b46-96c1-cc3287027b3e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:26.495881 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6b512f9f-67ab-4b46-96c1-cc3287027b3e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:26.496714 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6b512f9f-67ab-4b46-96c1-cc3287027b3e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:26.497168 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6b512f9f-67ab-4b46-96c1-cc3287027b3e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:26.528980 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6b512f9f-67ab-4b46-96c1-cc3287027b3e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044167 Dec 15 12:46:26.529564 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 514/1036] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:26 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:27.081593 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-75f2039b-068f-4b8c-8246-d25e7bd73ec0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:27.082442 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-75f2039b-068f-4b8c-8246-d25e7bd73ec0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:27.088807 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-75f2039b-068f-4b8c-8246-d25e7bd73ec0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:27.089259 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-75f2039b-068f-4b8c-8246-d25e7bd73ec0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:27.090122 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-75f2039b-068f-4b8c-8246-d25e7bd73ec0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:27.090564 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-75f2039b-068f-4b8c-8246-d25e7bd73ec0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:27.120928 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-75f2039b-068f-4b8c-8246-d25e7bd73ec0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043642 Dec 15 12:46:27.121733 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 523/1037] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:27 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:27.244899 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-48de9acf-2ed1-4262-8aa0-d06773110d29 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:27.245531 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-48de9acf-2ed1-4262-8aa0-d06773110d29 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:27.253075 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-48de9acf-2ed1-4262-8aa0-d06773110d29 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:27.253546 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-48de9acf-2ed1-4262-8aa0-d06773110d29 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:27.254351 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-48de9acf-2ed1-4262-8aa0-d06773110d29 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:27.255041 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-48de9acf-2ed1-4262-8aa0-d06773110d29 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:27.396075 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-48de9acf-2ed1-4262-8aa0-d06773110d29 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:27.404580 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-48de9acf-2ed1-4262-8aa0-d06773110d29 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:27.406104 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-48de9acf-2ed1-4262-8aa0-d06773110d29 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:27.407253 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-48de9acf-2ed1-4262-8aa0-d06773110d29 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.166144 Dec 15 12:46:27.408492 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 515/1038] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:27 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:27.540162 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1f8d0ea0-1bbd-48bd-a1db-0e843c50ab4b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:27.541083 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1f8d0ea0-1bbd-48bd-a1db-0e843c50ab4b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:27.547240 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1f8d0ea0-1bbd-48bd-a1db-0e843c50ab4b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:27.547678 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1f8d0ea0-1bbd-48bd-a1db-0e843c50ab4b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:27.548581 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1f8d0ea0-1bbd-48bd-a1db-0e843c50ab4b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:27.549023 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1f8d0ea0-1bbd-48bd-a1db-0e843c50ab4b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:27.581682 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1f8d0ea0-1bbd-48bd-a1db-0e843c50ab4b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045187 Dec 15 12:46:27.582770 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 524/1039] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:27 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:28.132361 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-52c3e1cd-98d8-4955-8316-6ab68a1ef8ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:28.133301 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-52c3e1cd-98d8-4955-8316-6ab68a1ef8ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:28.139230 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-52c3e1cd-98d8-4955-8316-6ab68a1ef8ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:28.139681 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-52c3e1cd-98d8-4955-8316-6ab68a1ef8ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:28.140461 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-52c3e1cd-98d8-4955-8316-6ab68a1ef8ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:28.140891 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-52c3e1cd-98d8-4955-8316-6ab68a1ef8ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:28.171766 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-52c3e1cd-98d8-4955-8316-6ab68a1ef8ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043353 Dec 15 12:46:28.172329 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 516/1040] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:28 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:28.426676 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a11d73fe-24ee-4301-b6bb-f7ca7dc4b926 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:28.427238 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a11d73fe-24ee-4301-b6bb-f7ca7dc4b926 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:28.433589 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a11d73fe-24ee-4301-b6bb-f7ca7dc4b926 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:28.434049 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a11d73fe-24ee-4301-b6bb-f7ca7dc4b926 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:28.434854 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a11d73fe-24ee-4301-b6bb-f7ca7dc4b926 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:28.435288 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a11d73fe-24ee-4301-b6bb-f7ca7dc4b926 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:28.567566 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a11d73fe-24ee-4301-b6bb-f7ca7dc4b926 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:28.575825 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a11d73fe-24ee-4301-b6bb-f7ca7dc4b926 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:28.577328 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a11d73fe-24ee-4301-b6bb-f7ca7dc4b926 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:28.578504 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a11d73fe-24ee-4301-b6bb-f7ca7dc4b926 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.156305 Dec 15 12:46:28.579049 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 525/1041] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:28 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:28.594136 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6443b4e1-bdb8-4252-b36e-19a162204b49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:28.596615 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6443b4e1-bdb8-4252-b36e-19a162204b49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:28.603749 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6443b4e1-bdb8-4252-b36e-19a162204b49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:28.604198 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6443b4e1-bdb8-4252-b36e-19a162204b49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:28.604989 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6443b4e1-bdb8-4252-b36e-19a162204b49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:28.605425 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6443b4e1-bdb8-4252-b36e-19a162204b49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:28.633904 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6443b4e1-bdb8-4252-b36e-19a162204b49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045611 Dec 15 12:46:28.634467 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 517/1042] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:28 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:29.185631 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1dfc6afa-7f8a-41cc-8761-ee0f295a78b3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:29.186575 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1dfc6afa-7f8a-41cc-8761-ee0f295a78b3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:29.193060 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1dfc6afa-7f8a-41cc-8761-ee0f295a78b3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:29.193533 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1dfc6afa-7f8a-41cc-8761-ee0f295a78b3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:29.194330 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1dfc6afa-7f8a-41cc-8761-ee0f295a78b3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:29.194767 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1dfc6afa-7f8a-41cc-8761-ee0f295a78b3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:29.225548 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1dfc6afa-7f8a-41cc-8761-ee0f295a78b3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043628 Dec 15 12:46:29.226123 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 526/1043] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:29 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:29.597522 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6d8d3d1f-e64e-4a58-a05c-034a51a77eff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:29.598144 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6d8d3d1f-e64e-4a58-a05c-034a51a77eff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:29.604457 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d8d3d1f-e64e-4a58-a05c-034a51a77eff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:29.604915 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d8d3d1f-e64e-4a58-a05c-034a51a77eff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:29.605720 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d8d3d1f-e64e-4a58-a05c-034a51a77eff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:29.606162 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d8d3d1f-e64e-4a58-a05c-034a51a77eff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:29.645896 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-43690021-c553-43d6-b7ed-9c191d08176a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:29.646807 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-43690021-c553-43d6-b7ed-9c191d08176a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:29.653150 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-43690021-c553-43d6-b7ed-9c191d08176a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:29.653646 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-43690021-c553-43d6-b7ed-9c191d08176a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:29.654503 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-43690021-c553-43d6-b7ed-9c191d08176a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:29.654951 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-43690021-c553-43d6-b7ed-9c191d08176a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:29.686938 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-43690021-c553-43d6-b7ed-9c191d08176a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044766 Dec 15 12:46:29.687780 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 527/1044] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:29 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:46:29.746316 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6d8d3d1f-e64e-4a58-a05c-034a51a77eff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:29.755293 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6d8d3d1f-e64e-4a58-a05c-034a51a77eff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:29.756788 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6d8d3d1f-e64e-4a58-a05c-034a51a77eff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:29.757963 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6d8d3d1f-e64e-4a58-a05c-034a51a77eff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.164353 Dec 15 12:46:29.758518 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 518/1045] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:29 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:30.237297 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fde6ef80-c340-4c73-b23a-8a1913e096a7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:30.238255 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fde6ef80-c340-4c73-b23a-8a1913e096a7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:30.244089 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fde6ef80-c340-4c73-b23a-8a1913e096a7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:30.244536 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fde6ef80-c340-4c73-b23a-8a1913e096a7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:30.245320 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fde6ef80-c340-4c73-b23a-8a1913e096a7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:30.245783 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fde6ef80-c340-4c73-b23a-8a1913e096a7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:30.278889 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fde6ef80-c340-4c73-b23a-8a1913e096a7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045291 Dec 15 12:46:30.279443 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 528/1046] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:30 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:30.700186 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f8caa8b2-278b-45ba-9070-07cb6a090f4e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:30.701135 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f8caa8b2-278b-45ba-9070-07cb6a090f4e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:30.708094 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f8caa8b2-278b-45ba-9070-07cb6a090f4e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:30.708539 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f8caa8b2-278b-45ba-9070-07cb6a090f4e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:30.709323 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f8caa8b2-278b-45ba-9070-07cb6a090f4e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:30.709773 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f8caa8b2-278b-45ba-9070-07cb6a090f4e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:30.739538 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f8caa8b2-278b-45ba-9070-07cb6a090f4e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043042 Dec 15 12:46:30.740101 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 519/1047] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:30 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:30.775469 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0256bb1e-eaff-48e3-b7be-450eb182195f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:30.776081 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0256bb1e-eaff-48e3-b7be-450eb182195f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:30.783627 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0256bb1e-eaff-48e3-b7be-450eb182195f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:30.784074 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0256bb1e-eaff-48e3-b7be-450eb182195f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:30.784874 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0256bb1e-eaff-48e3-b7be-450eb182195f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:30.785316 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0256bb1e-eaff-48e3-b7be-450eb182195f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:30.917925 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0256bb1e-eaff-48e3-b7be-450eb182195f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:30.926884 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0256bb1e-eaff-48e3-b7be-450eb182195f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:30.928391 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0256bb1e-eaff-48e3-b7be-450eb182195f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:30.929586 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0256bb1e-eaff-48e3-b7be-450eb182195f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.157789 Dec 15 12:46:30.930133 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 529/1048] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:30 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:46:31.291424 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7f9a35c0-75e3-4cf3-89d3-3c83215ecc19 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:31.292239 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7f9a35c0-75e3-4cf3-89d3-3c83215ecc19 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:31.298721 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7f9a35c0-75e3-4cf3-89d3-3c83215ecc19 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:31.299165 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7f9a35c0-75e3-4cf3-89d3-3c83215ecc19 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:31.300081 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7f9a35c0-75e3-4cf3-89d3-3c83215ecc19 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:31.300378 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7f9a35c0-75e3-4cf3-89d3-3c83215ecc19 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:31.331183 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7f9a35c0-75e3-4cf3-89d3-3c83215ecc19 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043638 Dec 15 12:46:31.331748 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 520/1049] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:31 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:31.751869 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e1d1aeea-8dcb-46ec-927b-64727f819ad7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:31.752818 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e1d1aeea-8dcb-46ec-927b-64727f819ad7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:31.759072 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e1d1aeea-8dcb-46ec-927b-64727f819ad7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:31.759512 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e1d1aeea-8dcb-46ec-927b-64727f819ad7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:31.760342 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e1d1aeea-8dcb-46ec-927b-64727f819ad7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:31.760741 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e1d1aeea-8dcb-46ec-927b-64727f819ad7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:31.792654 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e1d1aeea-8dcb-46ec-927b-64727f819ad7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044737 Dec 15 12:46:31.793539 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 530/1050] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:31 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:31.947903 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2a7698cb-8cf5-4a33-a608-58f6b611217d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:31.948726 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2a7698cb-8cf5-4a33-a608-58f6b611217d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:31.955183 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2a7698cb-8cf5-4a33-a608-58f6b611217d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:31.955622 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2a7698cb-8cf5-4a33-a608-58f6b611217d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:31.956433 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2a7698cb-8cf5-4a33-a608-58f6b611217d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:31.956870 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2a7698cb-8cf5-4a33-a608-58f6b611217d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:32.110369 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2a7698cb-8cf5-4a33-a608-58f6b611217d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:32.119102 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2a7698cb-8cf5-4a33-a608-58f6b611217d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:32.120577 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2a7698cb-8cf5-4a33-a608-58f6b611217d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:32.121920 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2a7698cb-8cf5-4a33-a608-58f6b611217d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.177486 Dec 15 12:46:32.122455 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 521/1051] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:31 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:32.342790 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-59824972-47ad-4498-93b4-a86122f158ff tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:32.343720 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-59824972-47ad-4498-93b4-a86122f158ff tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:32.350353 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-59824972-47ad-4498-93b4-a86122f158ff tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:32.350801 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-59824972-47ad-4498-93b4-a86122f158ff tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:32.351604 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-59824972-47ad-4498-93b4-a86122f158ff tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:32.352042 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-59824972-47ad-4498-93b4-a86122f158ff tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:32.382169 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-59824972-47ad-4498-93b4-a86122f158ff tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043155 Dec 15 12:46:32.382743 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 531/1052] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:32 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:32.804350 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-72892d91-a122-4311-b944-398d1b7f4552 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:32.805294 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-72892d91-a122-4311-b944-398d1b7f4552 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:32.811540 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-72892d91-a122-4311-b944-398d1b7f4552 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:32.812170 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-72892d91-a122-4311-b944-398d1b7f4552 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:32.812799 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-72892d91-a122-4311-b944-398d1b7f4552 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:32.813223 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-72892d91-a122-4311-b944-398d1b7f4552 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:32.842729 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-72892d91-a122-4311-b944-398d1b7f4552 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042065 Dec 15 12:46:32.843288 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 522/1053] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:32 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:33.140359 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d743fd6b-949e-49df-a823-9438d5aaf75b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:33.140966 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d743fd6b-949e-49df-a823-9438d5aaf75b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:33.147669 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d743fd6b-949e-49df-a823-9438d5aaf75b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:33.148122 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d743fd6b-949e-49df-a823-9438d5aaf75b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:33.148913 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d743fd6b-949e-49df-a823-9438d5aaf75b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:33.149350 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d743fd6b-949e-49df-a823-9438d5aaf75b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:33.286112 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d743fd6b-949e-49df-a823-9438d5aaf75b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:33.294449 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d743fd6b-949e-49df-a823-9438d5aaf75b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:33.295975 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d743fd6b-949e-49df-a823-9438d5aaf75b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:33.297163 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d743fd6b-949e-49df-a823-9438d5aaf75b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.160506 Dec 15 12:46:33.298456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 532/1054] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:33 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:33.393870 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9ba2a075-238a-4f7b-9c88-c8ca86ff7732 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:33.394684 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9ba2a075-238a-4f7b-9c88-c8ca86ff7732 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:33.401239 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9ba2a075-238a-4f7b-9c88-c8ca86ff7732 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:33.401732 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9ba2a075-238a-4f7b-9c88-c8ca86ff7732 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:33.402518 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9ba2a075-238a-4f7b-9c88-c8ca86ff7732 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:33.402945 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9ba2a075-238a-4f7b-9c88-c8ca86ff7732 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:33.434546 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9ba2a075-238a-4f7b-9c88-c8ca86ff7732 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044491 Dec 15 12:46:33.435142 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 523/1055] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:33 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:33.854731 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-46afcbe6-be7e-4be6-b24f-c51be027ba75 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:33.855544 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-46afcbe6-be7e-4be6-b24f-c51be027ba75 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:33.861475 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-46afcbe6-be7e-4be6-b24f-c51be027ba75 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:33.861942 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-46afcbe6-be7e-4be6-b24f-c51be027ba75 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:33.862707 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-46afcbe6-be7e-4be6-b24f-c51be027ba75 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:33.863133 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-46afcbe6-be7e-4be6-b24f-c51be027ba75 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:33.893432 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-46afcbe6-be7e-4be6-b24f-c51be027ba75 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042554 Dec 15 12:46:33.894003 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 533/1056] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:33 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:34.316602 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ade4c9bd-decf-46f7-b89d-51201c9379a6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:34.317253 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ade4c9bd-decf-46f7-b89d-51201c9379a6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:34.325443 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ade4c9bd-decf-46f7-b89d-51201c9379a6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:34.326157 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ade4c9bd-decf-46f7-b89d-51201c9379a6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:34.327437 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ade4c9bd-decf-46f7-b89d-51201c9379a6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:34.327889 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ade4c9bd-decf-46f7-b89d-51201c9379a6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:34.445936 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a223bb95-6ebb-47f1-bc61-d1f7137ef049 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:34.446841 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a223bb95-6ebb-47f1-bc61-d1f7137ef049 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:34.453454 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a223bb95-6ebb-47f1-bc61-d1f7137ef049 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:34.453947 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a223bb95-6ebb-47f1-bc61-d1f7137ef049 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:34.455250 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a223bb95-6ebb-47f1-bc61-d1f7137ef049 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:34.455815 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a223bb95-6ebb-47f1-bc61-d1f7137ef049 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:34.459860 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ade4c9bd-decf-46f7-b89d-51201c9379a6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:34.468273 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ade4c9bd-decf-46f7-b89d-51201c9379a6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:34.469849 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ade4c9bd-decf-46f7-b89d-51201c9379a6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:34.471175 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ade4c9bd-decf-46f7-b89d-51201c9379a6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.158818 Dec 15 12:46:34.471723 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 524/1057] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:34 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:34.488476 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a223bb95-6ebb-47f1-bc61-d1f7137ef049 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046251 Dec 15 12:46:34.489054 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 534/1058] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:34 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:46:34.904446 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4a2203a2-5e48-49e5-9c8f-f9b49b2dbc15 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:34.905356 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4a2203a2-5e48-49e5-9c8f-f9b49b2dbc15 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:34.912054 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a2203a2-5e48-49e5-9c8f-f9b49b2dbc15 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:34.912502 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a2203a2-5e48-49e5-9c8f-f9b49b2dbc15 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:34.913283 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a2203a2-5e48-49e5-9c8f-f9b49b2dbc15 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:34.913746 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a2203a2-5e48-49e5-9c8f-f9b49b2dbc15 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:34.947896 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4a2203a2-5e48-49e5-9c8f-f9b49b2dbc15 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047140 Dec 15 12:46:34.948486 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 525/1059] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:34 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:35.489284 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-eea0e128-0fc9-4d8e-8a5f-15517e28f64f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:35.489917 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-eea0e128-0fc9-4d8e-8a5f-15517e28f64f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:35.496328 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eea0e128-0fc9-4d8e-8a5f-15517e28f64f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:35.496770 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eea0e128-0fc9-4d8e-8a5f-15517e28f64f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:35.497562 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eea0e128-0fc9-4d8e-8a5f-15517e28f64f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:35.497992 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eea0e128-0fc9-4d8e-8a5f-15517e28f64f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:35.499322 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1e3e0e98-a2af-4af1-9348-281a6a751b56 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:35.500237 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1e3e0e98-a2af-4af1-9348-281a6a751b56 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:35.507869 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1e3e0e98-a2af-4af1-9348-281a6a751b56 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:35.507869 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1e3e0e98-a2af-4af1-9348-281a6a751b56 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:35.508386 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1e3e0e98-a2af-4af1-9348-281a6a751b56 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:35.508787 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1e3e0e98-a2af-4af1-9348-281a6a751b56 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:35.542295 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1e3e0e98-a2af-4af1-9348-281a6a751b56 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046577 Dec 15 12:46:35.543056 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 526/1060] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:35 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:46:35.642188 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-eea0e128-0fc9-4d8e-8a5f-15517e28f64f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:35.650489 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-eea0e128-0fc9-4d8e-8a5f-15517e28f64f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:35.651893 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-eea0e128-0fc9-4d8e-8a5f-15517e28f64f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:35.653139 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-eea0e128-0fc9-4d8e-8a5f-15517e28f64f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.167471 Dec 15 12:46:35.653741 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 535/1061] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:35 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:46:35.959519 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-81bc88eb-1060-4b14-9b7b-0edf526f54d9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:35.960449 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-81bc88eb-1060-4b14-9b7b-0edf526f54d9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:35.967119 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-81bc88eb-1060-4b14-9b7b-0edf526f54d9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:35.967624 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-81bc88eb-1060-4b14-9b7b-0edf526f54d9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:35.968721 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-81bc88eb-1060-4b14-9b7b-0edf526f54d9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:35.968986 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-81bc88eb-1060-4b14-9b7b-0edf526f54d9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:36.000024 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-81bc88eb-1060-4b14-9b7b-0edf526f54d9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044321 Dec 15 12:46:36.000592 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 527/1062] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:35 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:36.554389 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-52e6c8fc-bb44-4c80-aa96-7e835936e31d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:36.555225 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-52e6c8fc-bb44-4c80-aa96-7e835936e31d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:36.570137 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-52e6c8fc-bb44-4c80-aa96-7e835936e31d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:36.570591 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-52e6c8fc-bb44-4c80-aa96-7e835936e31d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:36.571383 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-52e6c8fc-bb44-4c80-aa96-7e835936e31d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:36.571822 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-52e6c8fc-bb44-4c80-aa96-7e835936e31d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:36.605314 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-52e6c8fc-bb44-4c80-aa96-7e835936e31d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054789 Dec 15 12:46:36.605880 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 536/1063] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:36 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:36.671863 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2d17cd55-e99f-497a-acbc-0a6e71c1ea3f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:36.672449 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2d17cd55-e99f-497a-acbc-0a6e71c1ea3f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:36.679097 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2d17cd55-e99f-497a-acbc-0a6e71c1ea3f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:36.679567 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2d17cd55-e99f-497a-acbc-0a6e71c1ea3f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:36.680303 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2d17cd55-e99f-497a-acbc-0a6e71c1ea3f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:36.680726 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2d17cd55-e99f-497a-acbc-0a6e71c1ea3f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:36.820225 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2d17cd55-e99f-497a-acbc-0a6e71c1ea3f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:36.836350 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2d17cd55-e99f-497a-acbc-0a6e71c1ea3f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:36.837882 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2d17cd55-e99f-497a-acbc-0a6e71c1ea3f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:36.839048 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2d17cd55-e99f-497a-acbc-0a6e71c1ea3f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.170921 Dec 15 12:46:36.839602 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 528/1064] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:36 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:37.011340 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3959c1dd-8e52-4fe6-aab8-5b063cb7e3b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:37.012267 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3959c1dd-8e52-4fe6-aab8-5b063cb7e3b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:37.018124 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3959c1dd-8e52-4fe6-aab8-5b063cb7e3b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:37.018551 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3959c1dd-8e52-4fe6-aab8-5b063cb7e3b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:37.019319 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3959c1dd-8e52-4fe6-aab8-5b063cb7e3b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:37.019745 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3959c1dd-8e52-4fe6-aab8-5b063cb7e3b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:37.049782 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3959c1dd-8e52-4fe6-aab8-5b063cb7e3b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042100 Dec 15 12:46:37.050338 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 537/1065] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:37 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:37.618390 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-266291e6-ad56-48a9-8c2e-974d1dc8d3e1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:37.619291 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-266291e6-ad56-48a9-8c2e-974d1dc8d3e1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:37.625029 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-266291e6-ad56-48a9-8c2e-974d1dc8d3e1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:37.625466 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-266291e6-ad56-48a9-8c2e-974d1dc8d3e1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:37.626378 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-266291e6-ad56-48a9-8c2e-974d1dc8d3e1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:37.627397 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-266291e6-ad56-48a9-8c2e-974d1dc8d3e1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:37.658336 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-266291e6-ad56-48a9-8c2e-974d1dc8d3e1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044191 Dec 15 12:46:37.659294 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 529/1066] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:37 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:37.857363 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-de8add8c-dce8-4f0d-b147-1931ee358cc0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:37.857923 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-de8add8c-dce8-4f0d-b147-1931ee358cc0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:37.865221 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-de8add8c-dce8-4f0d-b147-1931ee358cc0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:37.865733 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-de8add8c-dce8-4f0d-b147-1931ee358cc0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:37.866541 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-de8add8c-dce8-4f0d-b147-1931ee358cc0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:37.866971 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-de8add8c-dce8-4f0d-b147-1931ee358cc0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:38.002929 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-de8add8c-dce8-4f0d-b147-1931ee358cc0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:38.011967 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-de8add8c-dce8-4f0d-b147-1931ee358cc0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:38.013458 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-de8add8c-dce8-4f0d-b147-1931ee358cc0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:38.014622 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-de8add8c-dce8-4f0d-b147-1931ee358cc0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.161105 Dec 15 12:46:38.015272 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 538/1067] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:37 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:38.060391 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4e04b7f9-62a0-4d12-a52d-a0a63967219d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:38.061304 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4e04b7f9-62a0-4d12-a52d-a0a63967219d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:38.067583 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e04b7f9-62a0-4d12-a52d-a0a63967219d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:38.068028 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e04b7f9-62a0-4d12-a52d-a0a63967219d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:38.068804 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e04b7f9-62a0-4d12-a52d-a0a63967219d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:38.069238 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e04b7f9-62a0-4d12-a52d-a0a63967219d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:38.099373 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4e04b7f9-62a0-4d12-a52d-a0a63967219d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042641 Dec 15 12:46:38.099940 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 530/1068] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:38 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:38.669399 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-677071c8-62c6-442a-b195-ef84c9970aee tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:38.670337 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-677071c8-62c6-442a-b195-ef84c9970aee tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:38.676431 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-677071c8-62c6-442a-b195-ef84c9970aee tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:38.676736 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-677071c8-62c6-442a-b195-ef84c9970aee tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:38.677538 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-677071c8-62c6-442a-b195-ef84c9970aee tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:38.677973 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-677071c8-62c6-442a-b195-ef84c9970aee tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:38.709687 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-677071c8-62c6-442a-b195-ef84c9970aee tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043915 Dec 15 12:46:38.710212 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 539/1069] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:38 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:39.032203 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0f5d7ca6-a2f8-4287-bcd9-62cad1fb0afe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:39.032923 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0f5d7ca6-a2f8-4287-bcd9-62cad1fb0afe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:39.039400 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0f5d7ca6-a2f8-4287-bcd9-62cad1fb0afe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:39.039913 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0f5d7ca6-a2f8-4287-bcd9-62cad1fb0afe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:39.040873 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0f5d7ca6-a2f8-4287-bcd9-62cad1fb0afe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:39.041315 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0f5d7ca6-a2f8-4287-bcd9-62cad1fb0afe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:39.111070 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e95f468a-1b4f-4833-94ab-003599156697 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:39.112142 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e95f468a-1b4f-4833-94ab-003599156697 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:39.118888 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e95f468a-1b4f-4833-94ab-003599156697 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:39.119229 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e95f468a-1b4f-4833-94ab-003599156697 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:39.120057 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e95f468a-1b4f-4833-94ab-003599156697 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:39.120492 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e95f468a-1b4f-4833-94ab-003599156697 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:39.151790 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e95f468a-1b4f-4833-94ab-003599156697 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045011 Dec 15 12:46:39.152542 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 540/1070] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:39 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:46:39.173632 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0f5d7ca6-a2f8-4287-bcd9-62cad1fb0afe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:39.183419 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0f5d7ca6-a2f8-4287-bcd9-62cad1fb0afe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:39.184905 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0f5d7ca6-a2f8-4287-bcd9-62cad1fb0afe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:39.186088 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0f5d7ca6-a2f8-4287-bcd9-62cad1fb0afe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.157748 Dec 15 12:46:39.186637 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 531/1071] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:39 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:39.720568 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-cdd6e2ed-d7b9-428a-807b-5fbec17f7d0b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:39.721487 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-cdd6e2ed-d7b9-428a-807b-5fbec17f7d0b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:39.727229 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cdd6e2ed-d7b9-428a-807b-5fbec17f7d0b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:39.727688 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cdd6e2ed-d7b9-428a-807b-5fbec17f7d0b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:39.728474 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cdd6e2ed-d7b9-428a-807b-5fbec17f7d0b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:39.728913 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cdd6e2ed-d7b9-428a-807b-5fbec17f7d0b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:39.768221 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-cdd6e2ed-d7b9-428a-807b-5fbec17f7d0b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051890 Dec 15 12:46:39.768895 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 541/1072] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:39 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:40.164359 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0ea87186-0877-416e-84b6-dc7689085161 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:40.165284 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0ea87186-0877-416e-84b6-dc7689085161 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:40.171846 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0ea87186-0877-416e-84b6-dc7689085161 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:40.172297 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0ea87186-0877-416e-84b6-dc7689085161 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:40.173124 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0ea87186-0877-416e-84b6-dc7689085161 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:40.173624 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0ea87186-0877-416e-84b6-dc7689085161 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:40.204543 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-57cc9595-54ea-4e76-846e-54540245b1cc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:40.205186 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-57cc9595-54ea-4e76-846e-54540245b1cc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:40.206264 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0ea87186-0877-416e-84b6-dc7689085161 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045698 Dec 15 12:46:40.206983 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 532/1073] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:40 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:40.211581 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-57cc9595-54ea-4e76-846e-54540245b1cc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:40.212024 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-57cc9595-54ea-4e76-846e-54540245b1cc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:40.212948 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-57cc9595-54ea-4e76-846e-54540245b1cc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:40.213384 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-57cc9595-54ea-4e76-846e-54540245b1cc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:40.354077 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-57cc9595-54ea-4e76-846e-54540245b1cc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:40.363152 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-57cc9595-54ea-4e76-846e-54540245b1cc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:40.364689 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-57cc9595-54ea-4e76-846e-54540245b1cc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:40.365939 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-57cc9595-54ea-4e76-846e-54540245b1cc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.165577 Dec 15 12:46:40.366502 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 542/1074] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:40 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:46:40.779818 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-cb374ebf-ed12-40f8-8cf2-7797f7711d51 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:40.780726 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-cb374ebf-ed12-40f8-8cf2-7797f7711d51 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:40.786633 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cb374ebf-ed12-40f8-8cf2-7797f7711d51 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:40.787070 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cb374ebf-ed12-40f8-8cf2-7797f7711d51 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:40.787851 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cb374ebf-ed12-40f8-8cf2-7797f7711d51 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:40.788315 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cb374ebf-ed12-40f8-8cf2-7797f7711d51 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:40.822187 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cb374ebf-ed12-40f8-8cf2-7797f7711d51 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046121 Dec 15 12:46:40.822756 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 533/1075] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:40 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:41.217893 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a4aac337-d169-4ef0-beb2-99f631631cfe tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:41.218791 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a4aac337-d169-4ef0-beb2-99f631631cfe tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:41.225606 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a4aac337-d169-4ef0-beb2-99f631631cfe tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:41.226045 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a4aac337-d169-4ef0-beb2-99f631631cfe tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:41.226807 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a4aac337-d169-4ef0-beb2-99f631631cfe tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:41.227233 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a4aac337-d169-4ef0-beb2-99f631631cfe tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:41.256849 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a4aac337-d169-4ef0-beb2-99f631631cfe tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042632 Dec 15 12:46:41.257439 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 543/1076] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:41 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:41.384186 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7f6d0c85-6fe7-4994-aa66-f67dc0497dd0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:41.384794 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7f6d0c85-6fe7-4994-aa66-f67dc0497dd0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:41.391132 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7f6d0c85-6fe7-4994-aa66-f67dc0497dd0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:41.392264 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7f6d0c85-6fe7-4994-aa66-f67dc0497dd0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:41.393094 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7f6d0c85-6fe7-4994-aa66-f67dc0497dd0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:41.393550 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7f6d0c85-6fe7-4994-aa66-f67dc0497dd0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:41.529710 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7f6d0c85-6fe7-4994-aa66-f67dc0497dd0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:41.538630 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7f6d0c85-6fe7-4994-aa66-f67dc0497dd0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:41.540119 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7f6d0c85-6fe7-4994-aa66-f67dc0497dd0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:41.541267 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7f6d0c85-6fe7-4994-aa66-f67dc0497dd0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.161058 Dec 15 12:46:41.541857 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 534/1077] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:41 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:41.834761 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6d2f5726-3152-4be0-8d9d-0347cbfb3b3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:41.835541 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6d2f5726-3152-4be0-8d9d-0347cbfb3b3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:41.841982 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6d2f5726-3152-4be0-8d9d-0347cbfb3b3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:41.842428 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6d2f5726-3152-4be0-8d9d-0347cbfb3b3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:41.843212 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6d2f5726-3152-4be0-8d9d-0347cbfb3b3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:41.843641 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6d2f5726-3152-4be0-8d9d-0347cbfb3b3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:41.873087 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6d2f5726-3152-4be0-8d9d-0347cbfb3b3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042447 Dec 15 12:46:41.873665 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 544/1078] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:41 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:42.270673 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-da67adbd-020c-4dd3-a92a-428a562e3371 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:42.271934 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-da67adbd-020c-4dd3-a92a-428a562e3371 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:42.278585 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-da67adbd-020c-4dd3-a92a-428a562e3371 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:42.279035 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-da67adbd-020c-4dd3-a92a-428a562e3371 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:42.279817 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-da67adbd-020c-4dd3-a92a-428a562e3371 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:42.280257 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-da67adbd-020c-4dd3-a92a-428a562e3371 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:42.311667 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-da67adbd-020c-4dd3-a92a-428a562e3371 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046906 Dec 15 12:46:42.312440 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 535/1079] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:42 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:42.562518 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ad0a953b-49d1-44cd-95f1-6bac6cae8716 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:42.563998 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ad0a953b-49d1-44cd-95f1-6bac6cae8716 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:42.573342 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ad0a953b-49d1-44cd-95f1-6bac6cae8716 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:42.574059 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ad0a953b-49d1-44cd-95f1-6bac6cae8716 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:42.575282 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ad0a953b-49d1-44cd-95f1-6bac6cae8716 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:42.575955 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ad0a953b-49d1-44cd-95f1-6bac6cae8716 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:42.721560 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ad0a953b-49d1-44cd-95f1-6bac6cae8716 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:42.730011 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ad0a953b-49d1-44cd-95f1-6bac6cae8716 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:42.731642 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ad0a953b-49d1-44cd-95f1-6bac6cae8716 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:42.732855 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ad0a953b-49d1-44cd-95f1-6bac6cae8716 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.176693 Dec 15 12:46:42.733411 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 545/1080] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:42 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:42.884565 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-de21d4ae-2c23-4344-8bb7-517d4dcb673b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:42.885212 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-de21d4ae-2c23-4344-8bb7-517d4dcb673b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:42.891087 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-de21d4ae-2c23-4344-8bb7-517d4dcb673b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:42.891527 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-de21d4ae-2c23-4344-8bb7-517d4dcb673b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:42.892307 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-de21d4ae-2c23-4344-8bb7-517d4dcb673b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:42.892735 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-de21d4ae-2c23-4344-8bb7-517d4dcb673b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:42.924737 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-de21d4ae-2c23-4344-8bb7-517d4dcb673b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043848 Dec 15 12:46:42.925257 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 536/1081] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:42 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:43.323904 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d73667fb-36a7-42bf-9edb-6716912b3aae tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:43.324815 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d73667fb-36a7-42bf-9edb-6716912b3aae tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:43.331553 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d73667fb-36a7-42bf-9edb-6716912b3aae tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:43.332001 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d73667fb-36a7-42bf-9edb-6716912b3aae tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:43.332781 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d73667fb-36a7-42bf-9edb-6716912b3aae tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:43.333220 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d73667fb-36a7-42bf-9edb-6716912b3aae tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:43.362834 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d73667fb-36a7-42bf-9edb-6716912b3aae tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042639 Dec 15 12:46:43.363448 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 546/1082] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:43 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:43.751985 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-cb9f1772-be55-4b3b-a871-3a8a4624d8fc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:43.752606 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-cb9f1772-be55-4b3b-a871-3a8a4624d8fc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:43.759343 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cb9f1772-be55-4b3b-a871-3a8a4624d8fc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:43.759785 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cb9f1772-be55-4b3b-a871-3a8a4624d8fc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:43.760571 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cb9f1772-be55-4b3b-a871-3a8a4624d8fc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:43.760995 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cb9f1772-be55-4b3b-a871-3a8a4624d8fc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:43.895386 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-cb9f1772-be55-4b3b-a871-3a8a4624d8fc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:43.903581 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-cb9f1772-be55-4b3b-a871-3a8a4624d8fc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:43.905068 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-cb9f1772-be55-4b3b-a871-3a8a4624d8fc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:43.906251 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cb9f1772-be55-4b3b-a871-3a8a4624d8fc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.158778 Dec 15 12:46:43.906807 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 537/1083] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:43 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:43.936673 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b76d2305-05e9-4cd8-982a-2799caf6e268 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:43.938142 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b76d2305-05e9-4cd8-982a-2799caf6e268 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:43.945312 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b76d2305-05e9-4cd8-982a-2799caf6e268 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:43.945792 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b76d2305-05e9-4cd8-982a-2799caf6e268 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:43.946567 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b76d2305-05e9-4cd8-982a-2799caf6e268 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:43.946992 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b76d2305-05e9-4cd8-982a-2799caf6e268 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:43.978184 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b76d2305-05e9-4cd8-982a-2799caf6e268 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045872 Dec 15 12:46:43.978746 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 547/1084] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:43 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:44.374336 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c0a08cca-64ba-410f-9132-61478980d480 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:44.375281 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c0a08cca-64ba-410f-9132-61478980d480 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:44.382151 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c0a08cca-64ba-410f-9132-61478980d480 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:44.382601 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c0a08cca-64ba-410f-9132-61478980d480 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:44.383452 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c0a08cca-64ba-410f-9132-61478980d480 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:44.383890 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c0a08cca-64ba-410f-9132-61478980d480 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:44.414443 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c0a08cca-64ba-410f-9132-61478980d480 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043772 Dec 15 12:46:44.415004 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 538/1085] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:44 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:44.925762 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-564fd589-919e-49f9-99ee-1790e8cb1a84 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:44.926389 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-564fd589-919e-49f9-99ee-1790e8cb1a84 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:44.932224 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-564fd589-919e-49f9-99ee-1790e8cb1a84 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:44.932695 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-564fd589-919e-49f9-99ee-1790e8cb1a84 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:44.933482 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-564fd589-919e-49f9-99ee-1790e8cb1a84 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:44.933941 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-564fd589-919e-49f9-99ee-1790e8cb1a84 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:44.991686 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1b5c77ed-4b48-45d4-a978-94192f7643b0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:44.993429 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1b5c77ed-4b48-45d4-a978-94192f7643b0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:45.000404 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b5c77ed-4b48-45d4-a978-94192f7643b0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:45.001585 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b5c77ed-4b48-45d4-a978-94192f7643b0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:45.003642 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b5c77ed-4b48-45d4-a978-94192f7643b0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:45.004344 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b5c77ed-4b48-45d4-a978-94192f7643b0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:45.036645 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1b5c77ed-4b48-45d4-a978-94192f7643b0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050728 Dec 15 12:46:45.037217 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 539/1086] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:44 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:45.071786 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-564fd589-919e-49f9-99ee-1790e8cb1a84 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:45.080363 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-564fd589-919e-49f9-99ee-1790e8cb1a84 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:45.081935 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-564fd589-919e-49f9-99ee-1790e8cb1a84 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:45.083080 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-564fd589-919e-49f9-99ee-1790e8cb1a84 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.161860 Dec 15 12:46:45.083634 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 548/1087] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:44 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:45.426710 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7fc9e1b5-5f09-42ca-90f6-dd5a347283eb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:45.427663 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7fc9e1b5-5f09-42ca-90f6-dd5a347283eb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:45.433527 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7fc9e1b5-5f09-42ca-90f6-dd5a347283eb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:45.433975 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7fc9e1b5-5f09-42ca-90f6-dd5a347283eb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:45.434761 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7fc9e1b5-5f09-42ca-90f6-dd5a347283eb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:45.435197 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7fc9e1b5-5f09-42ca-90f6-dd5a347283eb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:45.463591 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7fc9e1b5-5f09-42ca-90f6-dd5a347283eb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041272 Dec 15 12:46:45.464144 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 540/1088] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:45 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:46.047180 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-335e293c-8170-462a-9d41-8ba3b46e18a7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:46.048099 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-335e293c-8170-462a-9d41-8ba3b46e18a7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:46.055137 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-335e293c-8170-462a-9d41-8ba3b46e18a7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:46.055581 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-335e293c-8170-462a-9d41-8ba3b46e18a7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:46.056364 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-335e293c-8170-462a-9d41-8ba3b46e18a7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:46.056792 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-335e293c-8170-462a-9d41-8ba3b46e18a7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:46.085864 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-335e293c-8170-462a-9d41-8ba3b46e18a7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042482 Dec 15 12:46:46.086516 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 549/1089] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:46 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:46.102098 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bd2ec376-490f-41ab-a5f6-97feac9bfac7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:46.102790 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bd2ec376-490f-41ab-a5f6-97feac9bfac7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:46.109384 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd2ec376-490f-41ab-a5f6-97feac9bfac7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:46.109865 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd2ec376-490f-41ab-a5f6-97feac9bfac7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:46.110652 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd2ec376-490f-41ab-a5f6-97feac9bfac7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:46.111201 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd2ec376-490f-41ab-a5f6-97feac9bfac7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:46.245871 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bd2ec376-490f-41ab-a5f6-97feac9bfac7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:46.255338 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bd2ec376-490f-41ab-a5f6-97feac9bfac7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:46.256909 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bd2ec376-490f-41ab-a5f6-97feac9bfac7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:46.258195 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bd2ec376-490f-41ab-a5f6-97feac9bfac7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.159748 Dec 15 12:46:46.258775 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 541/1090] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:46 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:46.475198 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ed2f534b-20a5-4f7c-a8c0-414e88efec20 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:46.476148 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ed2f534b-20a5-4f7c-a8c0-414e88efec20 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:46.482196 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ed2f534b-20a5-4f7c-a8c0-414e88efec20 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:46.482642 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ed2f534b-20a5-4f7c-a8c0-414e88efec20 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:46.483413 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ed2f534b-20a5-4f7c-a8c0-414e88efec20 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:46.483844 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ed2f534b-20a5-4f7c-a8c0-414e88efec20 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:46.514218 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ed2f534b-20a5-4f7c-a8c0-414e88efec20 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042654 Dec 15 12:46:46.514697 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 550/1091] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:46 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:47.097011 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1b6a9fff-4c87-4d2c-9946-1ca8f453d9ab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:47.098034 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1b6a9fff-4c87-4d2c-9946-1ca8f453d9ab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:47.103873 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b6a9fff-4c87-4d2c-9946-1ca8f453d9ab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:47.104468 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b6a9fff-4c87-4d2c-9946-1ca8f453d9ab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:47.105092 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b6a9fff-4c87-4d2c-9946-1ca8f453d9ab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:47.105537 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b6a9fff-4c87-4d2c-9946-1ca8f453d9ab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:47.135069 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1b6a9fff-4c87-4d2c-9946-1ca8f453d9ab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042594 Dec 15 12:46:47.135625 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 542/1092] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:47 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:47.277122 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3e06edaa-a5db-472a-9a86-b7cae5b84749 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:47.277746 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3e06edaa-a5db-472a-9a86-b7cae5b84749 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:47.284551 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3e06edaa-a5db-472a-9a86-b7cae5b84749 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:47.284998 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3e06edaa-a5db-472a-9a86-b7cae5b84749 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:47.285786 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3e06edaa-a5db-472a-9a86-b7cae5b84749 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:47.286210 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3e06edaa-a5db-472a-9a86-b7cae5b84749 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:47.431768 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3e06edaa-a5db-472a-9a86-b7cae5b84749 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:47.440062 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3e06edaa-a5db-472a-9a86-b7cae5b84749 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:47.441623 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3e06edaa-a5db-472a-9a86-b7cae5b84749 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:47.442781 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3e06edaa-a5db-472a-9a86-b7cae5b84749 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.169371 Dec 15 12:46:47.443452 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 551/1093] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:47 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:47.525284 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-691a3034-333f-42f4-8ba8-976b8d84b2f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:47.526250 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-691a3034-333f-42f4-8ba8-976b8d84b2f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:47.532069 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-691a3034-333f-42f4-8ba8-976b8d84b2f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:47.532514 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-691a3034-333f-42f4-8ba8-976b8d84b2f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:47.534118 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-691a3034-333f-42f4-8ba8-976b8d84b2f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:47.534564 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-691a3034-333f-42f4-8ba8-976b8d84b2f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:47.563479 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-691a3034-333f-42f4-8ba8-976b8d84b2f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041732 Dec 15 12:46:47.564228 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 543/1094] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:47 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:48.146892 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5c7cbbbf-7a4a-4369-9e5b-77154babdfde tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:48.147801 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5c7cbbbf-7a4a-4369-9e5b-77154babdfde tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:48.153867 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5c7cbbbf-7a4a-4369-9e5b-77154babdfde tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:48.154320 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5c7cbbbf-7a4a-4369-9e5b-77154babdfde tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:48.155098 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5c7cbbbf-7a4a-4369-9e5b-77154babdfde tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:48.155533 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5c7cbbbf-7a4a-4369-9e5b-77154babdfde tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:48.184303 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5c7cbbbf-7a4a-4369-9e5b-77154babdfde tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041001 Dec 15 12:46:48.184891 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 552/1095] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:48 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:48.461442 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-11633f42-b680-48c9-bf85-27acb16eb577 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:48.462088 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-11633f42-b680-48c9-bf85-27acb16eb577 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:48.468315 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-11633f42-b680-48c9-bf85-27acb16eb577 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:48.468760 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-11633f42-b680-48c9-bf85-27acb16eb577 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:48.469557 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-11633f42-b680-48c9-bf85-27acb16eb577 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:48.469996 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-11633f42-b680-48c9-bf85-27acb16eb577 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:48.574713 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5260210a-d730-422c-a44a-50967ce3f23f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:48.575608 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5260210a-d730-422c-a44a-50967ce3f23f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:48.582578 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5260210a-d730-422c-a44a-50967ce3f23f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:48.583011 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5260210a-d730-422c-a44a-50967ce3f23f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:48.583826 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5260210a-d730-422c-a44a-50967ce3f23f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:48.584244 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5260210a-d730-422c-a44a-50967ce3f23f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:48.608163 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-11633f42-b680-48c9-bf85-27acb16eb577 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:48.616393 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5260210a-d730-422c-a44a-50967ce3f23f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045352 Dec 15 12:46:48.616829 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-11633f42-b680-48c9-bf85-27acb16eb577 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:48.616964 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 553/1096] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:48 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:46:48.618361 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-11633f42-b680-48c9-bf85-27acb16eb577 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:48.619505 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-11633f42-b680-48c9-bf85-27acb16eb577 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.161777 Dec 15 12:46:48.620046 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 544/1097] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:48 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:49.195969 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9699d17d-ffc6-452d-ba8d-d7e37ff55941 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:49.196897 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9699d17d-ffc6-452d-ba8d-d7e37ff55941 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:49.202878 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9699d17d-ffc6-452d-ba8d-d7e37ff55941 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:49.203326 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9699d17d-ffc6-452d-ba8d-d7e37ff55941 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:49.204138 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9699d17d-ffc6-452d-ba8d-d7e37ff55941 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:49.204575 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9699d17d-ffc6-452d-ba8d-d7e37ff55941 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:49.239446 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9699d17d-ffc6-452d-ba8d-d7e37ff55941 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047259 Dec 15 12:46:49.240011 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 554/1098] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:49 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:49.628228 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ce52c607-bbaf-4b37-9ff7-2127ed46f644 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:49.629169 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ce52c607-bbaf-4b37-9ff7-2127ed46f644 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:49.635735 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ce52c607-bbaf-4b37-9ff7-2127ed46f644 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:49.636182 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ce52c607-bbaf-4b37-9ff7-2127ed46f644 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:49.637101 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ce52c607-bbaf-4b37-9ff7-2127ed46f644 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:49.637565 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ce52c607-bbaf-4b37-9ff7-2127ed46f644 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:49.638278 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5bea27a9-c45a-4725-a5a8-fc1f50b0175c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:49.638906 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5bea27a9-c45a-4725-a5a8-fc1f50b0175c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:49.646705 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5bea27a9-c45a-4725-a5a8-fc1f50b0175c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:49.647154 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5bea27a9-c45a-4725-a5a8-fc1f50b0175c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:49.647977 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5bea27a9-c45a-4725-a5a8-fc1f50b0175c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:49.648423 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5bea27a9-c45a-4725-a5a8-fc1f50b0175c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:49.669195 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ce52c607-bbaf-4b37-9ff7-2127ed46f644 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045001 Dec 15 12:46:49.669808 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 545/1099] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:49 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:49.786741 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5bea27a9-c45a-4725-a5a8-fc1f50b0175c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:49.795281 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5bea27a9-c45a-4725-a5a8-fc1f50b0175c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:49.796790 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5bea27a9-c45a-4725-a5a8-fc1f50b0175c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:49.798038 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5bea27a9-c45a-4725-a5a8-fc1f50b0175c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.163815 Dec 15 12:46:49.798625 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 555/1100] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:49 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:46:50.251050 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ef361c2d-f353-4007-854b-ae2e35814ba8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:50.252721 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ef361c2d-f353-4007-854b-ae2e35814ba8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:50.258768 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ef361c2d-f353-4007-854b-ae2e35814ba8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:50.259212 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ef361c2d-f353-4007-854b-ae2e35814ba8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:50.259984 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ef361c2d-f353-4007-854b-ae2e35814ba8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:50.260410 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ef361c2d-f353-4007-854b-ae2e35814ba8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:50.292487 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ef361c2d-f353-4007-854b-ae2e35814ba8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045066 Dec 15 12:46:50.293048 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 546/1101] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:50 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:50.682092 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c3ff2e4e-497d-4d34-866f-483c8851c248 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:50.683147 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c3ff2e4e-497d-4d34-866f-483c8851c248 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:50.689911 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c3ff2e4e-497d-4d34-866f-483c8851c248 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:50.690356 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c3ff2e4e-497d-4d34-866f-483c8851c248 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:50.691143 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c3ff2e4e-497d-4d34-866f-483c8851c248 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:50.691569 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c3ff2e4e-497d-4d34-866f-483c8851c248 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:50.720802 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c3ff2e4e-497d-4d34-866f-483c8851c248 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043338 Dec 15 12:46:50.721347 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 556/1102] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:50 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:50.816277 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0cf08454-82b8-4ddd-943b-941923cf81be tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:50.816875 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0cf08454-82b8-4ddd-943b-941923cf81be tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:50.823037 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0cf08454-82b8-4ddd-943b-941923cf81be tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:50.823472 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0cf08454-82b8-4ddd-943b-941923cf81be tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:50.824232 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0cf08454-82b8-4ddd-943b-941923cf81be tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:50.824657 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0cf08454-82b8-4ddd-943b-941923cf81be tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:51.107793 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0cf08454-82b8-4ddd-943b-941923cf81be tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:51.116287 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0cf08454-82b8-4ddd-943b-941923cf81be tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:51.117793 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0cf08454-82b8-4ddd-943b-941923cf81be tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:51.119140 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0cf08454-82b8-4ddd-943b-941923cf81be tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.306596 Dec 15 12:46:51.119704 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 547/1103] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:50 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:51.304048 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-29c467f0-5c17-4ef3-906f-fcae3b96ff10 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:51.305011 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-29c467f0-5c17-4ef3-906f-fcae3b96ff10 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:51.312296 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-29c467f0-5c17-4ef3-906f-fcae3b96ff10 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:51.312657 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-29c467f0-5c17-4ef3-906f-fcae3b96ff10 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:51.313453 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-29c467f0-5c17-4ef3-906f-fcae3b96ff10 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:51.313931 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-29c467f0-5c17-4ef3-906f-fcae3b96ff10 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:51.343319 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-29c467f0-5c17-4ef3-906f-fcae3b96ff10 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043002 Dec 15 12:46:51.343879 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 557/1104] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:51 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:46:51.732993 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-81b15105-0b61-4928-a008-db120b5e52a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:51.733914 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-81b15105-0b61-4928-a008-db120b5e52a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:51.740737 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-81b15105-0b61-4928-a008-db120b5e52a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:51.741181 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-81b15105-0b61-4928-a008-db120b5e52a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:51.741983 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-81b15105-0b61-4928-a008-db120b5e52a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:51.742414 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-81b15105-0b61-4928-a008-db120b5e52a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:51.771867 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-81b15105-0b61-4928-a008-db120b5e52a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043362 Dec 15 12:46:51.772410 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 548/1105] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:51 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:52.137091 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2d85bd9e-66e9-404a-bd12-c968b54bef2e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:52.137773 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2d85bd9e-66e9-404a-bd12-c968b54bef2e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:52.144666 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2d85bd9e-66e9-404a-bd12-c968b54bef2e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:52.145114 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2d85bd9e-66e9-404a-bd12-c968b54bef2e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:52.145949 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2d85bd9e-66e9-404a-bd12-c968b54bef2e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:52.146384 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2d85bd9e-66e9-404a-bd12-c968b54bef2e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:52.281042 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2d85bd9e-66e9-404a-bd12-c968b54bef2e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:52.290076 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2d85bd9e-66e9-404a-bd12-c968b54bef2e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:52.291590 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2d85bd9e-66e9-404a-bd12-c968b54bef2e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:52.292831 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2d85bd9e-66e9-404a-bd12-c968b54bef2e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.159451 Dec 15 12:46:52.295020 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 558/1106] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:52 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:52.355914 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7eb36ffe-930a-4020-9c98-14fffa1d0d91 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:52.356836 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7eb36ffe-930a-4020-9c98-14fffa1d0d91 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:52.363810 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7eb36ffe-930a-4020-9c98-14fffa1d0d91 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:52.364257 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7eb36ffe-930a-4020-9c98-14fffa1d0d91 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:52.365025 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7eb36ffe-930a-4020-9c98-14fffa1d0d91 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:52.365455 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7eb36ffe-930a-4020-9c98-14fffa1d0d91 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:52.394215 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7eb36ffe-930a-4020-9c98-14fffa1d0d91 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042027 Dec 15 12:46:52.394721 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 549/1107] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:52 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:52.786583 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3ffbce61-efa2-44ef-92d5-04de9bde27c6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:52.787417 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3ffbce61-efa2-44ef-92d5-04de9bde27c6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:52.793264 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3ffbce61-efa2-44ef-92d5-04de9bde27c6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:52.793744 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3ffbce61-efa2-44ef-92d5-04de9bde27c6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:52.794515 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3ffbce61-efa2-44ef-92d5-04de9bde27c6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:52.794947 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3ffbce61-efa2-44ef-92d5-04de9bde27c6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:52.824320 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3ffbce61-efa2-44ef-92d5-04de9bde27c6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042314 Dec 15 12:46:52.824902 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 559/1108] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:52 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:53.312468 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7bfdef8b-4418-49d7-8b62-64d42d38e893 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:53.313079 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7bfdef8b-4418-49d7-8b62-64d42d38e893 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:53.319737 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7bfdef8b-4418-49d7-8b62-64d42d38e893 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:53.320194 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7bfdef8b-4418-49d7-8b62-64d42d38e893 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:53.320957 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7bfdef8b-4418-49d7-8b62-64d42d38e893 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:53.321398 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7bfdef8b-4418-49d7-8b62-64d42d38e893 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:53.405878 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b407d56e-f912-41c4-ad84-a8549b348b90 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:53.406877 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b407d56e-f912-41c4-ad84-a8549b348b90 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:53.413651 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b407d56e-f912-41c4-ad84-a8549b348b90 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:53.414111 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b407d56e-f912-41c4-ad84-a8549b348b90 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:53.414906 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b407d56e-f912-41c4-ad84-a8549b348b90 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:53.415341 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b407d56e-f912-41c4-ad84-a8549b348b90 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:53.447671 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b407d56e-f912-41c4-ad84-a8549b348b90 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045795 Dec 15 12:46:53.448333 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 560/1109] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:53 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:46:53.468399 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7bfdef8b-4418-49d7-8b62-64d42d38e893 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:53.476808 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7bfdef8b-4418-49d7-8b62-64d42d38e893 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:53.478350 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7bfdef8b-4418-49d7-8b62-64d42d38e893 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:53.479509 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7bfdef8b-4418-49d7-8b62-64d42d38e893 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.170781 Dec 15 12:46:53.480057 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 550/1110] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:53 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:53.836115 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d593cf3e-e071-433b-b33d-907e5682e8ad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:53.837012 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d593cf3e-e071-433b-b33d-907e5682e8ad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:53.842832 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d593cf3e-e071-433b-b33d-907e5682e8ad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:53.843271 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d593cf3e-e071-433b-b33d-907e5682e8ad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:53.844032 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d593cf3e-e071-433b-b33d-907e5682e8ad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:53.844456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d593cf3e-e071-433b-b33d-907e5682e8ad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:53.876480 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d593cf3e-e071-433b-b33d-907e5682e8ad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043958 Dec 15 12:46:53.876987 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 561/1111] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:53 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:54.459761 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-43cb05a0-ab32-4835-9077-8198d6af2535 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:54.460666 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-43cb05a0-ab32-4835-9077-8198d6af2535 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:54.466895 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-43cb05a0-ab32-4835-9077-8198d6af2535 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:54.467343 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-43cb05a0-ab32-4835-9077-8198d6af2535 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:54.468120 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-43cb05a0-ab32-4835-9077-8198d6af2535 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:54.468550 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-43cb05a0-ab32-4835-9077-8198d6af2535 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:54.498396 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7fecd23d-ab84-40fa-84ac-160ca38860c6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:54.499011 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7fecd23d-ab84-40fa-84ac-160ca38860c6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:54.499594 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-43cb05a0-ab32-4835-9077-8198d6af2535 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043597 Dec 15 12:46:54.500158 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 551/1112] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:54 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:54.505282 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7fecd23d-ab84-40fa-84ac-160ca38860c6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:54.505763 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7fecd23d-ab84-40fa-84ac-160ca38860c6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:54.506550 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7fecd23d-ab84-40fa-84ac-160ca38860c6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:54.506988 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7fecd23d-ab84-40fa-84ac-160ca38860c6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:54.639460 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7fecd23d-ab84-40fa-84ac-160ca38860c6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:54.648939 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7fecd23d-ab84-40fa-84ac-160ca38860c6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:54.650436 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7fecd23d-ab84-40fa-84ac-160ca38860c6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:54.651588 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7fecd23d-ab84-40fa-84ac-160ca38860c6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.156800 Dec 15 12:46:54.652135 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 562/1113] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:54 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:46:54.888012 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1b28c391-40b8-4c3d-8bb3-55729ffbf5a2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:54.888916 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1b28c391-40b8-4c3d-8bb3-55729ffbf5a2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:54.895327 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b28c391-40b8-4c3d-8bb3-55729ffbf5a2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:54.895770 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b28c391-40b8-4c3d-8bb3-55729ffbf5a2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:54.896552 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b28c391-40b8-4c3d-8bb3-55729ffbf5a2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:54.897004 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b28c391-40b8-4c3d-8bb3-55729ffbf5a2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:54.927377 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1b28c391-40b8-4c3d-8bb3-55729ffbf5a2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043067 Dec 15 12:46:54.927935 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 552/1114] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:54 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:55.511333 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-395a4379-a603-4e0c-8285-7d5de96be991 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:55.512236 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-395a4379-a603-4e0c-8285-7d5de96be991 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:55.518694 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-395a4379-a603-4e0c-8285-7d5de96be991 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:55.519141 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-395a4379-a603-4e0c-8285-7d5de96be991 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:55.519921 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-395a4379-a603-4e0c-8285-7d5de96be991 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:55.520352 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-395a4379-a603-4e0c-8285-7d5de96be991 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:55.550637 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-395a4379-a603-4e0c-8285-7d5de96be991 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042936 Dec 15 12:46:55.551100 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 563/1115] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:55 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:55.670489 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-721e6d53-4901-41de-bd99-12822e0bae69 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:55.671098 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-721e6d53-4901-41de-bd99-12822e0bae69 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:55.678078 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-721e6d53-4901-41de-bd99-12822e0bae69 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:55.678530 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-721e6d53-4901-41de-bd99-12822e0bae69 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:55.679326 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-721e6d53-4901-41de-bd99-12822e0bae69 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:55.683582 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-721e6d53-4901-41de-bd99-12822e0bae69 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:55.818202 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-721e6d53-4901-41de-bd99-12822e0bae69 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:55.826331 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-721e6d53-4901-41de-bd99-12822e0bae69 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:55.827831 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-721e6d53-4901-41de-bd99-12822e0bae69 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:55.829102 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-721e6d53-4901-41de-bd99-12822e0bae69 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.162253 Dec 15 12:46:55.829835 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 553/1116] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:55 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:55.939354 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0861d83f-b0d1-4e47-a978-e75a98eeb9b9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:55.940272 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0861d83f-b0d1-4e47-a978-e75a98eeb9b9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:55.946462 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0861d83f-b0d1-4e47-a978-e75a98eeb9b9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:55.946906 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0861d83f-b0d1-4e47-a978-e75a98eeb9b9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:55.947690 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0861d83f-b0d1-4e47-a978-e75a98eeb9b9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:55.948119 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0861d83f-b0d1-4e47-a978-e75a98eeb9b9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:55.977295 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0861d83f-b0d1-4e47-a978-e75a98eeb9b9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041931 Dec 15 12:46:55.977881 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 564/1117] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:55 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:56.560892 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ac17ca75-7f39-4439-985e-e18a195427ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:56.561750 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ac17ca75-7f39-4439-985e-e18a195427ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:56.567918 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ac17ca75-7f39-4439-985e-e18a195427ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:56.568359 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ac17ca75-7f39-4439-985e-e18a195427ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:56.569159 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ac17ca75-7f39-4439-985e-e18a195427ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:56.569623 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ac17ca75-7f39-4439-985e-e18a195427ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:56.600333 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ac17ca75-7f39-4439-985e-e18a195427ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043109 Dec 15 12:46:56.600888 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 554/1118] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:56 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:56.847494 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4598bcef-b645-4021-ac23-bab0d956a939 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:56.848040 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4598bcef-b645-4021-ac23-bab0d956a939 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:56.854225 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4598bcef-b645-4021-ac23-bab0d956a939 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:56.854664 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4598bcef-b645-4021-ac23-bab0d956a939 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:56.855437 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4598bcef-b645-4021-ac23-bab0d956a939 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:56.855867 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4598bcef-b645-4021-ac23-bab0d956a939 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:56.986399 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4598bcef-b645-4021-ac23-bab0d956a939 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:56.989177 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7b457faf-b50b-41a8-8b36-21d5e77776da tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:56.990313 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7b457faf-b50b-41a8-8b36-21d5e77776da tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:56.996510 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7b457faf-b50b-41a8-8b36-21d5e77776da tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:56.996955 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7b457faf-b50b-41a8-8b36-21d5e77776da tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:56.997764 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7b457faf-b50b-41a8-8b36-21d5e77776da tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:56.998198 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7b457faf-b50b-41a8-8b36-21d5e77776da tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:56.999626 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4598bcef-b645-4021-ac23-bab0d956a939 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:57.001147 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4598bcef-b645-4021-ac23-bab0d956a939 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:57.003247 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4598bcef-b645-4021-ac23-bab0d956a939 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.159567 Dec 15 12:46:57.003807 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 565/1119] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:56 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:57.027775 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7b457faf-b50b-41a8-8b36-21d5e77776da tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043082 Dec 15 12:46:57.028323 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 555/1120] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:56 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:46:57.612805 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-099ad986-8d7a-4997-a145-0c1f3cafd4d7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:57.613753 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-099ad986-8d7a-4997-a145-0c1f3cafd4d7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:57.619984 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-099ad986-8d7a-4997-a145-0c1f3cafd4d7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:57.620317 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-099ad986-8d7a-4997-a145-0c1f3cafd4d7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:57.621091 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-099ad986-8d7a-4997-a145-0c1f3cafd4d7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:57.621547 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-099ad986-8d7a-4997-a145-0c1f3cafd4d7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:57.649793 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-099ad986-8d7a-4997-a145-0c1f3cafd4d7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041658 Dec 15 12:46:57.650352 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 566/1121] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:57 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:58.024001 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fe0bdad9-7fca-49a8-b233-6bf014da6051 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:58.024703 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fe0bdad9-7fca-49a8-b233-6bf014da6051 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:58.031470 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fe0bdad9-7fca-49a8-b233-6bf014da6051 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:58.032143 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fe0bdad9-7fca-49a8-b233-6bf014da6051 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:58.033982 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fe0bdad9-7fca-49a8-b233-6bf014da6051 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:58.034645 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fe0bdad9-7fca-49a8-b233-6bf014da6051 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:58.040050 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e38b97a8-86c2-45b8-af38-081ebb4d190e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:58.041050 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e38b97a8-86c2-45b8-af38-081ebb4d190e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:58.047134 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e38b97a8-86c2-45b8-af38-081ebb4d190e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:58.047574 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e38b97a8-86c2-45b8-af38-081ebb4d190e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:58.048545 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e38b97a8-86c2-45b8-af38-081ebb4d190e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:58.048981 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e38b97a8-86c2-45b8-af38-081ebb4d190e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:58.077958 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e38b97a8-86c2-45b8-af38-081ebb4d190e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041568 Dec 15 12:46:58.078814 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 567/1122] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:58 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:46:58.182196 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fe0bdad9-7fca-49a8-b233-6bf014da6051 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:58.191446 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fe0bdad9-7fca-49a8-b233-6bf014da6051 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:58.192921 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fe0bdad9-7fca-49a8-b233-6bf014da6051 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:58.194101 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fe0bdad9-7fca-49a8-b233-6bf014da6051 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.175822 Dec 15 12:46:58.194646 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 556/1123] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:58 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:58.661985 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c0a6f43c-d883-432f-a6bf-f14a2252af24 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:58.662890 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c0a6f43c-d883-432f-a6bf-f14a2252af24 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:58.668975 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c0a6f43c-d883-432f-a6bf-f14a2252af24 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:58.669422 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c0a6f43c-d883-432f-a6bf-f14a2252af24 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:58.670314 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c0a6f43c-d883-432f-a6bf-f14a2252af24 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:58.670676 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c0a6f43c-d883-432f-a6bf-f14a2252af24 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:58.711016 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c0a6f43c-d883-432f-a6bf-f14a2252af24 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053434 Dec 15 12:46:58.711603 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 568/1124] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:58 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:59.089540 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e4d14524-33c3-49d6-898d-c263bb328fc5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:59.090454 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e4d14524-33c3-49d6-898d-c263bb328fc5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:59.097035 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e4d14524-33c3-49d6-898d-c263bb328fc5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:59.097486 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e4d14524-33c3-49d6-898d-c263bb328fc5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:59.098355 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e4d14524-33c3-49d6-898d-c263bb328fc5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:59.098788 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e4d14524-33c3-49d6-898d-c263bb328fc5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:59.130606 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e4d14524-33c3-49d6-898d-c263bb328fc5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044510 Dec 15 12:46:59.131171 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 557/1125] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:59 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:46:59.212774 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-37fbab5f-2345-42bf-922b-1e7b5bebdaac tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:59.213410 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-37fbab5f-2345-42bf-922b-1e7b5bebdaac tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:59.219779 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-37fbab5f-2345-42bf-922b-1e7b5bebdaac tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:59.220229 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-37fbab5f-2345-42bf-922b-1e7b5bebdaac tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:59.221036 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-37fbab5f-2345-42bf-922b-1e7b5bebdaac tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:59.221466 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-37fbab5f-2345-42bf-922b-1e7b5bebdaac tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:59.360042 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-37fbab5f-2345-42bf-922b-1e7b5bebdaac tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:59.369305 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-37fbab5f-2345-42bf-922b-1e7b5bebdaac tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:59.370986 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-37fbab5f-2345-42bf-922b-1e7b5bebdaac tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:46:59.371996 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-37fbab5f-2345-42bf-922b-1e7b5bebdaac tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.162874 Dec 15 12:46:59.381755 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 569/1126] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:46:59 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:46:59.723827 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6d56a6eb-f68e-496b-90b1-3c0c6f1df063 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:46:59.724834 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6d56a6eb-f68e-496b-90b1-3c0c6f1df063 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:46:59.731900 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d56a6eb-f68e-496b-90b1-3c0c6f1df063 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:59.732474 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d56a6eb-f68e-496b-90b1-3c0c6f1df063 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:59.733514 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d56a6eb-f68e-496b-90b1-3c0c6f1df063 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:46:59.733971 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d56a6eb-f68e-496b-90b1-3c0c6f1df063 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:46:59.764895 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6d56a6eb-f68e-496b-90b1-3c0c6f1df063 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045904 Dec 15 12:46:59.765544 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 558/1127] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:46:59 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:00.141385 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7b906659-9a5a-4f28-bcf5-972ff265863c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:00.143066 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7b906659-9a5a-4f28-bcf5-972ff265863c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:00.148983 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b906659-9a5a-4f28-bcf5-972ff265863c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:00.149434 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b906659-9a5a-4f28-bcf5-972ff265863c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:00.150246 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b906659-9a5a-4f28-bcf5-972ff265863c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:00.150688 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b906659-9a5a-4f28-bcf5-972ff265863c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:00.182517 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7b906659-9a5a-4f28-bcf5-972ff265863c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044813 Dec 15 12:47:00.188649 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 570/1128] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:00 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:00.390176 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c12f665d-f696-4174-beb6-8575d895f1c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:00.390820 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c12f665d-f696-4174-beb6-8575d895f1c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:00.398320 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c12f665d-f696-4174-beb6-8575d895f1c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:00.398700 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c12f665d-f696-4174-beb6-8575d895f1c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:00.399499 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c12f665d-f696-4174-beb6-8575d895f1c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:00.399933 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c12f665d-f696-4174-beb6-8575d895f1c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:00.533255 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c12f665d-f696-4174-beb6-8575d895f1c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:00.541477 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c12f665d-f696-4174-beb6-8575d895f1c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:00.542981 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c12f665d-f696-4174-beb6-8575d895f1c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:00.544123 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c12f665d-f696-4174-beb6-8575d895f1c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.157644 Dec 15 12:47:00.544691 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 559/1129] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:00 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:00.776092 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8fba6c06-693d-4291-a9da-0a574e4b51ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:00.777018 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8fba6c06-693d-4291-a9da-0a574e4b51ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:00.782882 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8fba6c06-693d-4291-a9da-0a574e4b51ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:00.783328 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8fba6c06-693d-4291-a9da-0a574e4b51ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:00.784094 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8fba6c06-693d-4291-a9da-0a574e4b51ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:00.784527 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8fba6c06-693d-4291-a9da-0a574e4b51ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:00.815405 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8fba6c06-693d-4291-a9da-0a574e4b51ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042936 Dec 15 12:47:00.815960 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 571/1130] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:00 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:01.194082 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d339d09b-7cdc-4c98-8144-e5efd86419d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:01.195052 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d339d09b-7cdc-4c98-8144-e5efd86419d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:01.201025 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d339d09b-7cdc-4c98-8144-e5efd86419d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:01.201482 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d339d09b-7cdc-4c98-8144-e5efd86419d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:01.202285 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d339d09b-7cdc-4c98-8144-e5efd86419d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:01.202718 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d339d09b-7cdc-4c98-8144-e5efd86419d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:01.232871 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d339d09b-7cdc-4c98-8144-e5efd86419d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042449 Dec 15 12:47:01.233424 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 560/1131] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:01 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:01.562896 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4586998d-67ea-4aba-a33c-d753ae8b3cb3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:01.563413 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4586998d-67ea-4aba-a33c-d753ae8b3cb3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:01.570859 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4586998d-67ea-4aba-a33c-d753ae8b3cb3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:01.571497 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4586998d-67ea-4aba-a33c-d753ae8b3cb3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:01.572650 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4586998d-67ea-4aba-a33c-d753ae8b3cb3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:01.573266 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4586998d-67ea-4aba-a33c-d753ae8b3cb3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:01.706211 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4586998d-67ea-4aba-a33c-d753ae8b3cb3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:01.714535 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4586998d-67ea-4aba-a33c-d753ae8b3cb3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:01.716034 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4586998d-67ea-4aba-a33c-d753ae8b3cb3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:01.717284 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4586998d-67ea-4aba-a33c-d753ae8b3cb3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.158226 Dec 15 12:47:01.717773 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 572/1132] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:01 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:01.826886 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-04a2cf2d-d1c6-4b66-a648-68c74aede821 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:01.827720 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-04a2cf2d-d1c6-4b66-a648-68c74aede821 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:01.835315 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-04a2cf2d-d1c6-4b66-a648-68c74aede821 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:01.835771 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-04a2cf2d-d1c6-4b66-a648-68c74aede821 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:01.837011 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-04a2cf2d-d1c6-4b66-a648-68c74aede821 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:01.837137 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-04a2cf2d-d1c6-4b66-a648-68c74aede821 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:01.866392 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-04a2cf2d-d1c6-4b66-a648-68c74aede821 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043341 Dec 15 12:47:01.866930 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 561/1133] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:01 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:02.244883 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4f88fa10-8942-41eb-ac01-c484f69c1e88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:02.245873 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4f88fa10-8942-41eb-ac01-c484f69c1e88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:02.252287 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4f88fa10-8942-41eb-ac01-c484f69c1e88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:02.252728 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4f88fa10-8942-41eb-ac01-c484f69c1e88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:02.253532 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4f88fa10-8942-41eb-ac01-c484f69c1e88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:02.253975 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4f88fa10-8942-41eb-ac01-c484f69c1e88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:02.284188 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4f88fa10-8942-41eb-ac01-c484f69c1e88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043012 Dec 15 12:47:02.284732 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 573/1134] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:02 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:02.737533 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-050298e7-2e50-4b19-b57f-3c574af115b5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:02.738150 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-050298e7-2e50-4b19-b57f-3c574af115b5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:02.744170 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-050298e7-2e50-4b19-b57f-3c574af115b5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:02.744646 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-050298e7-2e50-4b19-b57f-3c574af115b5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:02.745445 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-050298e7-2e50-4b19-b57f-3c574af115b5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:02.745916 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-050298e7-2e50-4b19-b57f-3c574af115b5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:02.876316 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-050298e7-2e50-4b19-b57f-3c574af115b5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:02.878587 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3acacb36-dd58-4d0a-9048-92ea9b4dee92 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:02.879507 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3acacb36-dd58-4d0a-9048-92ea9b4dee92 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:02.885299 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-050298e7-2e50-4b19-b57f-3c574af115b5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:02.885924 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3acacb36-dd58-4d0a-9048-92ea9b4dee92 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:02.886373 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3acacb36-dd58-4d0a-9048-92ea9b4dee92 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:02.887064 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-050298e7-2e50-4b19-b57f-3c574af115b5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:02.887182 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3acacb36-dd58-4d0a-9048-92ea9b4dee92 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:02.887594 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3acacb36-dd58-4d0a-9048-92ea9b4dee92 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:02.888454 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-050298e7-2e50-4b19-b57f-3c574af115b5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.155854 Dec 15 12:47:02.889079 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 562/1135] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:02 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:02.917030 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3acacb36-dd58-4d0a-9048-92ea9b4dee92 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042619 Dec 15 12:47:02.917613 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 574/1136] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:02 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:47:03.295825 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ed26da66-d663-43c5-af12-1614a5b0838b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:03.296863 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ed26da66-d663-43c5-af12-1614a5b0838b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:03.303631 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ed26da66-d663-43c5-af12-1614a5b0838b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:03.304085 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ed26da66-d663-43c5-af12-1614a5b0838b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:03.304882 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ed26da66-d663-43c5-af12-1614a5b0838b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:03.305342 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ed26da66-d663-43c5-af12-1614a5b0838b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:03.344493 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ed26da66-d663-43c5-af12-1614a5b0838b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052567 Dec 15 12:47:03.345733 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 563/1137] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:03 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:47:03.906554 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-56958eee-9b26-453b-bd13-9b4b82485bbf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:03.907161 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-56958eee-9b26-453b-bd13-9b4b82485bbf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:03.913794 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-56958eee-9b26-453b-bd13-9b4b82485bbf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:03.914242 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-56958eee-9b26-453b-bd13-9b4b82485bbf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:03.915040 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-56958eee-9b26-453b-bd13-9b4b82485bbf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:03.915469 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-56958eee-9b26-453b-bd13-9b4b82485bbf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:03.928692 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b1d5abc8-134f-4ece-b524-b22d906cc967 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:03.929680 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b1d5abc8-134f-4ece-b524-b22d906cc967 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:03.935837 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1d5abc8-134f-4ece-b524-b22d906cc967 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:03.936279 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1d5abc8-134f-4ece-b524-b22d906cc967 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:03.937059 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1d5abc8-134f-4ece-b524-b22d906cc967 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:03.937486 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1d5abc8-134f-4ece-b524-b22d906cc967 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:03.967128 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b1d5abc8-134f-4ece-b524-b22d906cc967 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042145 Dec 15 12:47:03.967709 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 564/1138] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:03 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:47:04.057709 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-56958eee-9b26-453b-bd13-9b4b82485bbf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:04.067030 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-56958eee-9b26-453b-bd13-9b4b82485bbf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:04.068526 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-56958eee-9b26-453b-bd13-9b4b82485bbf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:04.069829 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-56958eee-9b26-453b-bd13-9b4b82485bbf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.166862 Dec 15 12:47:04.070408 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 575/1139] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:03 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:04.357627 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-90cc6f44-1742-4bea-b1f2-4f0d745cec74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:04.358534 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-90cc6f44-1742-4bea-b1f2-4f0d745cec74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:04.365106 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-90cc6f44-1742-4bea-b1f2-4f0d745cec74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:04.365576 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-90cc6f44-1742-4bea-b1f2-4f0d745cec74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:04.366346 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-90cc6f44-1742-4bea-b1f2-4f0d745cec74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:04.366773 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-90cc6f44-1742-4bea-b1f2-4f0d745cec74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:04.396513 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-90cc6f44-1742-4bea-b1f2-4f0d745cec74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042619 Dec 15 12:47:04.397054 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 565/1140] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:04 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:04.978614 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e2c26f4c-b6c6-45ce-b285-faab65b12c4d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:04.979531 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e2c26f4c-b6c6-45ce-b285-faab65b12c4d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:04.985927 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e2c26f4c-b6c6-45ce-b285-faab65b12c4d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:04.986382 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e2c26f4c-b6c6-45ce-b285-faab65b12c4d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:04.987167 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e2c26f4c-b6c6-45ce-b285-faab65b12c4d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:04.987604 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e2c26f4c-b6c6-45ce-b285-faab65b12c4d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:05.022131 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e2c26f4c-b6c6-45ce-b285-faab65b12c4d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047158 Dec 15 12:47:05.022698 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 576/1141] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:04 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:05.088046 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-819f107b-f478-4c1a-b9a4-b53ae75bc07f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:05.088798 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-819f107b-f478-4c1a-b9a4-b53ae75bc07f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:05.095258 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-819f107b-f478-4c1a-b9a4-b53ae75bc07f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:05.095814 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-819f107b-f478-4c1a-b9a4-b53ae75bc07f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:05.096605 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-819f107b-f478-4c1a-b9a4-b53ae75bc07f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:05.097041 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-819f107b-f478-4c1a-b9a4-b53ae75bc07f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:05.229368 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-819f107b-f478-4c1a-b9a4-b53ae75bc07f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:05.237981 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-819f107b-f478-4c1a-b9a4-b53ae75bc07f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:05.239451 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-819f107b-f478-4c1a-b9a4-b53ae75bc07f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:05.240597 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-819f107b-f478-4c1a-b9a4-b53ae75bc07f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.156298 Dec 15 12:47:05.241140 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 566/1142] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:05 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:05.408174 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-43296cc9-8907-41b6-b013-62aecbebe489 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:05.409630 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-43296cc9-8907-41b6-b013-62aecbebe489 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:05.420781 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-43296cc9-8907-41b6-b013-62aecbebe489 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:05.421254 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-43296cc9-8907-41b6-b013-62aecbebe489 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:05.422117 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-43296cc9-8907-41b6-b013-62aecbebe489 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:05.422546 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-43296cc9-8907-41b6-b013-62aecbebe489 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:05.454292 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-43296cc9-8907-41b6-b013-62aecbebe489 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049675 Dec 15 12:47:05.454807 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 577/1143] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:05 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:06.034326 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1b695fd1-8a37-46cf-89be-2bb5c884e10d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:06.035340 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1b695fd1-8a37-46cf-89be-2bb5c884e10d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:06.041260 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b695fd1-8a37-46cf-89be-2bb5c884e10d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:06.041738 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b695fd1-8a37-46cf-89be-2bb5c884e10d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:06.042518 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b695fd1-8a37-46cf-89be-2bb5c884e10d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:06.042951 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b695fd1-8a37-46cf-89be-2bb5c884e10d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:06.073353 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1b695fd1-8a37-46cf-89be-2bb5c884e10d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043413 Dec 15 12:47:06.073930 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 567/1144] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:06 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:06.259514 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5e6ce503-9c21-4f9c-957e-8dc6c3dac900 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:06.260081 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5e6ce503-9c21-4f9c-957e-8dc6c3dac900 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:06.267234 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5e6ce503-9c21-4f9c-957e-8dc6c3dac900 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:06.267826 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5e6ce503-9c21-4f9c-957e-8dc6c3dac900 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:06.268618 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5e6ce503-9c21-4f9c-957e-8dc6c3dac900 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:06.269052 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5e6ce503-9c21-4f9c-957e-8dc6c3dac900 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:06.402605 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5e6ce503-9c21-4f9c-957e-8dc6c3dac900 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:06.411661 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5e6ce503-9c21-4f9c-957e-8dc6c3dac900 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:06.413170 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5e6ce503-9c21-4f9c-957e-8dc6c3dac900 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:06.414421 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5e6ce503-9c21-4f9c-957e-8dc6c3dac900 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.159055 Dec 15 12:47:06.415000 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 578/1145] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:06 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:06.468576 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-07e5f9ee-f2bf-4105-b639-8a76841f1a93 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:06.470633 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-07e5f9ee-f2bf-4105-b639-8a76841f1a93 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:06.477303 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-07e5f9ee-f2bf-4105-b639-8a76841f1a93 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:06.477786 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-07e5f9ee-f2bf-4105-b639-8a76841f1a93 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:06.478580 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-07e5f9ee-f2bf-4105-b639-8a76841f1a93 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:06.479013 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-07e5f9ee-f2bf-4105-b639-8a76841f1a93 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:06.508411 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-07e5f9ee-f2bf-4105-b639-8a76841f1a93 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045980 Dec 15 12:47:06.508959 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 568/1146] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:06 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:07.090055 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-47b59e6c-51cc-45f8-a71a-74f72229ec8a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:07.090055 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-47b59e6c-51cc-45f8-a71a-74f72229ec8a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:07.092118 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-47b59e6c-51cc-45f8-a71a-74f72229ec8a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:07.092552 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-47b59e6c-51cc-45f8-a71a-74f72229ec8a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:07.093340 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-47b59e6c-51cc-45f8-a71a-74f72229ec8a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:07.093806 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-47b59e6c-51cc-45f8-a71a-74f72229ec8a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:07.124306 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-47b59e6c-51cc-45f8-a71a-74f72229ec8a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043349 Dec 15 12:47:07.124847 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 579/1147] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:07 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:07.433033 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3514e17a-5312-4fbb-af7a-a5f257355214 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:07.433667 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3514e17a-5312-4fbb-af7a-a5f257355214 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:07.439986 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3514e17a-5312-4fbb-af7a-a5f257355214 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:07.440423 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3514e17a-5312-4fbb-af7a-a5f257355214 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:07.441184 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3514e17a-5312-4fbb-af7a-a5f257355214 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:07.441638 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3514e17a-5312-4fbb-af7a-a5f257355214 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:07.521454 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e15c2920-2d42-4d74-bad5-9ab997e69c70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:07.522553 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e15c2920-2d42-4d74-bad5-9ab997e69c70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:07.532602 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e15c2920-2d42-4d74-bad5-9ab997e69c70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:07.532602 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e15c2920-2d42-4d74-bad5-9ab997e69c70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:07.533364 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e15c2920-2d42-4d74-bad5-9ab997e69c70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:07.533828 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e15c2920-2d42-4d74-bad5-9ab997e69c70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:07.565676 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e15c2920-2d42-4d74-bad5-9ab997e69c70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047889 Dec 15 12:47:07.566162 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 580/1148] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:07 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:07.598366 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3514e17a-5312-4fbb-af7a-a5f257355214 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:07.606742 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3514e17a-5312-4fbb-af7a-a5f257355214 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:07.608272 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3514e17a-5312-4fbb-af7a-a5f257355214 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:07.609535 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3514e17a-5312-4fbb-af7a-a5f257355214 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.180164 Dec 15 12:47:07.610122 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 569/1149] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:07 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:08.136896 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9f8976a1-df45-4c9c-9526-23642fc1a9d7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:08.137842 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9f8976a1-df45-4c9c-9526-23642fc1a9d7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:08.143802 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9f8976a1-df45-4c9c-9526-23642fc1a9d7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:08.144249 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9f8976a1-df45-4c9c-9526-23642fc1a9d7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:08.145041 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9f8976a1-df45-4c9c-9526-23642fc1a9d7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:08.145482 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9f8976a1-df45-4c9c-9526-23642fc1a9d7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:08.174334 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9f8976a1-df45-4c9c-9526-23642fc1a9d7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041375 Dec 15 12:47:08.174888 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 581/1150] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:08 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:08.580525 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4e2caa8c-7785-441a-9157-7b00e70852f6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:08.581939 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4e2caa8c-7785-441a-9157-7b00e70852f6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:08.592174 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e2caa8c-7785-441a-9157-7b00e70852f6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:08.592635 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e2caa8c-7785-441a-9157-7b00e70852f6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:08.593422 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e2caa8c-7785-441a-9157-7b00e70852f6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:08.594578 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e2caa8c-7785-441a-9157-7b00e70852f6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:08.628101 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4e2caa8c-7785-441a-9157-7b00e70852f6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052655 Dec 15 12:47:08.628758 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 570/1151] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:08 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:08.631505 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-df329bc9-a461-43f0-bd68-fe4dc728e371 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:08.632131 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-df329bc9-a461-43f0-bd68-fe4dc728e371 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:08.638509 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df329bc9-a461-43f0-bd68-fe4dc728e371 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:08.638956 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df329bc9-a461-43f0-bd68-fe4dc728e371 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:08.639742 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df329bc9-a461-43f0-bd68-fe4dc728e371 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:08.640180 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df329bc9-a461-43f0-bd68-fe4dc728e371 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:08.784531 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-df329bc9-a461-43f0-bd68-fe4dc728e371 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:08.792840 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-df329bc9-a461-43f0-bd68-fe4dc728e371 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:08.794400 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-df329bc9-a461-43f0-bd68-fe4dc728e371 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:08.795546 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-df329bc9-a461-43f0-bd68-fe4dc728e371 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.168102 Dec 15 12:47:08.796105 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 582/1152] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:08 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:47:09.185437 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a511cef6-826e-4971-bc90-c23fb1011726 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:09.186413 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a511cef6-826e-4971-bc90-c23fb1011726 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:09.192926 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a511cef6-826e-4971-bc90-c23fb1011726 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:09.193366 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a511cef6-826e-4971-bc90-c23fb1011726 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:09.194170 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a511cef6-826e-4971-bc90-c23fb1011726 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:09.194595 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a511cef6-826e-4971-bc90-c23fb1011726 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:09.222147 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a511cef6-826e-4971-bc90-c23fb1011726 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040474 Dec 15 12:47:09.222683 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 571/1153] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:09 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:09.639122 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-86ab692a-1d31-4751-9c5f-078d63f35772 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:09.640046 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-86ab692a-1d31-4751-9c5f-078d63f35772 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:09.653789 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-86ab692a-1d31-4751-9c5f-078d63f35772 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:09.654243 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-86ab692a-1d31-4751-9c5f-078d63f35772 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:09.655039 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-86ab692a-1d31-4751-9c5f-078d63f35772 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:09.655477 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-86ab692a-1d31-4751-9c5f-078d63f35772 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:09.685216 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-86ab692a-1d31-4751-9c5f-078d63f35772 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049839 Dec 15 12:47:09.685808 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 583/1154] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:09 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:09.814521 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d8bfd33d-27cd-4094-a228-b18d134ae028 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:09.815150 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d8bfd33d-27cd-4094-a228-b18d134ae028 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:09.821300 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d8bfd33d-27cd-4094-a228-b18d134ae028 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:09.821778 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d8bfd33d-27cd-4094-a228-b18d134ae028 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:09.822542 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d8bfd33d-27cd-4094-a228-b18d134ae028 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:09.822968 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d8bfd33d-27cd-4094-a228-b18d134ae028 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:09.957241 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d8bfd33d-27cd-4094-a228-b18d134ae028 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:09.966069 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d8bfd33d-27cd-4094-a228-b18d134ae028 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:09.967567 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d8bfd33d-27cd-4094-a228-b18d134ae028 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:09.968708 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d8bfd33d-27cd-4094-a228-b18d134ae028 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.158587 Dec 15 12:47:09.969244 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 572/1155] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:09 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:10.233801 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e427ea8f-57b7-4718-a31e-bc37afd151e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:10.234706 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e427ea8f-57b7-4718-a31e-bc37afd151e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:10.241191 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e427ea8f-57b7-4718-a31e-bc37afd151e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:10.241677 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e427ea8f-57b7-4718-a31e-bc37afd151e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:10.242443 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e427ea8f-57b7-4718-a31e-bc37afd151e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:10.242874 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e427ea8f-57b7-4718-a31e-bc37afd151e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:10.272551 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e427ea8f-57b7-4718-a31e-bc37afd151e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042398 Dec 15 12:47:10.273145 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 584/1156] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:10 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:10.697152 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-508ff99c-4d8c-49c3-a0bb-ec888057d801 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:10.698123 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-508ff99c-4d8c-49c3-a0bb-ec888057d801 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:10.705653 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-508ff99c-4d8c-49c3-a0bb-ec888057d801 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:10.706113 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-508ff99c-4d8c-49c3-a0bb-ec888057d801 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:10.706926 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-508ff99c-4d8c-49c3-a0bb-ec888057d801 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:10.707359 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-508ff99c-4d8c-49c3-a0bb-ec888057d801 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:10.742691 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-508ff99c-4d8c-49c3-a0bb-ec888057d801 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049325 Dec 15 12:47:10.743268 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 573/1157] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:10 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:10.986813 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e9f446ea-aa63-4ceb-8194-0eaec8b535df tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:10.987342 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e9f446ea-aa63-4ceb-8194-0eaec8b535df tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:10.993638 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e9f446ea-aa63-4ceb-8194-0eaec8b535df tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:10.994085 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e9f446ea-aa63-4ceb-8194-0eaec8b535df tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:10.994865 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e9f446ea-aa63-4ceb-8194-0eaec8b535df tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:10.995299 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e9f446ea-aa63-4ceb-8194-0eaec8b535df tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:11.132892 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e9f446ea-aa63-4ceb-8194-0eaec8b535df tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:11.141065 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e9f446ea-aa63-4ceb-8194-0eaec8b535df tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:11.143223 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e9f446ea-aa63-4ceb-8194-0eaec8b535df tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:11.144388 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e9f446ea-aa63-4ceb-8194-0eaec8b535df tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.161405 Dec 15 12:47:11.145111 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 585/1158] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:10 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:11.284094 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-320fab45-5f9e-468e-a563-62c38b5fe8dd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:11.284910 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-320fab45-5f9e-468e-a563-62c38b5fe8dd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:11.291728 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-320fab45-5f9e-468e-a563-62c38b5fe8dd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:11.292169 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-320fab45-5f9e-468e-a563-62c38b5fe8dd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:11.292953 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-320fab45-5f9e-468e-a563-62c38b5fe8dd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:11.293379 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-320fab45-5f9e-468e-a563-62c38b5fe8dd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:11.326958 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-320fab45-5f9e-468e-a563-62c38b5fe8dd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046697 Dec 15 12:47:11.327524 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 574/1159] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:11 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:11.754121 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-65941cc8-8c4f-4673-b5a5-47af0cf4a5b4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:11.755304 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-65941cc8-8c4f-4673-b5a5-47af0cf4a5b4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:11.761153 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-65941cc8-8c4f-4673-b5a5-47af0cf4a5b4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:11.761616 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-65941cc8-8c4f-4673-b5a5-47af0cf4a5b4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:11.762383 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-65941cc8-8c4f-4673-b5a5-47af0cf4a5b4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:11.762808 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-65941cc8-8c4f-4673-b5a5-47af0cf4a5b4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:11.792870 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-65941cc8-8c4f-4673-b5a5-47af0cf4a5b4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042414 Dec 15 12:47:11.793429 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 586/1160] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:11 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:12.164714 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-24952d5c-d343-4994-ba0b-2a94e90f3699 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:12.165319 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-24952d5c-d343-4994-ba0b-2a94e90f3699 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:12.171332 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-24952d5c-d343-4994-ba0b-2a94e90f3699 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:12.171775 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-24952d5c-d343-4994-ba0b-2a94e90f3699 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:12.172561 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-24952d5c-d343-4994-ba0b-2a94e90f3699 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:12.173146 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-24952d5c-d343-4994-ba0b-2a94e90f3699 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:12.312301 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-24952d5c-d343-4994-ba0b-2a94e90f3699 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:12.320947 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-24952d5c-d343-4994-ba0b-2a94e90f3699 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:12.322457 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-24952d5c-d343-4994-ba0b-2a94e90f3699 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:12.323607 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-24952d5c-d343-4994-ba0b-2a94e90f3699 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.162612 Dec 15 12:47:12.324158 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 575/1161] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:12 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:12.339138 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-83a66b7c-fdab-4c31-a5fd-edeb16f6804a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:12.340222 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-83a66b7c-fdab-4c31-a5fd-edeb16f6804a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:12.347388 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-83a66b7c-fdab-4c31-a5fd-edeb16f6804a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:12.347830 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-83a66b7c-fdab-4c31-a5fd-edeb16f6804a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:12.348611 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-83a66b7c-fdab-4c31-a5fd-edeb16f6804a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:12.349058 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-83a66b7c-fdab-4c31-a5fd-edeb16f6804a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:12.382898 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-83a66b7c-fdab-4c31-a5fd-edeb16f6804a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048222 Dec 15 12:47:12.383464 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 587/1162] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:12 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:12.804369 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4c3bd3ed-8531-4be5-a69c-b802810c8cd4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:12.805269 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4c3bd3ed-8531-4be5-a69c-b802810c8cd4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:12.811129 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4c3bd3ed-8531-4be5-a69c-b802810c8cd4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:12.811566 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4c3bd3ed-8531-4be5-a69c-b802810c8cd4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:12.812326 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4c3bd3ed-8531-4be5-a69c-b802810c8cd4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:12.812754 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4c3bd3ed-8531-4be5-a69c-b802810c8cd4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:12.842774 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4c3bd3ed-8531-4be5-a69c-b802810c8cd4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042044 Dec 15 12:47:12.843322 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 576/1163] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:12 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:13.342205 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a55b4b5f-2b8e-45a3-a4fa-f24f7bc1fcbe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:13.342843 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a55b4b5f-2b8e-45a3-a4fa-f24f7bc1fcbe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:13.349283 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a55b4b5f-2b8e-45a3-a4fa-f24f7bc1fcbe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:13.349768 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a55b4b5f-2b8e-45a3-a4fa-f24f7bc1fcbe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:13.350560 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a55b4b5f-2b8e-45a3-a4fa-f24f7bc1fcbe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:13.350995 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a55b4b5f-2b8e-45a3-a4fa-f24f7bc1fcbe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:13.395948 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f3823085-185b-4556-8888-647dbc49c183 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:13.397018 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f3823085-185b-4556-8888-647dbc49c183 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:13.403868 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f3823085-185b-4556-8888-647dbc49c183 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:13.405154 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f3823085-185b-4556-8888-647dbc49c183 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:13.405303 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f3823085-185b-4556-8888-647dbc49c183 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:13.405654 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f3823085-185b-4556-8888-647dbc49c183 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:13.437014 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f3823085-185b-4556-8888-647dbc49c183 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045889 Dec 15 12:47:13.437612 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 577/1164] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:13 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:47:13.502655 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a55b4b5f-2b8e-45a3-a4fa-f24f7bc1fcbe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:13.511373 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a55b4b5f-2b8e-45a3-a4fa-f24f7bc1fcbe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:13.512840 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a55b4b5f-2b8e-45a3-a4fa-f24f7bc1fcbe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:13.514015 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a55b4b5f-2b8e-45a3-a4fa-f24f7bc1fcbe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.175612 Dec 15 12:47:13.514574 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 588/1165] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:13 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:13.855066 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1a8783d1-6f3a-4a36-b686-1638f2f668e4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:13.855880 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1a8783d1-6f3a-4a36-b686-1638f2f668e4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:13.862551 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1a8783d1-6f3a-4a36-b686-1638f2f668e4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:13.862989 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1a8783d1-6f3a-4a36-b686-1638f2f668e4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:13.863823 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1a8783d1-6f3a-4a36-b686-1638f2f668e4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:13.864251 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1a8783d1-6f3a-4a36-b686-1638f2f668e4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:13.897015 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1a8783d1-6f3a-4a36-b686-1638f2f668e4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045665 Dec 15 12:47:13.897631 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 578/1166] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:13 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:14.449601 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-230218f3-6c94-4c12-99de-258dd85c00d1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:14.450677 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-230218f3-6c94-4c12-99de-258dd85c00d1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:14.457615 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-230218f3-6c94-4c12-99de-258dd85c00d1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:14.458067 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-230218f3-6c94-4c12-99de-258dd85c00d1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:14.458866 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-230218f3-6c94-4c12-99de-258dd85c00d1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:14.459302 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-230218f3-6c94-4c12-99de-258dd85c00d1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:14.489872 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-230218f3-6c94-4c12-99de-258dd85c00d1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044029 Dec 15 12:47:14.490456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 589/1167] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:14 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:14.532902 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2a9fe067-ce1a-4ae1-8f3b-67150fe6e8a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:14.534189 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2a9fe067-ce1a-4ae1-8f3b-67150fe6e8a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:14.540562 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2a9fe067-ce1a-4ae1-8f3b-67150fe6e8a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:14.541169 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2a9fe067-ce1a-4ae1-8f3b-67150fe6e8a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:14.542000 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2a9fe067-ce1a-4ae1-8f3b-67150fe6e8a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:14.542432 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2a9fe067-ce1a-4ae1-8f3b-67150fe6e8a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:14.682003 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2a9fe067-ce1a-4ae1-8f3b-67150fe6e8a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:14.691484 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2a9fe067-ce1a-4ae1-8f3b-67150fe6e8a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:14.692994 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2a9fe067-ce1a-4ae1-8f3b-67150fe6e8a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:14.694194 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2a9fe067-ce1a-4ae1-8f3b-67150fe6e8a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.165684 Dec 15 12:47:14.694743 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 579/1168] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:14 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:14.908710 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6e54ba64-71fd-4192-bf14-f912f302b3e7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:14.909764 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6e54ba64-71fd-4192-bf14-f912f302b3e7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:14.915966 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e54ba64-71fd-4192-bf14-f912f302b3e7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:14.916422 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e54ba64-71fd-4192-bf14-f912f302b3e7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:14.917217 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e54ba64-71fd-4192-bf14-f912f302b3e7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:14.917681 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e54ba64-71fd-4192-bf14-f912f302b3e7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:14.947575 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6e54ba64-71fd-4192-bf14-f912f302b3e7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042786 Dec 15 12:47:14.948132 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 590/1169] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:14 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:15.501701 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d23f50ef-8bfb-438d-9a1c-f3a9d06620db tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:15.502620 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d23f50ef-8bfb-438d-9a1c-f3a9d06620db tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:15.508707 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d23f50ef-8bfb-438d-9a1c-f3a9d06620db tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:15.509150 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d23f50ef-8bfb-438d-9a1c-f3a9d06620db tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:15.509970 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d23f50ef-8bfb-438d-9a1c-f3a9d06620db tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:15.510408 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d23f50ef-8bfb-438d-9a1c-f3a9d06620db tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:15.541436 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d23f50ef-8bfb-438d-9a1c-f3a9d06620db tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043566 Dec 15 12:47:15.545177 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 580/1170] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:15 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:15.721187 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6c4d3580-4c62-4fd5-9860-5f9828da6410 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:15.721847 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6c4d3580-4c62-4fd5-9860-5f9828da6410 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:15.727990 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c4d3580-4c62-4fd5-9860-5f9828da6410 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:15.728426 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c4d3580-4c62-4fd5-9860-5f9828da6410 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:15.729188 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c4d3580-4c62-4fd5-9860-5f9828da6410 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:15.729645 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c4d3580-4c62-4fd5-9860-5f9828da6410 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:15.871375 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6c4d3580-4c62-4fd5-9860-5f9828da6410 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:15.879723 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6c4d3580-4c62-4fd5-9860-5f9828da6410 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:15.881458 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6c4d3580-4c62-4fd5-9860-5f9828da6410 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:15.882624 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6c4d3580-4c62-4fd5-9860-5f9828da6410 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.165687 Dec 15 12:47:15.883175 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 591/1171] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:15 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:15.959757 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-216cf2e5-572e-4e83-9a31-c151c4b1acb1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:15.960797 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-216cf2e5-572e-4e83-9a31-c151c4b1acb1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:15.966827 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-216cf2e5-572e-4e83-9a31-c151c4b1acb1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:15.967267 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-216cf2e5-572e-4e83-9a31-c151c4b1acb1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:15.968035 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-216cf2e5-572e-4e83-9a31-c151c4b1acb1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:15.968462 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-216cf2e5-572e-4e83-9a31-c151c4b1acb1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:15.998811 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-216cf2e5-572e-4e83-9a31-c151c4b1acb1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042764 Dec 15 12:47:15.999386 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 581/1172] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:15 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:47:16.553535 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1b64420d-068d-4a59-9930-5cdb13b22edc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:16.554366 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1b64420d-068d-4a59-9930-5cdb13b22edc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:16.560139 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1b64420d-068d-4a59-9930-5cdb13b22edc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:16.560563 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1b64420d-068d-4a59-9930-5cdb13b22edc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:16.561329 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1b64420d-068d-4a59-9930-5cdb13b22edc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:16.561791 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1b64420d-068d-4a59-9930-5cdb13b22edc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:16.593275 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1b64420d-068d-4a59-9930-5cdb13b22edc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043699 Dec 15 12:47:16.593850 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 592/1173] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:16 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:16.901064 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a3e11312-1278-49af-82d7-aae11bba751e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:16.901676 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a3e11312-1278-49af-82d7-aae11bba751e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:16.908498 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a3e11312-1278-49af-82d7-aae11bba751e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:16.908940 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a3e11312-1278-49af-82d7-aae11bba751e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:16.909998 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a3e11312-1278-49af-82d7-aae11bba751e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:16.910438 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a3e11312-1278-49af-82d7-aae11bba751e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:17.010940 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f86eef69-2f45-40e7-b515-4d6352e33d4e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:17.011983 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f86eef69-2f45-40e7-b515-4d6352e33d4e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:17.018980 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f86eef69-2f45-40e7-b515-4d6352e33d4e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:17.019422 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f86eef69-2f45-40e7-b515-4d6352e33d4e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:17.020210 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f86eef69-2f45-40e7-b515-4d6352e33d4e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:17.020645 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f86eef69-2f45-40e7-b515-4d6352e33d4e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:17.040649 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a3e11312-1278-49af-82d7-aae11bba751e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:17.049936 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a3e11312-1278-49af-82d7-aae11bba751e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:17.051599 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a3e11312-1278-49af-82d7-aae11bba751e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:17.052819 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a3e11312-1278-49af-82d7-aae11bba751e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.155472 Dec 15 12:47:17.053476 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 582/1174] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:16 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:17.055775 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f86eef69-2f45-40e7-b515-4d6352e33d4e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048671 Dec 15 12:47:17.056375 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 593/1175] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:17 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:47:17.604765 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f0dfd856-1fb2-467a-b2f8-11407b3f8a7d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:17.605658 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f0dfd856-1fb2-467a-b2f8-11407b3f8a7d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:17.612226 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f0dfd856-1fb2-467a-b2f8-11407b3f8a7d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:17.612696 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f0dfd856-1fb2-467a-b2f8-11407b3f8a7d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:17.613466 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f0dfd856-1fb2-467a-b2f8-11407b3f8a7d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:17.613955 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f0dfd856-1fb2-467a-b2f8-11407b3f8a7d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:17.645258 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f0dfd856-1fb2-467a-b2f8-11407b3f8a7d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044277 Dec 15 12:47:17.645846 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 583/1176] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:17 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:18.067994 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-52989dc1-dd00-4a14-9d9d-a0ac87013a70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:18.068949 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-52989dc1-dd00-4a14-9d9d-a0ac87013a70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:18.071206 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1cc3b845-384e-481d-8fca-5711bf2176e3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:18.071815 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1cc3b845-384e-481d-8fca-5711bf2176e3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:18.075394 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-52989dc1-dd00-4a14-9d9d-a0ac87013a70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:18.075845 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-52989dc1-dd00-4a14-9d9d-a0ac87013a70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:18.076641 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-52989dc1-dd00-4a14-9d9d-a0ac87013a70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:18.077079 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-52989dc1-dd00-4a14-9d9d-a0ac87013a70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:18.078576 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1cc3b845-384e-481d-8fca-5711bf2176e3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:18.079505 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1cc3b845-384e-481d-8fca-5711bf2176e3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:18.080282 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1cc3b845-384e-481d-8fca-5711bf2176e3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:18.080708 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1cc3b845-384e-481d-8fca-5711bf2176e3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:18.114901 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-52989dc1-dd00-4a14-9d9d-a0ac87013a70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050759 Dec 15 12:47:18.115477 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 594/1177] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:18 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:18.217396 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1cc3b845-384e-481d-8fca-5711bf2176e3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:18.226329 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1cc3b845-384e-481d-8fca-5711bf2176e3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:18.227814 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1cc3b845-384e-481d-8fca-5711bf2176e3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:18.228970 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1cc3b845-384e-481d-8fca-5711bf2176e3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.161376 Dec 15 12:47:18.229557 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 584/1178] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:18 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:47:18.657923 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-eb3d4740-eb34-4941-a8d8-9aba0f05cdc1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:18.658837 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-eb3d4740-eb34-4941-a8d8-9aba0f05cdc1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:18.664762 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eb3d4740-eb34-4941-a8d8-9aba0f05cdc1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:18.665244 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eb3d4740-eb34-4941-a8d8-9aba0f05cdc1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:18.666132 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eb3d4740-eb34-4941-a8d8-9aba0f05cdc1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:18.666573 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eb3d4740-eb34-4941-a8d8-9aba0f05cdc1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:18.701446 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-eb3d4740-eb34-4941-a8d8-9aba0f05cdc1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047167 Dec 15 12:47:18.702377 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 595/1179] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:18 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:19.127245 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a3a4ad39-3697-49fb-989b-4b4cbd0a1289 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:19.128513 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a3a4ad39-3697-49fb-989b-4b4cbd0a1289 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:19.137534 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a3a4ad39-3697-49fb-989b-4b4cbd0a1289 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:19.138246 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a3a4ad39-3697-49fb-989b-4b4cbd0a1289 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:19.139747 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a3a4ad39-3697-49fb-989b-4b4cbd0a1289 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:19.140421 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a3a4ad39-3697-49fb-989b-4b4cbd0a1289 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:19.180927 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a3a4ad39-3697-49fb-989b-4b4cbd0a1289 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058213 Dec 15 12:47:19.181810 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 585/1180] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:19 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:19.247278 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f0d0e0da-dbaa-420b-923c-3f7c0a2f18ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:19.248194 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f0d0e0da-dbaa-420b-923c-3f7c0a2f18ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:19.254767 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f0d0e0da-dbaa-420b-923c-3f7c0a2f18ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:19.255457 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f0d0e0da-dbaa-420b-923c-3f7c0a2f18ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:19.256231 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f0d0e0da-dbaa-420b-923c-3f7c0a2f18ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:19.256660 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f0d0e0da-dbaa-420b-923c-3f7c0a2f18ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:19.401584 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f0d0e0da-dbaa-420b-923c-3f7c0a2f18ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:19.411953 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f0d0e0da-dbaa-420b-923c-3f7c0a2f18ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:19.415105 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f0d0e0da-dbaa-420b-923c-3f7c0a2f18ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:19.417401 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f0d0e0da-dbaa-420b-923c-3f7c0a2f18ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.173707 Dec 15 12:47:19.418434 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 596/1181] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:19 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:19.714324 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c0da57f6-92d7-4c50-b6fc-c22822436e4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:19.715238 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c0da57f6-92d7-4c50-b6fc-c22822436e4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:19.721840 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c0da57f6-92d7-4c50-b6fc-c22822436e4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:19.722281 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c0da57f6-92d7-4c50-b6fc-c22822436e4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:19.723057 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c0da57f6-92d7-4c50-b6fc-c22822436e4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:19.723483 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c0da57f6-92d7-4c50-b6fc-c22822436e4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:19.752563 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c0da57f6-92d7-4c50-b6fc-c22822436e4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042140 Dec 15 12:47:19.753106 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 586/1182] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:19 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:20.193268 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-83f684cd-b4a8-4fa3-9921-c9d50c64470e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:20.194612 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-83f684cd-b4a8-4fa3-9921-c9d50c64470e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:20.200526 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-83f684cd-b4a8-4fa3-9921-c9d50c64470e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:20.200967 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-83f684cd-b4a8-4fa3-9921-c9d50c64470e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:20.201769 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-83f684cd-b4a8-4fa3-9921-c9d50c64470e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:20.202270 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-83f684cd-b4a8-4fa3-9921-c9d50c64470e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:20.240142 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-83f684cd-b4a8-4fa3-9921-c9d50c64470e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050626 Dec 15 12:47:20.240732 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 597/1183] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:20 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:47:20.436434 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a7a1a40a-2486-4303-84ea-5724c54fefb4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:20.437059 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a7a1a40a-2486-4303-84ea-5724c54fefb4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:20.444307 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a7a1a40a-2486-4303-84ea-5724c54fefb4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:20.444715 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a7a1a40a-2486-4303-84ea-5724c54fefb4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:20.445528 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a7a1a40a-2486-4303-84ea-5724c54fefb4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:20.445957 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a7a1a40a-2486-4303-84ea-5724c54fefb4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:20.598388 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a7a1a40a-2486-4303-84ea-5724c54fefb4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:20.609063 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a7a1a40a-2486-4303-84ea-5724c54fefb4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:20.611158 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a7a1a40a-2486-4303-84ea-5724c54fefb4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:20.612351 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a7a1a40a-2486-4303-84ea-5724c54fefb4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.180027 Dec 15 12:47:20.612882 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 587/1184] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:20 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:20.764709 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7d33fea1-d3fb-4793-a329-761e22ed2973 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:20.765573 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7d33fea1-d3fb-4793-a329-761e22ed2973 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:20.773866 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7d33fea1-d3fb-4793-a329-761e22ed2973 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:20.774319 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7d33fea1-d3fb-4793-a329-761e22ed2973 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:20.775110 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7d33fea1-d3fb-4793-a329-761e22ed2973 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:20.775574 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7d33fea1-d3fb-4793-a329-761e22ed2973 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:20.812841 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7d33fea1-d3fb-4793-a329-761e22ed2973 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051944 Dec 15 12:47:20.813419 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 598/1185] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:20 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:21.252226 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e7a409e3-c649-47af-a171-16e5cd13dd21 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:21.253171 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e7a409e3-c649-47af-a171-16e5cd13dd21 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:21.259307 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e7a409e3-c649-47af-a171-16e5cd13dd21 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:21.259755 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e7a409e3-c649-47af-a171-16e5cd13dd21 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:21.260575 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e7a409e3-c649-47af-a171-16e5cd13dd21 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:21.261021 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e7a409e3-c649-47af-a171-16e5cd13dd21 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:21.293048 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e7a409e3-c649-47af-a171-16e5cd13dd21 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044977 Dec 15 12:47:21.294225 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 588/1186] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:21 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:21.631399 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f4d762d0-e62a-45d6-b035-df97a40c8516 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:21.632024 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f4d762d0-e62a-45d6-b035-df97a40c8516 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:21.638406 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4d762d0-e62a-45d6-b035-df97a40c8516 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:21.638948 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4d762d0-e62a-45d6-b035-df97a40c8516 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:21.639932 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4d762d0-e62a-45d6-b035-df97a40c8516 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:21.640359 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4d762d0-e62a-45d6-b035-df97a40c8516 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:21.775718 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f4d762d0-e62a-45d6-b035-df97a40c8516 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:21.783923 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f4d762d0-e62a-45d6-b035-df97a40c8516 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:21.785421 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f4d762d0-e62a-45d6-b035-df97a40c8516 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:21.786642 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f4d762d0-e62a-45d6-b035-df97a40c8516 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.159240 Dec 15 12:47:21.787192 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 599/1187] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:21 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:47:21.824466 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ad841952-e7ee-4e2a-aa1f-a84581967aa1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:21.825386 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ad841952-e7ee-4e2a-aa1f-a84581967aa1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:21.832230 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad841952-e7ee-4e2a-aa1f-a84581967aa1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:21.832711 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad841952-e7ee-4e2a-aa1f-a84581967aa1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:21.833500 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad841952-e7ee-4e2a-aa1f-a84581967aa1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:21.833950 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad841952-e7ee-4e2a-aa1f-a84581967aa1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:21.866053 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ad841952-e7ee-4e2a-aa1f-a84581967aa1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045229 Dec 15 12:47:21.866522 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 589/1188] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:21 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:22.305765 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f248441d-cb1c-49d0-a64d-642a42b485d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:22.306682 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f248441d-cb1c-49d0-a64d-642a42b485d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:22.312834 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f248441d-cb1c-49d0-a64d-642a42b485d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:22.313392 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f248441d-cb1c-49d0-a64d-642a42b485d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:22.314258 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f248441d-cb1c-49d0-a64d-642a42b485d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:22.314704 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f248441d-cb1c-49d0-a64d-642a42b485d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:22.345235 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f248441d-cb1c-49d0-a64d-642a42b485d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042812 Dec 15 12:47:22.348971 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 600/1189] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:22 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:22.804980 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-719c8d26-34f5-40a1-812e-6a8e5d1fbc9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:22.805634 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-719c8d26-34f5-40a1-812e-6a8e5d1fbc9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:22.811544 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-719c8d26-34f5-40a1-812e-6a8e5d1fbc9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:22.811980 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-719c8d26-34f5-40a1-812e-6a8e5d1fbc9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:22.812748 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-719c8d26-34f5-40a1-812e-6a8e5d1fbc9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:22.813172 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-719c8d26-34f5-40a1-812e-6a8e5d1fbc9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:22.878527 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-412cee52-ff1c-41d8-985c-2102d738cc64 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:22.879433 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-412cee52-ff1c-41d8-985c-2102d738cc64 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:22.886316 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-412cee52-ff1c-41d8-985c-2102d738cc64 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:22.886757 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-412cee52-ff1c-41d8-985c-2102d738cc64 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:22.887557 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-412cee52-ff1c-41d8-985c-2102d738cc64 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:22.887989 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-412cee52-ff1c-41d8-985c-2102d738cc64 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:22.929521 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-412cee52-ff1c-41d8-985c-2102d738cc64 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055661 Dec 15 12:47:22.930228 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 601/1190] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:22 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:47:22.950788 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-719c8d26-34f5-40a1-812e-6a8e5d1fbc9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:22.959974 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-719c8d26-34f5-40a1-812e-6a8e5d1fbc9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:22.961381 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-719c8d26-34f5-40a1-812e-6a8e5d1fbc9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:22.962592 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-719c8d26-34f5-40a1-812e-6a8e5d1fbc9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.161438 Dec 15 12:47:22.963133 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 590/1191] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:22 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:23.356698 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4cf69572-2594-4a81-b87a-baff1dd3a19b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:23.357677 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4cf69572-2594-4a81-b87a-baff1dd3a19b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:23.364488 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4cf69572-2594-4a81-b87a-baff1dd3a19b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:23.364951 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4cf69572-2594-4a81-b87a-baff1dd3a19b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:23.365776 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4cf69572-2594-4a81-b87a-baff1dd3a19b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:23.366205 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4cf69572-2594-4a81-b87a-baff1dd3a19b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:23.397030 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4cf69572-2594-4a81-b87a-baff1dd3a19b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044123 Dec 15 12:47:23.397620 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 602/1192] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:23 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:23.941078 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-af11b180-6a1e-4fc0-ab5b-0f6ae0be9972 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:23.942044 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-af11b180-6a1e-4fc0-ab5b-0f6ae0be9972 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:23.948492 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-af11b180-6a1e-4fc0-ab5b-0f6ae0be9972 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:23.948939 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-af11b180-6a1e-4fc0-ab5b-0f6ae0be9972 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:23.949743 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-af11b180-6a1e-4fc0-ab5b-0f6ae0be9972 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:23.950171 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-af11b180-6a1e-4fc0-ab5b-0f6ae0be9972 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:23.979122 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-af11b180-6a1e-4fc0-ab5b-0f6ae0be9972 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041746 Dec 15 12:47:23.979795 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 591/1193] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:23 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:23.980286 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-94554623-80fc-463a-b9c8-31a17802c470 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:23.981010 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-94554623-80fc-463a-b9c8-31a17802c470 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:23.988331 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-94554623-80fc-463a-b9c8-31a17802c470 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:23.988786 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-94554623-80fc-463a-b9c8-31a17802c470 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:23.989606 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-94554623-80fc-463a-b9c8-31a17802c470 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:23.990047 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-94554623-80fc-463a-b9c8-31a17802c470 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:24.120019 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-94554623-80fc-463a-b9c8-31a17802c470 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:24.128153 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-94554623-80fc-463a-b9c8-31a17802c470 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:24.129649 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-94554623-80fc-463a-b9c8-31a17802c470 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:24.131049 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-94554623-80fc-463a-b9c8-31a17802c470 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.154774 Dec 15 12:47:24.131597 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 603/1194] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:23 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:47:24.409121 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d1063e7e-c994-4257-b22d-da509737d31d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:24.410069 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d1063e7e-c994-4257-b22d-da509737d31d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:24.415857 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d1063e7e-c994-4257-b22d-da509737d31d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:24.416294 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d1063e7e-c994-4257-b22d-da509737d31d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:24.417062 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d1063e7e-c994-4257-b22d-da509737d31d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:24.417485 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d1063e7e-c994-4257-b22d-da509737d31d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:24.449350 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d1063e7e-c994-4257-b22d-da509737d31d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044527 Dec 15 12:47:24.449980 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 592/1195] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:24 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:24.991488 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-03cb7804-48dc-4ea7-aff8-a201bc28b2a3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:24.992401 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-03cb7804-48dc-4ea7-aff8-a201bc28b2a3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:24.998662 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-03cb7804-48dc-4ea7-aff8-a201bc28b2a3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:24.999110 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-03cb7804-48dc-4ea7-aff8-a201bc28b2a3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:24.999874 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-03cb7804-48dc-4ea7-aff8-a201bc28b2a3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:25.000301 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-03cb7804-48dc-4ea7-aff8-a201bc28b2a3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:25.030665 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-03cb7804-48dc-4ea7-aff8-a201bc28b2a3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042840 Dec 15 12:47:25.031232 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 604/1196] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:24 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:25.149965 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c69f84e8-c100-410e-81a6-bbcf7bdb9ddc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:25.150586 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c69f84e8-c100-410e-81a6-bbcf7bdb9ddc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:25.156838 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c69f84e8-c100-410e-81a6-bbcf7bdb9ddc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:25.158468 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c69f84e8-c100-410e-81a6-bbcf7bdb9ddc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:25.159299 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c69f84e8-c100-410e-81a6-bbcf7bdb9ddc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:25.159805 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c69f84e8-c100-410e-81a6-bbcf7bdb9ddc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:25.297861 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c69f84e8-c100-410e-81a6-bbcf7bdb9ddc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:25.306550 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c69f84e8-c100-410e-81a6-bbcf7bdb9ddc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:25.308101 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c69f84e8-c100-410e-81a6-bbcf7bdb9ddc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:25.309330 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c69f84e8-c100-410e-81a6-bbcf7bdb9ddc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.163168 Dec 15 12:47:25.309909 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 593/1197] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:25 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:25.460323 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-596d3e1d-05ae-4a18-8630-f0e142dd5c55 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:25.461146 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-596d3e1d-05ae-4a18-8630-f0e142dd5c55 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:25.467142 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-596d3e1d-05ae-4a18-8630-f0e142dd5c55 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:25.467584 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-596d3e1d-05ae-4a18-8630-f0e142dd5c55 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:25.468365 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-596d3e1d-05ae-4a18-8630-f0e142dd5c55 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:25.468800 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-596d3e1d-05ae-4a18-8630-f0e142dd5c55 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:25.507910 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-596d3e1d-05ae-4a18-8630-f0e142dd5c55 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051355 Dec 15 12:47:25.508481 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 605/1198] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:25 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:26.042121 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c7f072df-ccd9-44aa-9d3d-2719d2d06f7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:26.043072 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c7f072df-ccd9-44aa-9d3d-2719d2d06f7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:26.049199 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c7f072df-ccd9-44aa-9d3d-2719d2d06f7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:26.049695 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c7f072df-ccd9-44aa-9d3d-2719d2d06f7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:26.050486 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c7f072df-ccd9-44aa-9d3d-2719d2d06f7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:26.050928 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c7f072df-ccd9-44aa-9d3d-2719d2d06f7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:26.082197 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c7f072df-ccd9-44aa-9d3d-2719d2d06f7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043791 Dec 15 12:47:26.082759 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 594/1199] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:26 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:26.328607 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9ebded6c-b74b-4c08-96c3-1f88ac1af068 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:26.329897 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9ebded6c-b74b-4c08-96c3-1f88ac1af068 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:26.336222 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9ebded6c-b74b-4c08-96c3-1f88ac1af068 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:26.336663 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9ebded6c-b74b-4c08-96c3-1f88ac1af068 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:26.337436 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9ebded6c-b74b-4c08-96c3-1f88ac1af068 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:26.337888 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9ebded6c-b74b-4c08-96c3-1f88ac1af068 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:26.474874 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9ebded6c-b74b-4c08-96c3-1f88ac1af068 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:26.483787 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9ebded6c-b74b-4c08-96c3-1f88ac1af068 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:26.485850 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9ebded6c-b74b-4c08-96c3-1f88ac1af068 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:26.487118 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9ebded6c-b74b-4c08-96c3-1f88ac1af068 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.162873 Dec 15 12:47:26.487691 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 606/1200] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:26 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:26.519602 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ca68d92b-6286-486c-a733-fa9174ab48c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:26.520509 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ca68d92b-6286-486c-a733-fa9174ab48c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:26.526825 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ca68d92b-6286-486c-a733-fa9174ab48c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:26.527269 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ca68d92b-6286-486c-a733-fa9174ab48c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:26.528144 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ca68d92b-6286-486c-a733-fa9174ab48c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:26.528588 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ca68d92b-6286-486c-a733-fa9174ab48c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:26.560717 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ca68d92b-6286-486c-a733-fa9174ab48c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044951 Dec 15 12:47:26.561300 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 595/1201] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:26 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:27.093805 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-268148d2-2c9c-4e27-a85a-4d73f0cbb855 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:27.095514 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-268148d2-2c9c-4e27-a85a-4d73f0cbb855 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:27.107460 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-268148d2-2c9c-4e27-a85a-4d73f0cbb855 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:27.107910 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-268148d2-2c9c-4e27-a85a-4d73f0cbb855 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:27.108714 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-268148d2-2c9c-4e27-a85a-4d73f0cbb855 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:27.109147 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-268148d2-2c9c-4e27-a85a-4d73f0cbb855 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:27.140833 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-268148d2-2c9c-4e27-a85a-4d73f0cbb855 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050731 Dec 15 12:47:27.142010 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 607/1202] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:27 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:27.506099 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1bbbd91b-cbe4-44a6-93c8-b2c00fa9643c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:27.506699 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1bbbd91b-cbe4-44a6-93c8-b2c00fa9643c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:27.512578 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1bbbd91b-cbe4-44a6-93c8-b2c00fa9643c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:27.513081 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1bbbd91b-cbe4-44a6-93c8-b2c00fa9643c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:27.513890 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1bbbd91b-cbe4-44a6-93c8-b2c00fa9643c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:27.514316 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1bbbd91b-cbe4-44a6-93c8-b2c00fa9643c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:27.572144 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-896d9877-49b5-4f5c-94b5-326a76eab326 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:27.573113 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-896d9877-49b5-4f5c-94b5-326a76eab326 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:27.580454 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-896d9877-49b5-4f5c-94b5-326a76eab326 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:27.581658 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-896d9877-49b5-4f5c-94b5-326a76eab326 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:27.581762 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-896d9877-49b5-4f5c-94b5-326a76eab326 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:27.582236 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-896d9877-49b5-4f5c-94b5-326a76eab326 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:27.622617 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-896d9877-49b5-4f5c-94b5-326a76eab326 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054250 Dec 15 12:47:27.623347 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 608/1203] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:27 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:47:27.654183 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1bbbd91b-cbe4-44a6-93c8-b2c00fa9643c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:27.663220 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1bbbd91b-cbe4-44a6-93c8-b2c00fa9643c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:27.664607 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1bbbd91b-cbe4-44a6-93c8-b2c00fa9643c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:27.665895 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1bbbd91b-cbe4-44a6-93c8-b2c00fa9643c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.163643 Dec 15 12:47:27.666358 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 596/1204] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:27 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:28.152684 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-284966da-d2dd-4a66-adf0-314949d48b33 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:28.153646 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-284966da-d2dd-4a66-adf0-314949d48b33 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:28.160640 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-284966da-d2dd-4a66-adf0-314949d48b33 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:28.161108 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-284966da-d2dd-4a66-adf0-314949d48b33 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:28.161931 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-284966da-d2dd-4a66-adf0-314949d48b33 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:28.162355 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-284966da-d2dd-4a66-adf0-314949d48b33 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:28.191554 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-284966da-d2dd-4a66-adf0-314949d48b33 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043086 Dec 15 12:47:28.192098 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 609/1205] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:28 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:28.634509 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bae828fc-0eac-44e8-9490-e2830478ef17 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:28.635423 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bae828fc-0eac-44e8-9490-e2830478ef17 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:28.642264 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bae828fc-0eac-44e8-9490-e2830478ef17 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:28.642898 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bae828fc-0eac-44e8-9490-e2830478ef17 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:28.643691 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bae828fc-0eac-44e8-9490-e2830478ef17 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:28.644127 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bae828fc-0eac-44e8-9490-e2830478ef17 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:28.675085 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bae828fc-0eac-44e8-9490-e2830478ef17 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044571 Dec 15 12:47:28.676017 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 597/1206] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:28 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:28.691575 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fc251db1-aa9f-48bf-ab0c-7a96cdb190b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:28.692174 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fc251db1-aa9f-48bf-ab0c-7a96cdb190b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:28.698815 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fc251db1-aa9f-48bf-ab0c-7a96cdb190b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:28.699271 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fc251db1-aa9f-48bf-ab0c-7a96cdb190b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:28.700064 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fc251db1-aa9f-48bf-ab0c-7a96cdb190b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:28.700500 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fc251db1-aa9f-48bf-ab0c-7a96cdb190b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:28.835987 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-fc251db1-aa9f-48bf-ab0c-7a96cdb190b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:28.844246 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-fc251db1-aa9f-48bf-ab0c-7a96cdb190b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:28.845849 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-fc251db1-aa9f-48bf-ab0c-7a96cdb190b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:28.847007 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fc251db1-aa9f-48bf-ab0c-7a96cdb190b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.159249 Dec 15 12:47:28.847566 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 610/1207] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:28 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:47:29.203034 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-76e58cd8-b530-42f1-97a7-136dc0e7d662 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:29.203967 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-76e58cd8-b530-42f1-97a7-136dc0e7d662 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:29.209808 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-76e58cd8-b530-42f1-97a7-136dc0e7d662 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:29.210244 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-76e58cd8-b530-42f1-97a7-136dc0e7d662 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:29.211004 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-76e58cd8-b530-42f1-97a7-136dc0e7d662 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:29.211430 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-76e58cd8-b530-42f1-97a7-136dc0e7d662 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:29.241566 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-76e58cd8-b530-42f1-97a7-136dc0e7d662 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042222 Dec 15 12:47:29.242154 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 598/1208] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:29 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:29.686644 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1fba0a76-831e-4201-818b-5d31c062c399 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:29.687589 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1fba0a76-831e-4201-818b-5d31c062c399 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:29.694584 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1fba0a76-831e-4201-818b-5d31c062c399 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:29.695066 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1fba0a76-831e-4201-818b-5d31c062c399 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:29.695806 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1fba0a76-831e-4201-818b-5d31c062c399 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:29.696276 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1fba0a76-831e-4201-818b-5d31c062c399 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:29.729300 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1fba0a76-831e-4201-818b-5d31c062c399 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046098 Dec 15 12:47:29.733314 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 611/1209] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:29 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:29.865685 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4fbe1f49-83c2-4a65-a03b-f730308383d1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:29.866298 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4fbe1f49-83c2-4a65-a03b-f730308383d1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:29.875507 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4fbe1f49-83c2-4a65-a03b-f730308383d1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:29.876621 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4fbe1f49-83c2-4a65-a03b-f730308383d1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:29.877954 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4fbe1f49-83c2-4a65-a03b-f730308383d1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:29.878524 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4fbe1f49-83c2-4a65-a03b-f730308383d1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:30.015461 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4fbe1f49-83c2-4a65-a03b-f730308383d1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:30.023786 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4fbe1f49-83c2-4a65-a03b-f730308383d1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:30.025374 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4fbe1f49-83c2-4a65-a03b-f730308383d1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:30.026611 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4fbe1f49-83c2-4a65-a03b-f730308383d1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.164699 Dec 15 12:47:30.027180 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 599/1210] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:29 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:30.253811 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0c93578e-0693-4750-9ccd-ab8d38a825dc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:30.254772 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0c93578e-0693-4750-9ccd-ab8d38a825dc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:30.261044 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0c93578e-0693-4750-9ccd-ab8d38a825dc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:30.261491 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0c93578e-0693-4750-9ccd-ab8d38a825dc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:30.262309 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0c93578e-0693-4750-9ccd-ab8d38a825dc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:30.262744 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0c93578e-0693-4750-9ccd-ab8d38a825dc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:30.291920 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0c93578e-0693-4750-9ccd-ab8d38a825dc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042443 Dec 15 12:47:30.292505 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 612/1211] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:30 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:30.741633 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-254b60c2-bb69-4ca0-9be1-72730fd5f670 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:30.742544 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-254b60c2-bb69-4ca0-9be1-72730fd5f670 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:30.748645 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-254b60c2-bb69-4ca0-9be1-72730fd5f670 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:30.750038 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-254b60c2-bb69-4ca0-9be1-72730fd5f670 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:30.750038 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-254b60c2-bb69-4ca0-9be1-72730fd5f670 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:30.750465 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-254b60c2-bb69-4ca0-9be1-72730fd5f670 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:30.782538 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-254b60c2-bb69-4ca0-9be1-72730fd5f670 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043780 Dec 15 12:47:30.783239 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 600/1212] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:30 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:31.045386 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0446a592-44a1-4540-ab0e-18a6c344715c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:31.045957 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0446a592-44a1-4540-ab0e-18a6c344715c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:31.052363 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0446a592-44a1-4540-ab0e-18a6c344715c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:31.052808 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0446a592-44a1-4540-ab0e-18a6c344715c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:31.053618 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0446a592-44a1-4540-ab0e-18a6c344715c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:31.054053 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0446a592-44a1-4540-ab0e-18a6c344715c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:31.196478 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0446a592-44a1-4540-ab0e-18a6c344715c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:31.205231 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0446a592-44a1-4540-ab0e-18a6c344715c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:31.206703 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0446a592-44a1-4540-ab0e-18a6c344715c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:31.207858 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0446a592-44a1-4540-ab0e-18a6c344715c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.166254 Dec 15 12:47:31.208412 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 613/1213] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:31 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:31.308145 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-73f599b2-f97d-4836-91b9-465132793f10 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:31.309053 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-73f599b2-f97d-4836-91b9-465132793f10 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:31.315671 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-73f599b2-f97d-4836-91b9-465132793f10 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:31.316113 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-73f599b2-f97d-4836-91b9-465132793f10 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:31.316891 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-73f599b2-f97d-4836-91b9-465132793f10 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:31.317320 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-73f599b2-f97d-4836-91b9-465132793f10 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:31.349016 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-73f599b2-f97d-4836-91b9-465132793f10 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044580 Dec 15 12:47:31.349594 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 601/1214] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:31 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:31.794517 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0050d5f1-e51b-4cbc-8b57-ca4bb250492f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:31.795691 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0050d5f1-e51b-4cbc-8b57-ca4bb250492f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:31.801970 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0050d5f1-e51b-4cbc-8b57-ca4bb250492f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:31.802419 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0050d5f1-e51b-4cbc-8b57-ca4bb250492f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:31.803208 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0050d5f1-e51b-4cbc-8b57-ca4bb250492f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:31.803635 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0050d5f1-e51b-4cbc-8b57-ca4bb250492f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:31.833277 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0050d5f1-e51b-4cbc-8b57-ca4bb250492f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042582 Dec 15 12:47:31.833845 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 614/1215] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:31 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:32.225776 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b2cb8ba1-31cc-456f-bb53-06ac7a2bc4f1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:32.226410 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b2cb8ba1-31cc-456f-bb53-06ac7a2bc4f1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:32.232189 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b2cb8ba1-31cc-456f-bb53-06ac7a2bc4f1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:32.232639 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b2cb8ba1-31cc-456f-bb53-06ac7a2bc4f1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:32.233424 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b2cb8ba1-31cc-456f-bb53-06ac7a2bc4f1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:32.233884 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b2cb8ba1-31cc-456f-bb53-06ac7a2bc4f1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:32.361880 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9acae9da-9995-431b-be19-30c8fe959e30 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:32.362916 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9acae9da-9995-431b-be19-30c8fe959e30 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:32.368956 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9acae9da-9995-431b-be19-30c8fe959e30 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:32.369408 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9acae9da-9995-431b-be19-30c8fe959e30 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:32.370240 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9acae9da-9995-431b-be19-30c8fe959e30 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:32.370675 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9acae9da-9995-431b-be19-30c8fe959e30 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:32.390108 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b2cb8ba1-31cc-456f-bb53-06ac7a2bc4f1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:32.399229 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b2cb8ba1-31cc-456f-bb53-06ac7a2bc4f1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:32.400707 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b2cb8ba1-31cc-456f-bb53-06ac7a2bc4f1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:32.401898 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b2cb8ba1-31cc-456f-bb53-06ac7a2bc4f1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.179826 Dec 15 12:47:32.402515 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 602/1216] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:32 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:47:32.405055 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9acae9da-9995-431b-be19-30c8fe959e30 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048005 Dec 15 12:47:32.406028 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 615/1217] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:32 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:32.844160 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ed0956dd-9369-4073-aa29-b80b17c5925b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:32.845365 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ed0956dd-9369-4073-aa29-b80b17c5925b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:32.851517 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ed0956dd-9369-4073-aa29-b80b17c5925b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:32.851957 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ed0956dd-9369-4073-aa29-b80b17c5925b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:32.852753 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ed0956dd-9369-4073-aa29-b80b17c5925b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:32.853190 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ed0956dd-9369-4073-aa29-b80b17c5925b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:32.883924 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ed0956dd-9369-4073-aa29-b80b17c5925b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043816 Dec 15 12:47:32.884692 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 603/1218] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:32 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:33.416798 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fe96b799-80f7-4177-9d05-2f01d9a07f8b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:33.417831 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fe96b799-80f7-4177-9d05-2f01d9a07f8b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:33.421616 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b1f33ea3-d555-456a-b0ad-c162652c8dc3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:33.422280 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b1f33ea3-d555-456a-b0ad-c162652c8dc3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:33.424992 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe96b799-80f7-4177-9d05-2f01d9a07f8b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:33.425445 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe96b799-80f7-4177-9d05-2f01d9a07f8b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:33.426322 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe96b799-80f7-4177-9d05-2f01d9a07f8b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:33.426758 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe96b799-80f7-4177-9d05-2f01d9a07f8b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:33.429055 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1f33ea3-d555-456a-b0ad-c162652c8dc3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:33.429544 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1f33ea3-d555-456a-b0ad-c162652c8dc3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:33.430362 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1f33ea3-d555-456a-b0ad-c162652c8dc3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:33.430842 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1f33ea3-d555-456a-b0ad-c162652c8dc3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:33.457226 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fe96b799-80f7-4177-9d05-2f01d9a07f8b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044052 Dec 15 12:47:33.457879 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 616/1219] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:33 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:33.569306 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b1f33ea3-d555-456a-b0ad-c162652c8dc3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:33.578077 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b1f33ea3-d555-456a-b0ad-c162652c8dc3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:33.580412 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b1f33ea3-d555-456a-b0ad-c162652c8dc3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:33.582009 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b1f33ea3-d555-456a-b0ad-c162652c8dc3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.164348 Dec 15 12:47:33.582580 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 604/1220] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:33 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:47:33.895873 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a7636206-5ee9-489a-bcfb-95c99ffa5588 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:33.896752 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a7636206-5ee9-489a-bcfb-95c99ffa5588 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:33.902524 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a7636206-5ee9-489a-bcfb-95c99ffa5588 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:33.902969 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a7636206-5ee9-489a-bcfb-95c99ffa5588 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:33.903758 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a7636206-5ee9-489a-bcfb-95c99ffa5588 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:33.904188 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a7636206-5ee9-489a-bcfb-95c99ffa5588 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:33.933868 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a7636206-5ee9-489a-bcfb-95c99ffa5588 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042297 Dec 15 12:47:33.934425 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 617/1221] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:33 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:34.468807 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1b14477e-20f7-45b4-852a-a2c78af97d0c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:34.470865 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1b14477e-20f7-45b4-852a-a2c78af97d0c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:34.476571 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b14477e-20f7-45b4-852a-a2c78af97d0c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:34.477015 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b14477e-20f7-45b4-852a-a2c78af97d0c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:34.477823 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b14477e-20f7-45b4-852a-a2c78af97d0c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:34.478258 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b14477e-20f7-45b4-852a-a2c78af97d0c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:34.509084 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1b14477e-20f7-45b4-852a-a2c78af97d0c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044094 Dec 15 12:47:34.509675 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 605/1222] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:34 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:34.600772 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fda6d4cc-8587-47a4-b71a-18e84c62cdc0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:34.601374 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fda6d4cc-8587-47a4-b71a-18e84c62cdc0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:34.607760 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fda6d4cc-8587-47a4-b71a-18e84c62cdc0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:34.608208 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fda6d4cc-8587-47a4-b71a-18e84c62cdc0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:34.608987 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fda6d4cc-8587-47a4-b71a-18e84c62cdc0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:34.609421 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fda6d4cc-8587-47a4-b71a-18e84c62cdc0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:34.753626 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-fda6d4cc-8587-47a4-b71a-18e84c62cdc0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:34.762160 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-fda6d4cc-8587-47a4-b71a-18e84c62cdc0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:34.763661 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-fda6d4cc-8587-47a4-b71a-18e84c62cdc0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:34.764808 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fda6d4cc-8587-47a4-b71a-18e84c62cdc0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.167953 Dec 15 12:47:34.765364 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 618/1223] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:34 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:34.944588 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5cb0b029-1f1a-4623-9915-a2a67c7d2be5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:34.945501 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5cb0b029-1f1a-4623-9915-a2a67c7d2be5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:34.951397 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5cb0b029-1f1a-4623-9915-a2a67c7d2be5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:34.951846 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5cb0b029-1f1a-4623-9915-a2a67c7d2be5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:34.952635 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5cb0b029-1f1a-4623-9915-a2a67c7d2be5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:34.953072 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5cb0b029-1f1a-4623-9915-a2a67c7d2be5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:34.984041 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5cb0b029-1f1a-4623-9915-a2a67c7d2be5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043134 Dec 15 12:47:34.984624 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 606/1224] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:34 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:35.520776 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4fa78322-cd37-461d-a97c-8b22c94a6906 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:35.521975 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4fa78322-cd37-461d-a97c-8b22c94a6906 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:35.528140 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4fa78322-cd37-461d-a97c-8b22c94a6906 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:35.528583 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4fa78322-cd37-461d-a97c-8b22c94a6906 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:35.529351 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4fa78322-cd37-461d-a97c-8b22c94a6906 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:35.529811 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4fa78322-cd37-461d-a97c-8b22c94a6906 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:35.559591 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4fa78322-cd37-461d-a97c-8b22c94a6906 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042752 Dec 15 12:47:35.560164 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 619/1225] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:35 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:35.788970 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-04b10b6b-1bf3-4057-b8db-14eb54e56ee9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:35.789535 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-04b10b6b-1bf3-4057-b8db-14eb54e56ee9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:35.795820 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-04b10b6b-1bf3-4057-b8db-14eb54e56ee9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:35.796269 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-04b10b6b-1bf3-4057-b8db-14eb54e56ee9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:35.797044 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-04b10b6b-1bf3-4057-b8db-14eb54e56ee9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:35.798135 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-04b10b6b-1bf3-4057-b8db-14eb54e56ee9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:35.935658 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-04b10b6b-1bf3-4057-b8db-14eb54e56ee9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:35.945048 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-04b10b6b-1bf3-4057-b8db-14eb54e56ee9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:35.946339 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-04b10b6b-1bf3-4057-b8db-14eb54e56ee9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:35.947550 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-04b10b6b-1bf3-4057-b8db-14eb54e56ee9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.162518 Dec 15 12:47:35.948109 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 607/1226] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:35 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:35.995686 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-caccf404-bf8f-48e8-b93f-c0a5e80baab2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:35.996598 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-caccf404-bf8f-48e8-b93f-c0a5e80baab2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:36.003022 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-caccf404-bf8f-48e8-b93f-c0a5e80baab2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:36.003307 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-caccf404-bf8f-48e8-b93f-c0a5e80baab2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:36.004089 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-caccf404-bf8f-48e8-b93f-c0a5e80baab2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:36.004520 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-caccf404-bf8f-48e8-b93f-c0a5e80baab2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:36.037215 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-caccf404-bf8f-48e8-b93f-c0a5e80baab2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045169 Dec 15 12:47:36.038188 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 620/1227] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:35 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:36.572285 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-171dcf97-784b-4fae-80f3-06b113c623d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:36.573123 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-171dcf97-784b-4fae-80f3-06b113c623d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:36.579647 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-171dcf97-784b-4fae-80f3-06b113c623d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:36.580091 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-171dcf97-784b-4fae-80f3-06b113c623d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:36.580870 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-171dcf97-784b-4fae-80f3-06b113c623d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:36.581303 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-171dcf97-784b-4fae-80f3-06b113c623d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:36.616535 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-171dcf97-784b-4fae-80f3-06b113c623d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048066 Dec 15 12:47:36.617091 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 608/1228] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:36 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:36.965670 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-30869554-f949-4e86-a70f-3941ef1d6ebf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:36.966284 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-30869554-f949-4e86-a70f-3941ef1d6ebf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:36.972305 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-30869554-f949-4e86-a70f-3941ef1d6ebf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:36.972747 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-30869554-f949-4e86-a70f-3941ef1d6ebf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:36.973525 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-30869554-f949-4e86-a70f-3941ef1d6ebf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:36.973969 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-30869554-f949-4e86-a70f-3941ef1d6ebf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:37.049247 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7aa97452-4a54-44b6-ae1d-b88f5377974d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:37.050361 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7aa97452-4a54-44b6-ae1d-b88f5377974d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:37.056847 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7aa97452-4a54-44b6-ae1d-b88f5377974d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:37.057323 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7aa97452-4a54-44b6-ae1d-b88f5377974d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:37.058251 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7aa97452-4a54-44b6-ae1d-b88f5377974d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:37.059087 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7aa97452-4a54-44b6-ae1d-b88f5377974d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:37.090969 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7aa97452-4a54-44b6-ae1d-b88f5377974d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046531 Dec 15 12:47:37.091539 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 609/1229] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:37 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:37.123619 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-30869554-f949-4e86-a70f-3941ef1d6ebf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:37.132875 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-30869554-f949-4e86-a70f-3941ef1d6ebf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:37.134395 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-30869554-f949-4e86-a70f-3941ef1d6ebf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:37.135530 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-30869554-f949-4e86-a70f-3941ef1d6ebf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.173687 Dec 15 12:47:37.136081 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 621/1230] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:36 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:37.628785 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ad503ee8-db87-44d3-8a66-4240755227a3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:37.629741 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ad503ee8-db87-44d3-8a66-4240755227a3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:37.636425 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad503ee8-db87-44d3-8a66-4240755227a3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:37.636894 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad503ee8-db87-44d3-8a66-4240755227a3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:37.637745 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad503ee8-db87-44d3-8a66-4240755227a3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:37.638183 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad503ee8-db87-44d3-8a66-4240755227a3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:37.670214 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ad503ee8-db87-44d3-8a66-4240755227a3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045878 Dec 15 12:47:37.670768 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 610/1231] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:37 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:38.103406 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fd26c48e-dec7-44b5-8430-3d7c9c08cb34 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:38.104745 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fd26c48e-dec7-44b5-8430-3d7c9c08cb34 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:38.113195 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fd26c48e-dec7-44b5-8430-3d7c9c08cb34 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:38.113683 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fd26c48e-dec7-44b5-8430-3d7c9c08cb34 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:38.114615 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fd26c48e-dec7-44b5-8430-3d7c9c08cb34 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:38.114922 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fd26c48e-dec7-44b5-8430-3d7c9c08cb34 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:38.151429 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fd26c48e-dec7-44b5-8430-3d7c9c08cb34 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052820 Dec 15 12:47:38.152485 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 622/1232] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:38 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:38.152611 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bb0ccfcd-e26a-4e9d-9ef2-4f9ea9b20167 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:38.153405 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bb0ccfcd-e26a-4e9d-9ef2-4f9ea9b20167 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:38.160889 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bb0ccfcd-e26a-4e9d-9ef2-4f9ea9b20167 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:38.161328 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bb0ccfcd-e26a-4e9d-9ef2-4f9ea9b20167 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:38.162139 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bb0ccfcd-e26a-4e9d-9ef2-4f9ea9b20167 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:38.162566 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bb0ccfcd-e26a-4e9d-9ef2-4f9ea9b20167 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:38.294987 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bb0ccfcd-e26a-4e9d-9ef2-4f9ea9b20167 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:38.303989 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bb0ccfcd-e26a-4e9d-9ef2-4f9ea9b20167 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:38.305459 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bb0ccfcd-e26a-4e9d-9ef2-4f9ea9b20167 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:38.306623 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bb0ccfcd-e26a-4e9d-9ef2-4f9ea9b20167 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.157645 Dec 15 12:47:38.307178 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 611/1233] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:38 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:47:38.682244 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ea6c07de-791a-40f0-8e7b-85535a1adf74 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:38.683201 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ea6c07de-791a-40f0-8e7b-85535a1adf74 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:38.689396 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea6c07de-791a-40f0-8e7b-85535a1adf74 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:38.689868 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea6c07de-791a-40f0-8e7b-85535a1adf74 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:38.690687 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea6c07de-791a-40f0-8e7b-85535a1adf74 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:38.691120 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea6c07de-791a-40f0-8e7b-85535a1adf74 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:38.720192 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ea6c07de-791a-40f0-8e7b-85535a1adf74 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041221 Dec 15 12:47:38.720743 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 623/1234] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:38 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:39.163570 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0eda66c0-c676-4d8a-a750-3a0f2a439f88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:39.164512 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0eda66c0-c676-4d8a-a750-3a0f2a439f88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:39.170768 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0eda66c0-c676-4d8a-a750-3a0f2a439f88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:39.171213 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0eda66c0-c676-4d8a-a750-3a0f2a439f88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:39.171985 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0eda66c0-c676-4d8a-a750-3a0f2a439f88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:39.172533 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0eda66c0-c676-4d8a-a750-3a0f2a439f88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:39.201441 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0eda66c0-c676-4d8a-a750-3a0f2a439f88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041412 Dec 15 12:47:39.202061 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 612/1235] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:39 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:39.325235 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ecaf07f9-7045-4ff2-aff2-65626ea59790 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:39.325874 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ecaf07f9-7045-4ff2-aff2-65626ea59790 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:39.332676 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ecaf07f9-7045-4ff2-aff2-65626ea59790 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:39.333121 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ecaf07f9-7045-4ff2-aff2-65626ea59790 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:39.333923 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ecaf07f9-7045-4ff2-aff2-65626ea59790 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:39.334357 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ecaf07f9-7045-4ff2-aff2-65626ea59790 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:39.476641 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ecaf07f9-7045-4ff2-aff2-65626ea59790 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:39.485010 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ecaf07f9-7045-4ff2-aff2-65626ea59790 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:39.486547 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ecaf07f9-7045-4ff2-aff2-65626ea59790 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:39.487746 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ecaf07f9-7045-4ff2-aff2-65626ea59790 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.166303 Dec 15 12:47:39.491377 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 624/1236] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:39 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:39.731435 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-13085f3c-94fd-4c62-a396-d3c6ee6946fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:39.732343 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-13085f3c-94fd-4c62-a396-d3c6ee6946fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:39.738788 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-13085f3c-94fd-4c62-a396-d3c6ee6946fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:39.739234 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-13085f3c-94fd-4c62-a396-d3c6ee6946fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:39.740010 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-13085f3c-94fd-4c62-a396-d3c6ee6946fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:39.740444 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-13085f3c-94fd-4c62-a396-d3c6ee6946fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:39.770187 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-13085f3c-94fd-4c62-a396-d3c6ee6946fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042459 Dec 15 12:47:39.770752 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 613/1237] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:39 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:40.214968 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f87d2404-0e1f-411e-85db-d21ee63df7fb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:40.215885 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f87d2404-0e1f-411e-85db-d21ee63df7fb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:40.222116 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f87d2404-0e1f-411e-85db-d21ee63df7fb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:40.222563 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f87d2404-0e1f-411e-85db-d21ee63df7fb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:40.223352 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f87d2404-0e1f-411e-85db-d21ee63df7fb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:40.223789 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f87d2404-0e1f-411e-85db-d21ee63df7fb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:40.253648 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f87d2404-0e1f-411e-85db-d21ee63df7fb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042321 Dec 15 12:47:40.254231 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 625/1238] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:40 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:40.506314 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c4b5799e-303e-4b44-880c-418ba6e6499f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:40.506920 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c4b5799e-303e-4b44-880c-418ba6e6499f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:40.513682 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c4b5799e-303e-4b44-880c-418ba6e6499f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:40.514127 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c4b5799e-303e-4b44-880c-418ba6e6499f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:40.514918 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c4b5799e-303e-4b44-880c-418ba6e6499f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:40.515349 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c4b5799e-303e-4b44-880c-418ba6e6499f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:40.654421 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c4b5799e-303e-4b44-880c-418ba6e6499f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:40.663911 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c4b5799e-303e-4b44-880c-418ba6e6499f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:40.665468 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c4b5799e-303e-4b44-880c-418ba6e6499f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:40.666734 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c4b5799e-303e-4b44-880c-418ba6e6499f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.164647 Dec 15 12:47:40.667316 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 614/1239] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:40 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:40.782570 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-56448cbc-0ac6-4107-a435-76f9fca11948 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:40.783373 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-56448cbc-0ac6-4107-a435-76f9fca11948 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:40.790054 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-56448cbc-0ac6-4107-a435-76f9fca11948 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:40.790493 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-56448cbc-0ac6-4107-a435-76f9fca11948 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:40.791263 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-56448cbc-0ac6-4107-a435-76f9fca11948 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:40.791691 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-56448cbc-0ac6-4107-a435-76f9fca11948 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:40.819534 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-56448cbc-0ac6-4107-a435-76f9fca11948 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041364 Dec 15 12:47:40.820095 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 626/1240] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:40 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:41.265230 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-30483010-5197-4ac8-bf65-16fcce9b0aad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:41.266857 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-30483010-5197-4ac8-bf65-16fcce9b0aad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:41.272818 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-30483010-5197-4ac8-bf65-16fcce9b0aad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:41.273351 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-30483010-5197-4ac8-bf65-16fcce9b0aad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:41.274211 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-30483010-5197-4ac8-bf65-16fcce9b0aad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:41.274603 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-30483010-5197-4ac8-bf65-16fcce9b0aad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:41.313801 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-30483010-5197-4ac8-bf65-16fcce9b0aad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051535 Dec 15 12:47:41.314362 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 615/1241] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:41 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:41.684989 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-baaffc61-c1d0-4635-93cc-fffef492414a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:41.685620 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-baaffc61-c1d0-4635-93cc-fffef492414a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:41.691535 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-baaffc61-c1d0-4635-93cc-fffef492414a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:41.691971 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-baaffc61-c1d0-4635-93cc-fffef492414a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:41.692736 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-baaffc61-c1d0-4635-93cc-fffef492414a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:41.693176 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-baaffc61-c1d0-4635-93cc-fffef492414a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:41.831225 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fe848b15-5dc7-46a8-ab89-16fb24656490 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:41.832244 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fe848b15-5dc7-46a8-ab89-16fb24656490 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:41.836230 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-baaffc61-c1d0-4635-93cc-fffef492414a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:41.838469 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fe848b15-5dc7-46a8-ab89-16fb24656490 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:41.838918 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fe848b15-5dc7-46a8-ab89-16fb24656490 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:41.839709 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fe848b15-5dc7-46a8-ab89-16fb24656490 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:41.840145 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fe848b15-5dc7-46a8-ab89-16fb24656490 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:41.845988 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-baaffc61-c1d0-4635-93cc-fffef492414a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:41.847570 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-baaffc61-c1d0-4635-93cc-fffef492414a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:41.848738 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-baaffc61-c1d0-4635-93cc-fffef492414a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.167363 Dec 15 12:47:41.849306 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 627/1242] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:41 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:41.878500 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fe848b15-5dc7-46a8-ab89-16fb24656490 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050894 Dec 15 12:47:41.879002 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 616/1243] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:41 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:47:42.327449 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-68007191-0d36-44b9-bbfa-b3c78b118829 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:42.328357 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-68007191-0d36-44b9-bbfa-b3c78b118829 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:42.335083 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-68007191-0d36-44b9-bbfa-b3c78b118829 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:42.335526 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-68007191-0d36-44b9-bbfa-b3c78b118829 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:42.336362 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-68007191-0d36-44b9-bbfa-b3c78b118829 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:42.336754 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-68007191-0d36-44b9-bbfa-b3c78b118829 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:42.368357 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-68007191-0d36-44b9-bbfa-b3c78b118829 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044571 Dec 15 12:47:42.368922 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 628/1244] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:42 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:42.866752 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a41db404-350d-4809-bfe2-5afb748e6a4f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:42.867363 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a41db404-350d-4809-bfe2-5afb748e6a4f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:42.873649 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a41db404-350d-4809-bfe2-5afb748e6a4f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:42.874098 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a41db404-350d-4809-bfe2-5afb748e6a4f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:42.874866 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a41db404-350d-4809-bfe2-5afb748e6a4f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:42.875340 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a41db404-350d-4809-bfe2-5afb748e6a4f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:42.890053 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-867c7a95-ebaa-44c2-8ab8-1b044a865536 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:42.891486 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-867c7a95-ebaa-44c2-8ab8-1b044a865536 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:42.897645 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-867c7a95-ebaa-44c2-8ab8-1b044a865536 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:42.898092 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-867c7a95-ebaa-44c2-8ab8-1b044a865536 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:42.898876 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-867c7a95-ebaa-44c2-8ab8-1b044a865536 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:42.899310 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-867c7a95-ebaa-44c2-8ab8-1b044a865536 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:42.931498 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-867c7a95-ebaa-44c2-8ab8-1b044a865536 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045058 Dec 15 12:47:42.931980 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 629/1245] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:42 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:47:43.008930 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a41db404-350d-4809-bfe2-5afb748e6a4f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:43.018288 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a41db404-350d-4809-bfe2-5afb748e6a4f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:43.019757 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a41db404-350d-4809-bfe2-5afb748e6a4f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:43.020919 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a41db404-350d-4809-bfe2-5afb748e6a4f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.157884 Dec 15 12:47:43.021470 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 617/1246] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:42 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:43.380690 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b6496327-6e31-4f8c-92dc-5b156488a0e8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:43.381640 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b6496327-6e31-4f8c-92dc-5b156488a0e8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:43.387535 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b6496327-6e31-4f8c-92dc-5b156488a0e8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:43.387979 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b6496327-6e31-4f8c-92dc-5b156488a0e8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:43.388777 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b6496327-6e31-4f8c-92dc-5b156488a0e8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:43.389213 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b6496327-6e31-4f8c-92dc-5b156488a0e8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:43.417917 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b6496327-6e31-4f8c-92dc-5b156488a0e8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041351 Dec 15 12:47:43.418489 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 630/1247] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:43 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:43.942736 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-80b7e2a9-931f-478b-9177-a4940096b75b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:43.943640 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-80b7e2a9-931f-478b-9177-a4940096b75b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:43.950242 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-80b7e2a9-931f-478b-9177-a4940096b75b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:43.950682 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-80b7e2a9-931f-478b-9177-a4940096b75b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:43.951478 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-80b7e2a9-931f-478b-9177-a4940096b75b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:43.952060 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-80b7e2a9-931f-478b-9177-a4940096b75b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:43.981696 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-80b7e2a9-931f-478b-9177-a4940096b75b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042579 Dec 15 12:47:43.982247 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 618/1248] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:43 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:44.038753 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8f941ee8-c59a-4e4e-b2cc-382be07629d0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:44.039344 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8f941ee8-c59a-4e4e-b2cc-382be07629d0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:44.045849 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8f941ee8-c59a-4e4e-b2cc-382be07629d0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:44.046296 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8f941ee8-c59a-4e4e-b2cc-382be07629d0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:44.047085 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8f941ee8-c59a-4e4e-b2cc-382be07629d0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:44.047921 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8f941ee8-c59a-4e4e-b2cc-382be07629d0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:44.190548 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-8f941ee8-c59a-4e4e-b2cc-382be07629d0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:44.198711 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-8f941ee8-c59a-4e4e-b2cc-382be07629d0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:44.200127 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-8f941ee8-c59a-4e4e-b2cc-382be07629d0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:44.201283 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8f941ee8-c59a-4e4e-b2cc-382be07629d0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.166197 Dec 15 12:47:44.201885 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 631/1249] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:44 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:44.429337 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e1ce08e9-4b03-4dd1-8191-d1e8bab28e68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:44.430264 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e1ce08e9-4b03-4dd1-8191-d1e8bab28e68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:44.436045 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e1ce08e9-4b03-4dd1-8191-d1e8bab28e68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:44.436494 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e1ce08e9-4b03-4dd1-8191-d1e8bab28e68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:44.437276 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e1ce08e9-4b03-4dd1-8191-d1e8bab28e68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:44.437764 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e1ce08e9-4b03-4dd1-8191-d1e8bab28e68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:44.468061 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e1ce08e9-4b03-4dd1-8191-d1e8bab28e68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042311 Dec 15 12:47:44.468570 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 619/1250] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:44 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:44.994614 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-261f5a81-8938-4aad-a24f-b7e57c704162 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:44.995512 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-261f5a81-8938-4aad-a24f-b7e57c704162 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:45.002284 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-261f5a81-8938-4aad-a24f-b7e57c704162 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:45.002721 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-261f5a81-8938-4aad-a24f-b7e57c704162 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:45.003500 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-261f5a81-8938-4aad-a24f-b7e57c704162 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:45.003925 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-261f5a81-8938-4aad-a24f-b7e57c704162 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:45.034195 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-261f5a81-8938-4aad-a24f-b7e57c704162 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043216 Dec 15 12:47:45.034681 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 632/1251] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:44 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:45.220045 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d882c3b1-9bd7-489e-8cd2-c571ba466e96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:45.220658 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d882c3b1-9bd7-489e-8cd2-c571ba466e96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:45.226902 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d882c3b1-9bd7-489e-8cd2-c571ba466e96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:45.227350 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d882c3b1-9bd7-489e-8cd2-c571ba466e96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:45.228123 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d882c3b1-9bd7-489e-8cd2-c571ba466e96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:45.228557 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d882c3b1-9bd7-489e-8cd2-c571ba466e96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:45.361009 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d882c3b1-9bd7-489e-8cd2-c571ba466e96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:45.369250 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d882c3b1-9bd7-489e-8cd2-c571ba466e96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:45.370784 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d882c3b1-9bd7-489e-8cd2-c571ba466e96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:45.371931 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d882c3b1-9bd7-489e-8cd2-c571ba466e96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.155772 Dec 15 12:47:45.372484 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 620/1252] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:45 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:45.480201 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-911f92b0-8208-47b9-a32c-e097c8a51b94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:45.481137 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-911f92b0-8208-47b9-a32c-e097c8a51b94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:45.488134 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-911f92b0-8208-47b9-a32c-e097c8a51b94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:45.488583 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-911f92b0-8208-47b9-a32c-e097c8a51b94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:45.489362 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-911f92b0-8208-47b9-a32c-e097c8a51b94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:45.489827 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-911f92b0-8208-47b9-a32c-e097c8a51b94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:45.519661 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-911f92b0-8208-47b9-a32c-e097c8a51b94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043161 Dec 15 12:47:45.520220 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 633/1253] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:45 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:46.046747 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-eb1beaf1-05a1-45f2-9553-0b3d871f052d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:46.048268 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-eb1beaf1-05a1-45f2-9553-0b3d871f052d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:46.054214 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eb1beaf1-05a1-45f2-9553-0b3d871f052d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:46.054661 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eb1beaf1-05a1-45f2-9553-0b3d871f052d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:46.055442 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eb1beaf1-05a1-45f2-9553-0b3d871f052d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:46.055876 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eb1beaf1-05a1-45f2-9553-0b3d871f052d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:46.088864 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-eb1beaf1-05a1-45f2-9553-0b3d871f052d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045811 Dec 15 12:47:46.089458 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 621/1254] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:46 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:47:46.398447 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5a490257-a48e-4719-bf1a-bf54d2db378e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:46.399040 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5a490257-a48e-4719-bf1a-bf54d2db378e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:46.404817 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5a490257-a48e-4719-bf1a-bf54d2db378e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:46.405259 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5a490257-a48e-4719-bf1a-bf54d2db378e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:46.406062 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5a490257-a48e-4719-bf1a-bf54d2db378e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:46.407077 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5a490257-a48e-4719-bf1a-bf54d2db378e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:46.530508 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5c2267f6-66f3-4386-9564-e72e9c370c98 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:46.531472 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5c2267f6-66f3-4386-9564-e72e9c370c98 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:46.538342 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5c2267f6-66f3-4386-9564-e72e9c370c98 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:46.538785 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5c2267f6-66f3-4386-9564-e72e9c370c98 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:46.539564 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5c2267f6-66f3-4386-9564-e72e9c370c98 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:46.539996 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5c2267f6-66f3-4386-9564-e72e9c370c98 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:46.545943 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5a490257-a48e-4719-bf1a-bf54d2db378e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:46.555623 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5a490257-a48e-4719-bf1a-bf54d2db378e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:46.557050 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5a490257-a48e-4719-bf1a-bf54d2db378e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:46.558449 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5a490257-a48e-4719-bf1a-bf54d2db378e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.170861 Dec 15 12:47:46.558857 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 634/1255] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:46 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:46.570229 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5c2267f6-66f3-4386-9564-e72e9c370c98 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043388 Dec 15 12:47:46.570782 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 622/1256] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:46 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:47.100246 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-aa1e81b7-099f-4de5-934c-dcce067474a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:47.101155 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-aa1e81b7-099f-4de5-934c-dcce067474a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:47.107027 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa1e81b7-099f-4de5-934c-dcce067474a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:47.107478 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa1e81b7-099f-4de5-934c-dcce067474a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:47.108258 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa1e81b7-099f-4de5-934c-dcce067474a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:47.108696 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa1e81b7-099f-4de5-934c-dcce067474a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:47.139102 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-aa1e81b7-099f-4de5-934c-dcce067474a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042546 Dec 15 12:47:47.139671 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 635/1257] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:47 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:47.576887 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e9df6b36-5f6f-4046-9092-3f6e7e88a893 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:47.577630 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e9df6b36-5f6f-4046-9092-3f6e7e88a893 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:47.581312 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-23eb7832-bc01-401f-b6f0-b4e99feabfb1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:47.582249 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-23eb7832-bc01-401f-b6f0-b4e99feabfb1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:47.584413 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e9df6b36-5f6f-4046-9092-3f6e7e88a893 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:47.584934 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e9df6b36-5f6f-4046-9092-3f6e7e88a893 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:47.585821 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e9df6b36-5f6f-4046-9092-3f6e7e88a893 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:47.586327 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e9df6b36-5f6f-4046-9092-3f6e7e88a893 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:47.588097 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-23eb7832-bc01-401f-b6f0-b4e99feabfb1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:47.595787 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-23eb7832-bc01-401f-b6f0-b4e99feabfb1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:47.596751 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-23eb7832-bc01-401f-b6f0-b4e99feabfb1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:47.597203 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-23eb7832-bc01-401f-b6f0-b4e99feabfb1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:47.627902 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-23eb7832-bc01-401f-b6f0-b4e99feabfb1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050293 Dec 15 12:47:47.630190 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 636/1258] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:47 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:47:47.732071 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e9df6b36-5f6f-4046-9092-3f6e7e88a893 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:47.741641 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e9df6b36-5f6f-4046-9092-3f6e7e88a893 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:47.743137 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e9df6b36-5f6f-4046-9092-3f6e7e88a893 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:47.744295 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e9df6b36-5f6f-4046-9092-3f6e7e88a893 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.171178 Dec 15 12:47:47.744877 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 623/1259] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:47 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:48.150808 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c4d064d2-8fa4-4ca5-a840-edfe5f2f1339 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:48.151738 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c4d064d2-8fa4-4ca5-a840-edfe5f2f1339 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:48.157924 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c4d064d2-8fa4-4ca5-a840-edfe5f2f1339 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:48.158360 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c4d064d2-8fa4-4ca5-a840-edfe5f2f1339 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:48.159129 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c4d064d2-8fa4-4ca5-a840-edfe5f2f1339 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:48.159553 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c4d064d2-8fa4-4ca5-a840-edfe5f2f1339 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:48.190884 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c4d064d2-8fa4-4ca5-a840-edfe5f2f1339 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043689 Dec 15 12:47:48.191356 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 637/1260] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:48 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:48.640465 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fc842f03-3ed7-4681-8af8-1408eb9d25a8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:48.641425 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fc842f03-3ed7-4681-8af8-1408eb9d25a8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:48.647397 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fc842f03-3ed7-4681-8af8-1408eb9d25a8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:48.647837 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fc842f03-3ed7-4681-8af8-1408eb9d25a8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:48.648618 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fc842f03-3ed7-4681-8af8-1408eb9d25a8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:48.649040 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fc842f03-3ed7-4681-8af8-1408eb9d25a8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:48.678779 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fc842f03-3ed7-4681-8af8-1408eb9d25a8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042683 Dec 15 12:47:48.679508 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 624/1261] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:48 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:48.700474 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 12:47:48.700726 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 12:47:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 12:47:48.762722 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f1a51234-aade-41ef-8661-7ef097e893c9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:48.763346 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f1a51234-aade-41ef-8661-7ef097e893c9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:48.770352 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f1a51234-aade-41ef-8661-7ef097e893c9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:48.770791 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f1a51234-aade-41ef-8661-7ef097e893c9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:48.771560 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f1a51234-aade-41ef-8661-7ef097e893c9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:48.772633 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f1a51234-aade-41ef-8661-7ef097e893c9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:48.917084 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f1a51234-aade-41ef-8661-7ef097e893c9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:48.925482 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f1a51234-aade-41ef-8661-7ef097e893c9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:48.927011 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f1a51234-aade-41ef-8661-7ef097e893c9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:48.928202 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f1a51234-aade-41ef-8661-7ef097e893c9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.169221 Dec 15 12:47:48.928766 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 638/1262] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:48 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:49.201604 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e009d152-0a61-4b5e-bf71-1940cf243505 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:49.202505 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e009d152-0a61-4b5e-bf71-1940cf243505 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:49.209769 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e009d152-0a61-4b5e-bf71-1940cf243505 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:49.210214 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e009d152-0a61-4b5e-bf71-1940cf243505 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:49.211026 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e009d152-0a61-4b5e-bf71-1940cf243505 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:49.211455 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e009d152-0a61-4b5e-bf71-1940cf243505 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:49.242916 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e009d152-0a61-4b5e-bf71-1940cf243505 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045063 Dec 15 12:47:49.243468 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 625/1263] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:49 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:49.690319 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0ebcfa47-aea7-46b3-8f63-0e9dff3b2f75 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:49.691270 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0ebcfa47-aea7-46b3-8f63-0e9dff3b2f75 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:49.697195 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0ebcfa47-aea7-46b3-8f63-0e9dff3b2f75 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:49.697676 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0ebcfa47-aea7-46b3-8f63-0e9dff3b2f75 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:49.698464 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0ebcfa47-aea7-46b3-8f63-0e9dff3b2f75 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:49.698901 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0ebcfa47-aea7-46b3-8f63-0e9dff3b2f75 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:49.729291 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0ebcfa47-aea7-46b3-8f63-0e9dff3b2f75 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043342 Dec 15 12:47:49.729948 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 639/1264] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:49 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:47:49.946656 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-784e65b0-0425-4a29-b8a6-1f90a2dc1fa9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:49.947281 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-784e65b0-0425-4a29-b8a6-1f90a2dc1fa9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:49.953861 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-784e65b0-0425-4a29-b8a6-1f90a2dc1fa9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:49.954341 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-784e65b0-0425-4a29-b8a6-1f90a2dc1fa9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:49.955118 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-784e65b0-0425-4a29-b8a6-1f90a2dc1fa9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:49.955546 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-784e65b0-0425-4a29-b8a6-1f90a2dc1fa9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:50.087384 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-784e65b0-0425-4a29-b8a6-1f90a2dc1fa9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:50.096558 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-784e65b0-0425-4a29-b8a6-1f90a2dc1fa9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:50.098154 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-784e65b0-0425-4a29-b8a6-1f90a2dc1fa9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:50.099364 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-784e65b0-0425-4a29-b8a6-1f90a2dc1fa9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.156424 Dec 15 12:47:50.099927 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 626/1265] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:49 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:50.254642 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d74bfa74-0fb1-4594-bf2f-9e5ec48b4ef0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:50.255760 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d74bfa74-0fb1-4594-bf2f-9e5ec48b4ef0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:50.263782 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d74bfa74-0fb1-4594-bf2f-9e5ec48b4ef0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:50.264488 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d74bfa74-0fb1-4594-bf2f-9e5ec48b4ef0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:50.266281 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d74bfa74-0fb1-4594-bf2f-9e5ec48b4ef0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:50.266951 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d74bfa74-0fb1-4594-bf2f-9e5ec48b4ef0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:50.298166 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d74bfa74-0fb1-4594-bf2f-9e5ec48b4ef0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047367 Dec 15 12:47:50.298743 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 640/1266] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:50 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:50.742150 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f7f6bfb5-ef03-49a3-85e8-ec40d8ecf2b6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:50.743069 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f7f6bfb5-ef03-49a3-85e8-ec40d8ecf2b6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:50.748955 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f7f6bfb5-ef03-49a3-85e8-ec40d8ecf2b6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:50.749399 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f7f6bfb5-ef03-49a3-85e8-ec40d8ecf2b6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:50.750327 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f7f6bfb5-ef03-49a3-85e8-ec40d8ecf2b6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:50.750920 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f7f6bfb5-ef03-49a3-85e8-ec40d8ecf2b6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:50.785170 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f7f6bfb5-ef03-49a3-85e8-ec40d8ecf2b6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047002 Dec 15 12:47:50.785780 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 627/1267] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:50 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:51.118143 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0c963051-85fd-4dc0-b9a8-d2ac22490961 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:51.118754 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0c963051-85fd-4dc0-b9a8-d2ac22490961 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:51.124519 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0c963051-85fd-4dc0-b9a8-d2ac22490961 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:51.124966 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0c963051-85fd-4dc0-b9a8-d2ac22490961 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:51.125768 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0c963051-85fd-4dc0-b9a8-d2ac22490961 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:51.126204 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0c963051-85fd-4dc0-b9a8-d2ac22490961 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:51.276854 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0c963051-85fd-4dc0-b9a8-d2ac22490961 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:51.285798 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0c963051-85fd-4dc0-b9a8-d2ac22490961 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:51.287275 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0c963051-85fd-4dc0-b9a8-d2ac22490961 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:51.288414 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0c963051-85fd-4dc0-b9a8-d2ac22490961 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.174054 Dec 15 12:47:51.288960 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 641/1268] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:51 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:51.311326 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0e0b9a03-1df5-4a75-890b-4d483ba0edde tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:51.312240 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0e0b9a03-1df5-4a75-890b-4d483ba0edde tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:51.318620 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e0b9a03-1df5-4a75-890b-4d483ba0edde tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:51.319007 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e0b9a03-1df5-4a75-890b-4d483ba0edde tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:51.319792 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e0b9a03-1df5-4a75-890b-4d483ba0edde tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:51.320228 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e0b9a03-1df5-4a75-890b-4d483ba0edde tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:51.350231 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0e0b9a03-1df5-4a75-890b-4d483ba0edde tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042544 Dec 15 12:47:51.350824 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 628/1269] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:51 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:51.796271 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6c9f6f92-46f9-4bd9-b12d-dd3985e56672 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:51.797711 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6c9f6f92-46f9-4bd9-b12d-dd3985e56672 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:51.803633 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c9f6f92-46f9-4bd9-b12d-dd3985e56672 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:51.804080 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c9f6f92-46f9-4bd9-b12d-dd3985e56672 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:51.804854 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c9f6f92-46f9-4bd9-b12d-dd3985e56672 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:51.805286 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c9f6f92-46f9-4bd9-b12d-dd3985e56672 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:51.838862 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6c9f6f92-46f9-4bd9-b12d-dd3985e56672 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046283 Dec 15 12:47:51.839419 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 642/1270] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:51 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:47:52.306740 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ed736f4b-7cb9-4c38-8bf7-c666ff643101 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:52.307351 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ed736f4b-7cb9-4c38-8bf7-c666ff643101 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:52.313293 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ed736f4b-7cb9-4c38-8bf7-c666ff643101 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:52.313961 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ed736f4b-7cb9-4c38-8bf7-c666ff643101 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:52.314551 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ed736f4b-7cb9-4c38-8bf7-c666ff643101 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:52.314972 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ed736f4b-7cb9-4c38-8bf7-c666ff643101 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:52.362456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-803f934d-191d-4b75-b63c-4937f5bc1980 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:52.363473 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-803f934d-191d-4b75-b63c-4937f5bc1980 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:52.370933 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-803f934d-191d-4b75-b63c-4937f5bc1980 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:52.371305 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-803f934d-191d-4b75-b63c-4937f5bc1980 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:52.372093 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-803f934d-191d-4b75-b63c-4937f5bc1980 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:52.372529 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-803f934d-191d-4b75-b63c-4937f5bc1980 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:52.403952 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-803f934d-191d-4b75-b63c-4937f5bc1980 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045949 Dec 15 12:47:52.404515 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 643/1271] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:52 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:47:52.446182 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ed736f4b-7cb9-4c38-8bf7-c666ff643101 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:52.454588 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ed736f4b-7cb9-4c38-8bf7-c666ff643101 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:52.456892 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ed736f4b-7cb9-4c38-8bf7-c666ff643101 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:52.458082 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ed736f4b-7cb9-4c38-8bf7-c666ff643101 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.155086 Dec 15 12:47:52.458630 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 629/1272] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:52 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:52.849408 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a1907794-fbbe-49ae-afe7-bfe04bd046e0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:52.850374 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a1907794-fbbe-49ae-afe7-bfe04bd046e0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:52.856214 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a1907794-fbbe-49ae-afe7-bfe04bd046e0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:52.857089 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a1907794-fbbe-49ae-afe7-bfe04bd046e0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:52.858526 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a1907794-fbbe-49ae-afe7-bfe04bd046e0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:52.859147 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a1907794-fbbe-49ae-afe7-bfe04bd046e0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:52.891435 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a1907794-fbbe-49ae-afe7-bfe04bd046e0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045676 Dec 15 12:47:52.891997 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 644/1273] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:52 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:53.414924 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e6f80b0a-1e97-441b-a9b4-0bfb70e39fc1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:53.415771 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e6f80b0a-1e97-441b-a9b4-0bfb70e39fc1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:53.422031 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e6f80b0a-1e97-441b-a9b4-0bfb70e39fc1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:53.422473 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e6f80b0a-1e97-441b-a9b4-0bfb70e39fc1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:53.423233 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e6f80b0a-1e97-441b-a9b4-0bfb70e39fc1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:53.423660 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e6f80b0a-1e97-441b-a9b4-0bfb70e39fc1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:53.454094 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e6f80b0a-1e97-441b-a9b4-0bfb70e39fc1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042918 Dec 15 12:47:53.454648 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 630/1274] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:53 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:47:53.475865 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-62e0e1ae-9e8b-4586-b465-8db93260ea17 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:53.476467 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-62e0e1ae-9e8b-4586-b465-8db93260ea17 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:53.482971 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-62e0e1ae-9e8b-4586-b465-8db93260ea17 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:53.483415 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-62e0e1ae-9e8b-4586-b465-8db93260ea17 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:53.484202 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-62e0e1ae-9e8b-4586-b465-8db93260ea17 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:53.484635 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-62e0e1ae-9e8b-4586-b465-8db93260ea17 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:53.615492 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-62e0e1ae-9e8b-4586-b465-8db93260ea17 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:53.623544 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-62e0e1ae-9e8b-4586-b465-8db93260ea17 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:53.625063 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-62e0e1ae-9e8b-4586-b465-8db93260ea17 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:53.626250 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-62e0e1ae-9e8b-4586-b465-8db93260ea17 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.154061 Dec 15 12:47:53.626800 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 645/1275] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:53 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:53.904052 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b0758665-1f29-489b-8fef-48b9e08f0972 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:53.905011 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b0758665-1f29-489b-8fef-48b9e08f0972 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:53.911663 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b0758665-1f29-489b-8fef-48b9e08f0972 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:53.912090 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b0758665-1f29-489b-8fef-48b9e08f0972 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:53.912870 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b0758665-1f29-489b-8fef-48b9e08f0972 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:53.913304 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b0758665-1f29-489b-8fef-48b9e08f0972 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:53.941886 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b0758665-1f29-489b-8fef-48b9e08f0972 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041661 Dec 15 12:47:53.942435 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 631/1276] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:53 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:54.465246 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bc8b95ee-4dac-4fbe-a85c-c8d99537f32b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:54.466107 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bc8b95ee-4dac-4fbe-a85c-c8d99537f32b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:54.472799 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bc8b95ee-4dac-4fbe-a85c-c8d99537f32b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:54.473256 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bc8b95ee-4dac-4fbe-a85c-c8d99537f32b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:54.474126 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bc8b95ee-4dac-4fbe-a85c-c8d99537f32b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:54.474570 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bc8b95ee-4dac-4fbe-a85c-c8d99537f32b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:54.504500 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bc8b95ee-4dac-4fbe-a85c-c8d99537f32b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043071 Dec 15 12:47:54.505141 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 646/1277] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:54 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:54.645048 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-842d07b3-5ada-4b3a-a270-338f083b61bb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:54.645690 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-842d07b3-5ada-4b3a-a270-338f083b61bb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:54.652780 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-842d07b3-5ada-4b3a-a270-338f083b61bb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:54.653226 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-842d07b3-5ada-4b3a-a270-338f083b61bb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:54.654078 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-842d07b3-5ada-4b3a-a270-338f083b61bb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:54.654539 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-842d07b3-5ada-4b3a-a270-338f083b61bb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:54.795357 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-842d07b3-5ada-4b3a-a270-338f083b61bb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:54.805005 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-842d07b3-5ada-4b3a-a270-338f083b61bb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:54.806513 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-842d07b3-5ada-4b3a-a270-338f083b61bb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:54.807672 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-842d07b3-5ada-4b3a-a270-338f083b61bb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.166417 Dec 15 12:47:54.808221 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 632/1278] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:54 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:54.953276 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-aa5e83e1-c813-40e4-9506-aecf7e0afe7d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:54.954210 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-aa5e83e1-c813-40e4-9506-aecf7e0afe7d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:54.960040 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa5e83e1-c813-40e4-9506-aecf7e0afe7d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:54.960528 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa5e83e1-c813-40e4-9506-aecf7e0afe7d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:54.961268 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa5e83e1-c813-40e4-9506-aecf7e0afe7d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:54.961739 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa5e83e1-c813-40e4-9506-aecf7e0afe7d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:54.990467 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-aa5e83e1-c813-40e4-9506-aecf7e0afe7d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040732 Dec 15 12:47:54.990969 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 647/1279] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:54 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:55.516455 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d276dfb1-7dfd-4e98-92d0-0a19b710ed20 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:55.517289 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d276dfb1-7dfd-4e98-92d0-0a19b710ed20 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:55.523956 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d276dfb1-7dfd-4e98-92d0-0a19b710ed20 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:55.524406 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d276dfb1-7dfd-4e98-92d0-0a19b710ed20 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:55.525204 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d276dfb1-7dfd-4e98-92d0-0a19b710ed20 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:55.525672 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d276dfb1-7dfd-4e98-92d0-0a19b710ed20 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:55.554729 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d276dfb1-7dfd-4e98-92d0-0a19b710ed20 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042306 Dec 15 12:47:55.555271 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 633/1280] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:55 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:55.826970 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fde50db0-f738-4ce5-b503-3a17e87d138a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:55.827541 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fde50db0-f738-4ce5-b503-3a17e87d138a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:55.834495 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fde50db0-f738-4ce5-b503-3a17e87d138a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:55.834941 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fde50db0-f738-4ce5-b503-3a17e87d138a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:55.835724 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fde50db0-f738-4ce5-b503-3a17e87d138a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:55.836155 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fde50db0-f738-4ce5-b503-3a17e87d138a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:55.972434 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-fde50db0-f738-4ce5-b503-3a17e87d138a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:55.981000 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-fde50db0-f738-4ce5-b503-3a17e87d138a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:55.982608 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-fde50db0-f738-4ce5-b503-3a17e87d138a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:55.983803 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fde50db0-f738-4ce5-b503-3a17e87d138a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.160676 Dec 15 12:47:55.984371 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 648/1281] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:55 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:56.001671 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-eba1e39f-7264-497b-86f4-7f3f98a7205c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:56.003104 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-eba1e39f-7264-497b-86f4-7f3f98a7205c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:56.009569 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eba1e39f-7264-497b-86f4-7f3f98a7205c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:56.010014 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eba1e39f-7264-497b-86f4-7f3f98a7205c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:56.010788 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eba1e39f-7264-497b-86f4-7f3f98a7205c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:56.011222 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eba1e39f-7264-497b-86f4-7f3f98a7205c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:56.041525 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-eba1e39f-7264-497b-86f4-7f3f98a7205c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043439 Dec 15 12:47:56.042047 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 634/1282] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:55 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:56.567135 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1eda3e53-3298-4dd1-8145-0b840e5e0ccd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:56.567955 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1eda3e53-3298-4dd1-8145-0b840e5e0ccd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:56.573943 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1eda3e53-3298-4dd1-8145-0b840e5e0ccd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:56.574384 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1eda3e53-3298-4dd1-8145-0b840e5e0ccd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:56.575148 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1eda3e53-3298-4dd1-8145-0b840e5e0ccd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:56.575578 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1eda3e53-3298-4dd1-8145-0b840e5e0ccd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:56.606309 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1eda3e53-3298-4dd1-8145-0b840e5e0ccd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043762 Dec 15 12:47:56.606882 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 649/1283] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:56 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:57.001850 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-057d5e23-0d6d-49bb-b998-5ba5aa506966 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:57.002585 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-057d5e23-0d6d-49bb-b998-5ba5aa506966 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:57.008833 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-057d5e23-0d6d-49bb-b998-5ba5aa506966 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:57.009270 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-057d5e23-0d6d-49bb-b998-5ba5aa506966 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:57.010084 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-057d5e23-0d6d-49bb-b998-5ba5aa506966 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:57.010517 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-057d5e23-0d6d-49bb-b998-5ba5aa506966 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:57.052622 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-299a29c9-07d4-4167-879f-51923e5b143d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:57.053547 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-299a29c9-07d4-4167-879f-51923e5b143d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:57.061436 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-299a29c9-07d4-4167-879f-51923e5b143d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:57.061915 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-299a29c9-07d4-4167-879f-51923e5b143d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:57.062708 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-299a29c9-07d4-4167-879f-51923e5b143d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:57.063144 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-299a29c9-07d4-4167-879f-51923e5b143d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:57.101702 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-299a29c9-07d4-4167-879f-51923e5b143d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053022 Dec 15 12:47:57.102280 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 650/1284] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:57 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:47:57.323328 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-057d5e23-0d6d-49bb-b998-5ba5aa506966 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:57.332276 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-057d5e23-0d6d-49bb-b998-5ba5aa506966 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:57.333801 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-057d5e23-0d6d-49bb-b998-5ba5aa506966 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:57.334973 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-057d5e23-0d6d-49bb-b998-5ba5aa506966 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.336877 Dec 15 12:47:57.335530 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 635/1285] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:56 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:57.617991 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f757328e-7a20-4d98-9f48-9165e1fe5448 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:57.618838 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f757328e-7a20-4d98-9f48-9165e1fe5448 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:57.624637 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f757328e-7a20-4d98-9f48-9165e1fe5448 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:57.625075 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f757328e-7a20-4d98-9f48-9165e1fe5448 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:57.625867 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f757328e-7a20-4d98-9f48-9165e1fe5448 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:57.626290 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f757328e-7a20-4d98-9f48-9165e1fe5448 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:57.658122 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f757328e-7a20-4d98-9f48-9165e1fe5448 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043795 Dec 15 12:47:57.658894 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 651/1286] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:57 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:58.113633 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-80b24489-88c8-43c1-baf7-7e7da1b1eb0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:58.114540 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-80b24489-88c8-43c1-baf7-7e7da1b1eb0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:58.128069 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-80b24489-88c8-43c1-baf7-7e7da1b1eb0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:58.128514 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-80b24489-88c8-43c1-baf7-7e7da1b1eb0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:58.129310 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-80b24489-88c8-43c1-baf7-7e7da1b1eb0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:58.129775 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-80b24489-88c8-43c1-baf7-7e7da1b1eb0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:58.158824 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-80b24489-88c8-43c1-baf7-7e7da1b1eb0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049063 Dec 15 12:47:58.159381 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 636/1287] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:58 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:58.357262 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6057c912-ef31-4030-a210-7fed0944498a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:58.357896 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6057c912-ef31-4030-a210-7fed0944498a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:58.364922 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6057c912-ef31-4030-a210-7fed0944498a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:58.365425 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6057c912-ef31-4030-a210-7fed0944498a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:58.366170 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6057c912-ef31-4030-a210-7fed0944498a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:58.366604 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6057c912-ef31-4030-a210-7fed0944498a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:58.400557 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 12:47:58.400974 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 12:47:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 (ip 10.222.0.76) !!! Dec 15 12:47:58.508832 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6057c912-ef31-4030-a210-7fed0944498a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:58.517016 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6057c912-ef31-4030-a210-7fed0944498a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:58.519512 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6057c912-ef31-4030-a210-7fed0944498a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:58.524110 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6057c912-ef31-4030-a210-7fed0944498a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.167150 Dec 15 12:47:58.524110 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 652/1288] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:58 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:58.670266 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9f8783fb-ced8-4468-9ad3-e1ebe4cda524 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:58.671160 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9f8783fb-ced8-4468-9ad3-e1ebe4cda524 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:58.677762 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9f8783fb-ced8-4468-9ad3-e1ebe4cda524 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:58.678213 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9f8783fb-ced8-4468-9ad3-e1ebe4cda524 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:58.679009 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9f8783fb-ced8-4468-9ad3-e1ebe4cda524 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:58.679441 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9f8783fb-ced8-4468-9ad3-e1ebe4cda524 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:58.712312 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9f8783fb-ced8-4468-9ad3-e1ebe4cda524 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045606 Dec 15 12:47:58.712869 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 637/1289] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:58 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:59.170087 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b5392486-ed5c-41d0-a861-31b8404c4397 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:59.170987 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b5392486-ed5c-41d0-a861-31b8404c4397 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:59.177582 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5392486-ed5c-41d0-a861-31b8404c4397 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:59.178025 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5392486-ed5c-41d0-a861-31b8404c4397 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:59.178790 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5392486-ed5c-41d0-a861-31b8404c4397 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:59.179220 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5392486-ed5c-41d0-a861-31b8404c4397 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:59.207860 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b5392486-ed5c-41d0-a861-31b8404c4397 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041484 Dec 15 12:47:59.208406 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 653/1290] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:59 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:47:59.540134 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a58af685-88d8-4aab-b7a0-006bd3d35f22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:59.541165 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a58af685-88d8-4aab-b7a0-006bd3d35f22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:59.550278 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a58af685-88d8-4aab-b7a0-006bd3d35f22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:59.550875 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a58af685-88d8-4aab-b7a0-006bd3d35f22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:59.551878 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a58af685-88d8-4aab-b7a0-006bd3d35f22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:59.552313 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a58af685-88d8-4aab-b7a0-006bd3d35f22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:59.720946 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a58af685-88d8-4aab-b7a0-006bd3d35f22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:59.724224 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2f9a486a-77fb-4b30-bc1f-56f5186cf1d2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:47:59.725234 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2f9a486a-77fb-4b30-bc1f-56f5186cf1d2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:47:59.731315 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2f9a486a-77fb-4b30-bc1f-56f5186cf1d2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:59.731775 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2f9a486a-77fb-4b30-bc1f-56f5186cf1d2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:59.731983 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a58af685-88d8-4aab-b7a0-006bd3d35f22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:59.732574 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2f9a486a-77fb-4b30-bc1f-56f5186cf1d2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:47:59.733024 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2f9a486a-77fb-4b30-bc1f-56f5186cf1d2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:47:59.734302 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a58af685-88d8-4aab-b7a0-006bd3d35f22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:47:59.736025 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a58af685-88d8-4aab-b7a0-006bd3d35f22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.200870 Dec 15 12:47:59.748337 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 638/1291] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:47:59 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:47:59.765022 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2f9a486a-77fb-4b30-bc1f-56f5186cf1d2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044905 Dec 15 12:47:59.768867 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 654/1292] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:47:59 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:48:00.219475 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-85e71f08-6de4-4568-bced-2142e28b71f9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:00.220401 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-85e71f08-6de4-4568-bced-2142e28b71f9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:00.227107 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-85e71f08-6de4-4568-bced-2142e28b71f9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:00.227554 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-85e71f08-6de4-4568-bced-2142e28b71f9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:00.228335 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-85e71f08-6de4-4568-bced-2142e28b71f9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:00.228761 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-85e71f08-6de4-4568-bced-2142e28b71f9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:00.266161 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-85e71f08-6de4-4568-bced-2142e28b71f9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050359 Dec 15 12:48:00.266738 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 639/1293] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:00 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:00.756994 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c8893e00-5d40-4527-808b-70a90a1b47e7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:00.757538 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c8893e00-5d40-4527-808b-70a90a1b47e7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:00.763647 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c8893e00-5d40-4527-808b-70a90a1b47e7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:00.764087 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c8893e00-5d40-4527-808b-70a90a1b47e7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:00.764851 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c8893e00-5d40-4527-808b-70a90a1b47e7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:00.765279 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c8893e00-5d40-4527-808b-70a90a1b47e7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:00.776119 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8a328bd6-fe6d-4804-8275-ebfd8376d531 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:00.777127 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8a328bd6-fe6d-4804-8275-ebfd8376d531 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:00.783878 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8a328bd6-fe6d-4804-8275-ebfd8376d531 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:00.784341 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8a328bd6-fe6d-4804-8275-ebfd8376d531 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:00.785198 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8a328bd6-fe6d-4804-8275-ebfd8376d531 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:00.785665 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8a328bd6-fe6d-4804-8275-ebfd8376d531 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:00.817204 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8a328bd6-fe6d-4804-8275-ebfd8376d531 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044848 Dec 15 12:48:00.817800 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 640/1294] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:00 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:48:00.900604 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c8893e00-5d40-4527-808b-70a90a1b47e7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:00.908750 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c8893e00-5d40-4527-808b-70a90a1b47e7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:00.910298 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c8893e00-5d40-4527-808b-70a90a1b47e7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:00.911446 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c8893e00-5d40-4527-808b-70a90a1b47e7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.159215 Dec 15 12:48:00.911998 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 655/1295] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:48:00 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:48:01.278386 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-813b4bb2-c6a2-4e0c-a79c-506a9df1a36a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:01.279347 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-813b4bb2-c6a2-4e0c-a79c-506a9df1a36a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:01.285790 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-813b4bb2-c6a2-4e0c-a79c-506a9df1a36a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:01.286246 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-813b4bb2-c6a2-4e0c-a79c-506a9df1a36a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:01.287064 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-813b4bb2-c6a2-4e0c-a79c-506a9df1a36a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:01.287500 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-813b4bb2-c6a2-4e0c-a79c-506a9df1a36a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:01.320896 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-813b4bb2-c6a2-4e0c-a79c-506a9df1a36a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046173 Dec 15 12:48:01.321384 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 641/1296] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:01 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:01.828609 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f4f81431-688c-484c-93da-ee12ea6eebc3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:01.829605 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f4f81431-688c-484c-93da-ee12ea6eebc3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:01.835921 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4f81431-688c-484c-93da-ee12ea6eebc3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:01.836368 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4f81431-688c-484c-93da-ee12ea6eebc3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:01.837153 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4f81431-688c-484c-93da-ee12ea6eebc3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:01.837616 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4f81431-688c-484c-93da-ee12ea6eebc3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:01.867431 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f4f81431-688c-484c-93da-ee12ea6eebc3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042628 Dec 15 12:48:01.867981 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 656/1297] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:01 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:01.932779 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-afb09e7b-bbd5-4408-8c1f-d9b5cbf13d1e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:01.933785 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-afb09e7b-bbd5-4408-8c1f-d9b5cbf13d1e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:01.940374 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afb09e7b-bbd5-4408-8c1f-d9b5cbf13d1e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:01.940820 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afb09e7b-bbd5-4408-8c1f-d9b5cbf13d1e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:01.941761 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afb09e7b-bbd5-4408-8c1f-d9b5cbf13d1e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:01.942211 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afb09e7b-bbd5-4408-8c1f-d9b5cbf13d1e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:02.079126 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-afb09e7b-bbd5-4408-8c1f-d9b5cbf13d1e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:02.088956 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-afb09e7b-bbd5-4408-8c1f-d9b5cbf13d1e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:02.090386 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-afb09e7b-bbd5-4408-8c1f-d9b5cbf13d1e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:02.091555 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-afb09e7b-bbd5-4408-8c1f-d9b5cbf13d1e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.164798 Dec 15 12:48:02.092104 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 642/1298] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:48:01 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:48:02.332834 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c8520da9-0d3c-480b-9874-88fe20f60396 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:02.333788 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c8520da9-0d3c-480b-9874-88fe20f60396 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:02.339666 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c8520da9-0d3c-480b-9874-88fe20f60396 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:02.340043 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c8520da9-0d3c-480b-9874-88fe20f60396 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:02.340822 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c8520da9-0d3c-480b-9874-88fe20f60396 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:02.341276 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c8520da9-0d3c-480b-9874-88fe20f60396 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:02.371563 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c8520da9-0d3c-480b-9874-88fe20f60396 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042483 Dec 15 12:48:02.372111 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 657/1299] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:02 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:02.879673 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-705907c2-90e9-4ab3-928e-93df42345151 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:02.880777 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-705907c2-90e9-4ab3-928e-93df42345151 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:02.886706 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-705907c2-90e9-4ab3-928e-93df42345151 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:02.887157 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-705907c2-90e9-4ab3-928e-93df42345151 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:02.887938 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-705907c2-90e9-4ab3-928e-93df42345151 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:02.888376 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-705907c2-90e9-4ab3-928e-93df42345151 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:02.917957 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-705907c2-90e9-4ab3-928e-93df42345151 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042560 Dec 15 12:48:02.918561 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 643/1300] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:02 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:03.109478 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-50144240-08a5-4dc3-91f1-d6cc74639019 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:03.110117 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-50144240-08a5-4dc3-91f1-d6cc74639019 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:03.116724 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-50144240-08a5-4dc3-91f1-d6cc74639019 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:03.117172 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-50144240-08a5-4dc3-91f1-d6cc74639019 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:03.117991 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-50144240-08a5-4dc3-91f1-d6cc74639019 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:03.118427 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-50144240-08a5-4dc3-91f1-d6cc74639019 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:03.268423 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-50144240-08a5-4dc3-91f1-d6cc74639019 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:03.278332 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-50144240-08a5-4dc3-91f1-d6cc74639019 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:03.279827 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-50144240-08a5-4dc3-91f1-d6cc74639019 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:03.281291 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-50144240-08a5-4dc3-91f1-d6cc74639019 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.175340 Dec 15 12:48:03.282139 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 658/1301] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:48:03 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:48:03.383325 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-cec50ceb-4e63-4946-8b0f-756aa471e57c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:03.384323 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-cec50ceb-4e63-4946-8b0f-756aa471e57c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:03.394349 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cec50ceb-4e63-4946-8b0f-756aa471e57c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:03.394799 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cec50ceb-4e63-4946-8b0f-756aa471e57c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:03.395594 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cec50ceb-4e63-4946-8b0f-756aa471e57c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:03.396039 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cec50ceb-4e63-4946-8b0f-756aa471e57c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:03.426167 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cec50ceb-4e63-4946-8b0f-756aa471e57c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046268 Dec 15 12:48:03.426808 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 644/1302] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:03 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:03.929779 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-daac1540-d147-4b10-9e37-a03c11b4e764 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:03.930600 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-daac1540-d147-4b10-9e37-a03c11b4e764 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:03.936423 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-daac1540-d147-4b10-9e37-a03c11b4e764 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:03.936860 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-daac1540-d147-4b10-9e37-a03c11b4e764 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:03.937654 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-daac1540-d147-4b10-9e37-a03c11b4e764 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:03.938086 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-daac1540-d147-4b10-9e37-a03c11b4e764 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:03.967610 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-daac1540-d147-4b10-9e37-a03c11b4e764 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041711 Dec 15 12:48:03.968220 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 659/1303] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:03 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:04.303454 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b80e26e5-7305-4b26-9374-103e2b9a01eb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:04.304062 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b80e26e5-7305-4b26-9374-103e2b9a01eb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:04.310053 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b80e26e5-7305-4b26-9374-103e2b9a01eb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:04.310501 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b80e26e5-7305-4b26-9374-103e2b9a01eb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:04.311270 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b80e26e5-7305-4b26-9374-103e2b9a01eb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:04.311701 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b80e26e5-7305-4b26-9374-103e2b9a01eb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:04.437959 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0c242484-8524-45bb-833e-639529b0a23a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:04.438985 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0c242484-8524-45bb-833e-639529b0a23a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:04.446305 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0c242484-8524-45bb-833e-639529b0a23a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:04.446745 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0c242484-8524-45bb-833e-639529b0a23a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:04.447521 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0c242484-8524-45bb-833e-639529b0a23a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:04.447947 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0c242484-8524-45bb-833e-639529b0a23a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:04.451918 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b80e26e5-7305-4b26-9374-103e2b9a01eb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:04.460119 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b80e26e5-7305-4b26-9374-103e2b9a01eb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:04.461647 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b80e26e5-7305-4b26-9374-103e2b9a01eb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:04.462816 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b80e26e5-7305-4b26-9374-103e2b9a01eb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.163540 Dec 15 12:48:04.463370 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 645/1304] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:48:04 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:48:04.478424 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0c242484-8524-45bb-833e-639529b0a23a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044219 Dec 15 12:48:04.479005 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 660/1305] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:04 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:48:04.979781 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-060ac087-260c-434b-abdd-517531eba63a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:04.980665 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-060ac087-260c-434b-abdd-517531eba63a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:04.986548 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-060ac087-260c-434b-abdd-517531eba63a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:04.986997 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-060ac087-260c-434b-abdd-517531eba63a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:04.988370 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-060ac087-260c-434b-abdd-517531eba63a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:04.988784 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-060ac087-260c-434b-abdd-517531eba63a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:05.025632 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-060ac087-260c-434b-abdd-517531eba63a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049658 Dec 15 12:48:05.026187 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 646/1306] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:04 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:48:05.483364 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e14f5dc9-30ed-478f-bcc3-43509b478a93 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:05.483981 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e14f5dc9-30ed-478f-bcc3-43509b478a93 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:05.489815 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-04f2a623-3e97-4a69-997b-0a905adf2cc3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:05.490729 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e14f5dc9-30ed-478f-bcc3-43509b478a93 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:05.490845 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-04f2a623-3e97-4a69-997b-0a905adf2cc3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:05.491181 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e14f5dc9-30ed-478f-bcc3-43509b478a93 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:05.491969 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e14f5dc9-30ed-478f-bcc3-43509b478a93 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:05.492414 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e14f5dc9-30ed-478f-bcc3-43509b478a93 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:05.497188 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-04f2a623-3e97-4a69-997b-0a905adf2cc3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:05.497674 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-04f2a623-3e97-4a69-997b-0a905adf2cc3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:05.498463 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-04f2a623-3e97-4a69-997b-0a905adf2cc3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:05.498901 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-04f2a623-3e97-4a69-997b-0a905adf2cc3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:05.532478 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-04f2a623-3e97-4a69-997b-0a905adf2cc3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046402 Dec 15 12:48:05.533043 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 647/1307] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:05 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:48:05.631458 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e14f5dc9-30ed-478f-bcc3-43509b478a93 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:05.639784 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e14f5dc9-30ed-478f-bcc3-43509b478a93 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:05.641235 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e14f5dc9-30ed-478f-bcc3-43509b478a93 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:05.642432 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e14f5dc9-30ed-478f-bcc3-43509b478a93 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.162790 Dec 15 12:48:05.642964 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 661/1308] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:48:05 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:48:06.037013 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-db4db960-61f5-49f0-8296-5f07e73aecfd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:06.038003 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-db4db960-61f5-49f0-8296-5f07e73aecfd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:06.044211 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-db4db960-61f5-49f0-8296-5f07e73aecfd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:06.044652 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-db4db960-61f5-49f0-8296-5f07e73aecfd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:06.045442 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-db4db960-61f5-49f0-8296-5f07e73aecfd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:06.045888 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-db4db960-61f5-49f0-8296-5f07e73aecfd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:06.076474 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-db4db960-61f5-49f0-8296-5f07e73aecfd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043229 Dec 15 12:48:06.077027 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 648/1309] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:06 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:06.544862 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0d290791-5116-4b83-8f27-852ee5bfe0f6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:06.545793 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0d290791-5116-4b83-8f27-852ee5bfe0f6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:06.552704 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0d290791-5116-4b83-8f27-852ee5bfe0f6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:06.553143 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0d290791-5116-4b83-8f27-852ee5bfe0f6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:06.553940 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0d290791-5116-4b83-8f27-852ee5bfe0f6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:06.554369 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0d290791-5116-4b83-8f27-852ee5bfe0f6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:06.583921 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0d290791-5116-4b83-8f27-852ee5bfe0f6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042643 Dec 15 12:48:06.584398 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 662/1310] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:06 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:06.662701 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4122f581-e11c-4f05-864c-7ef4e2379f20 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:06.663322 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4122f581-e11c-4f05-864c-7ef4e2379f20 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:06.670035 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4122f581-e11c-4f05-864c-7ef4e2379f20 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:06.670475 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4122f581-e11c-4f05-864c-7ef4e2379f20 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:06.671296 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4122f581-e11c-4f05-864c-7ef4e2379f20 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:06.671686 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4122f581-e11c-4f05-864c-7ef4e2379f20 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:06.804729 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4122f581-e11c-4f05-864c-7ef4e2379f20 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:06.813280 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4122f581-e11c-4f05-864c-7ef4e2379f20 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:06.814910 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4122f581-e11c-4f05-864c-7ef4e2379f20 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:06.816290 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4122f581-e11c-4f05-864c-7ef4e2379f20 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.158597 Dec 15 12:48:06.816832 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 649/1311] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:48:06 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:48:07.088972 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9d216cf0-faba-4763-82d4-2e1c78e9028a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:07.089820 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9d216cf0-faba-4763-82d4-2e1c78e9028a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:07.095598 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9d216cf0-faba-4763-82d4-2e1c78e9028a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:07.096042 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9d216cf0-faba-4763-82d4-2e1c78e9028a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:07.096812 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9d216cf0-faba-4763-82d4-2e1c78e9028a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:07.097276 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9d216cf0-faba-4763-82d4-2e1c78e9028a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:07.125537 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9d216cf0-faba-4763-82d4-2e1c78e9028a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040371 Dec 15 12:48:07.126071 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 663/1312] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:07 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:48:07.594997 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-456cab79-b04c-46a2-b1ea-e7d2e11d1cab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:07.595908 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-456cab79-b04c-46a2-b1ea-e7d2e11d1cab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:07.609143 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-456cab79-b04c-46a2-b1ea-e7d2e11d1cab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:07.609618 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-456cab79-b04c-46a2-b1ea-e7d2e11d1cab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:07.610411 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-456cab79-b04c-46a2-b1ea-e7d2e11d1cab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:07.610842 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-456cab79-b04c-46a2-b1ea-e7d2e11d1cab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:07.651720 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-456cab79-b04c-46a2-b1ea-e7d2e11d1cab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060052 Dec 15 12:48:07.652878 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 650/1313] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:07 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:07.833741 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-add9a3b3-fd74-4a68-a315-d0168af0d98b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:07.834311 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-add9a3b3-fd74-4a68-a315-d0168af0d98b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:07.840469 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-add9a3b3-fd74-4a68-a315-d0168af0d98b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:07.840914 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-add9a3b3-fd74-4a68-a315-d0168af0d98b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:07.841748 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-add9a3b3-fd74-4a68-a315-d0168af0d98b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:07.842183 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-add9a3b3-fd74-4a68-a315-d0168af0d98b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:07.979032 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-add9a3b3-fd74-4a68-a315-d0168af0d98b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:07.987146 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-add9a3b3-fd74-4a68-a315-d0168af0d98b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:07.989310 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-add9a3b3-fd74-4a68-a315-d0168af0d98b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:07.990493 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-add9a3b3-fd74-4a68-a315-d0168af0d98b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.160759 Dec 15 12:48:07.991043 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 664/1314] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:48:07 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:48:08.138174 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6af786c1-7587-4dc3-857a-5638e98c7bb1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:08.139131 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6af786c1-7587-4dc3-857a-5638e98c7bb1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:08.145631 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6af786c1-7587-4dc3-857a-5638e98c7bb1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:08.146080 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6af786c1-7587-4dc3-857a-5638e98c7bb1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:08.146870 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6af786c1-7587-4dc3-857a-5638e98c7bb1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:08.147308 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6af786c1-7587-4dc3-857a-5638e98c7bb1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:08.184726 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6af786c1-7587-4dc3-857a-5638e98c7bb1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050320 Dec 15 12:48:08.185288 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 651/1315] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:08 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:08.665966 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9ddd87f6-369a-4be8-b4d4-f0686fdd3bd8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:08.666834 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9ddd87f6-369a-4be8-b4d4-f0686fdd3bd8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:08.672689 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9ddd87f6-369a-4be8-b4d4-f0686fdd3bd8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:08.673178 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9ddd87f6-369a-4be8-b4d4-f0686fdd3bd8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:08.673991 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9ddd87f6-369a-4be8-b4d4-f0686fdd3bd8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:08.674426 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9ddd87f6-369a-4be8-b4d4-f0686fdd3bd8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:08.709050 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9ddd87f6-369a-4be8-b4d4-f0686fdd3bd8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046875 Dec 15 12:48:08.709645 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 665/1316] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:08 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:09.009791 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b013968b-e4a8-4e6b-9d46-ceb6bae9f031 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:09.010403 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b013968b-e4a8-4e6b-9d46-ceb6bae9f031 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:09.016562 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b013968b-e4a8-4e6b-9d46-ceb6bae9f031 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:09.016990 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b013968b-e4a8-4e6b-9d46-ceb6bae9f031 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:09.017795 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b013968b-e4a8-4e6b-9d46-ceb6bae9f031 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:09.018268 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b013968b-e4a8-4e6b-9d46-ceb6bae9f031 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:09.158908 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b013968b-e4a8-4e6b-9d46-ceb6bae9f031 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:09.170156 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b013968b-e4a8-4e6b-9d46-ceb6bae9f031 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:09.171560 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b013968b-e4a8-4e6b-9d46-ceb6bae9f031 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:09.172730 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b013968b-e4a8-4e6b-9d46-ceb6bae9f031 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.167053 Dec 15 12:48:09.173285 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 652/1317] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:48:09 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:48:09.196452 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-cf3d1a5f-326b-415f-b131-da554a160092 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:09.197402 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-cf3d1a5f-326b-415f-b131-da554a160092 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:09.203675 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cf3d1a5f-326b-415f-b131-da554a160092 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:09.204128 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cf3d1a5f-326b-415f-b131-da554a160092 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:09.204906 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cf3d1a5f-326b-415f-b131-da554a160092 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:09.205350 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cf3d1a5f-326b-415f-b131-da554a160092 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:09.241012 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-cf3d1a5f-326b-415f-b131-da554a160092 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048122 Dec 15 12:48:09.241585 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 666/1318] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:09 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:09.720152 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c5922d43-8313-43a6-b6a4-9724c409e032 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:09.721070 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c5922d43-8313-43a6-b6a4-9724c409e032 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:09.727704 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c5922d43-8313-43a6-b6a4-9724c409e032 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:09.728145 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c5922d43-8313-43a6-b6a4-9724c409e032 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:09.730004 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c5922d43-8313-43a6-b6a4-9724c409e032 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:09.730640 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c5922d43-8313-43a6-b6a4-9724c409e032 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:09.762977 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c5922d43-8313-43a6-b6a4-9724c409e032 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046556 Dec 15 12:48:09.763522 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 653/1319] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:09 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:10.013761 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1ca2faf6-f2c0-4f03-b550-be448a32f217 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:10.014291 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1ca2faf6-f2c0-4f03-b550-be448a32f217 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:10.020838 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ca2faf6-f2c0-4f03-b550-be448a32f217 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:10.021286 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ca2faf6-f2c0-4f03-b550-be448a32f217 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:10.022099 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ca2faf6-f2c0-4f03-b550-be448a32f217 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:10.022535 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ca2faf6-f2c0-4f03-b550-be448a32f217 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:10.110227 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.objects.instance [None req-1ca2faf6-f2c0-4f03-b550-be448a32f217 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lazy-loading 'services' on Instance uuid 7081597f-acfc-473d-8e16-f7b52bcdd7c9 {{(pid=122614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 12:48:10.181775 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1ca2faf6-f2c0-4f03-b550-be448a32f217 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "DELETE /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9/os-volume_attachments/bbea2541-839d-464e-a72c-8c95c98d43e8" status: 202 len: 0 microversion: 2.1 time: 0.171509 Dec 15 12:48:10.182363 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 667/1320] 10.222.0.76 () {58 vars in 1415 bytes} [Wed Dec 15 12:48:10 2021] DELETE /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9/os-volume_attachments/bbea2541-839d-464e-a72c-8c95c98d43e8 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 12:48:10.197877 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e28cad5c-6511-4e3f-b377-f238df77fa7b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:10.198690 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e28cad5c-6511-4e3f-b377-f238df77fa7b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:10.210893 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e28cad5c-6511-4e3f-b377-f238df77fa7b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:10.211435 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e28cad5c-6511-4e3f-b377-f238df77fa7b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:10.212471 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e28cad5c-6511-4e3f-b377-f238df77fa7b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:10.213085 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e28cad5c-6511-4e3f-b377-f238df77fa7b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:10.253927 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f00dde16-9f19-437e-86fd-d482065c8ca9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:10.255096 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f00dde16-9f19-437e-86fd-d482065c8ca9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:10.262275 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f00dde16-9f19-437e-86fd-d482065c8ca9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:10.262999 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f00dde16-9f19-437e-86fd-d482065c8ca9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:10.263955 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f00dde16-9f19-437e-86fd-d482065c8ca9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:10.264872 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f00dde16-9f19-437e-86fd-d482065c8ca9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:10.301301 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f00dde16-9f19-437e-86fd-d482065c8ca9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052480 Dec 15 12:48:10.305166 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 668/1321] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:10 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:48:10.358893 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e28cad5c-6511-4e3f-b377-f238df77fa7b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:10.367914 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e28cad5c-6511-4e3f-b377-f238df77fa7b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:10.369377 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e28cad5c-6511-4e3f-b377-f238df77fa7b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:10.370565 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e28cad5c-6511-4e3f-b377-f238df77fa7b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.183130 Dec 15 12:48:10.371159 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 654/1322] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:48:10 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:48:10.774636 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c090292f-5f95-4697-946c-4e1e8bac1a76 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:10.775676 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c090292f-5f95-4697-946c-4e1e8bac1a76 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:10.782591 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c090292f-5f95-4697-946c-4e1e8bac1a76 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:10.783091 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c090292f-5f95-4697-946c-4e1e8bac1a76 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:10.783890 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c090292f-5f95-4697-946c-4e1e8bac1a76 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:10.784335 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c090292f-5f95-4697-946c-4e1e8bac1a76 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:10.816071 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c090292f-5f95-4697-946c-4e1e8bac1a76 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045211 Dec 15 12:48:10.816684 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 669/1323] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:10 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:48:11.312163 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-daeb3276-314e-4ae8-94d0-c62e0fbca4e3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:11.313081 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-daeb3276-314e-4ae8-94d0-c62e0fbca4e3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:11.319730 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-daeb3276-314e-4ae8-94d0-c62e0fbca4e3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:11.320177 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-daeb3276-314e-4ae8-94d0-c62e0fbca4e3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:11.320999 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-daeb3276-314e-4ae8-94d0-c62e0fbca4e3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:11.321436 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-daeb3276-314e-4ae8-94d0-c62e0fbca4e3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:11.359569 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-daeb3276-314e-4ae8-94d0-c62e0fbca4e3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050822 Dec 15 12:48:11.360131 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 655/1324] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:11 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:11.390929 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5bf10676-fec9-4b58-9d38-a74f5fd022cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:11.391658 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5bf10676-fec9-4b58-9d38-a74f5fd022cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:11.399702 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5bf10676-fec9-4b58-9d38-a74f5fd022cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:11.400186 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5bf10676-fec9-4b58-9d38-a74f5fd022cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:11.400961 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5bf10676-fec9-4b58-9d38-a74f5fd022cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:11.401394 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5bf10676-fec9-4b58-9d38-a74f5fd022cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:11.548182 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5bf10676-fec9-4b58-9d38-a74f5fd022cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:11.557168 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5bf10676-fec9-4b58-9d38-a74f5fd022cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:11.558846 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5bf10676-fec9-4b58-9d38-a74f5fd022cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:11.560043 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5bf10676-fec9-4b58-9d38-a74f5fd022cd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.172983 Dec 15 12:48:11.560607 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 670/1325] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:48:11 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:48:11.827804 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ada56a5d-ee98-413a-a8fe-22318509edf6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:11.828733 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ada56a5d-ee98-413a-a8fe-22318509edf6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:11.835361 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ada56a5d-ee98-413a-a8fe-22318509edf6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:11.835810 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ada56a5d-ee98-413a-a8fe-22318509edf6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:11.836602 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ada56a5d-ee98-413a-a8fe-22318509edf6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:11.837036 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ada56a5d-ee98-413a-a8fe-22318509edf6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:11.865903 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ada56a5d-ee98-413a-a8fe-22318509edf6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041883 Dec 15 12:48:11.866457 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 656/1326] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:11 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:12.370142 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5a9b10a9-97f3-4151-851a-1123e61a21e2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:12.371088 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5a9b10a9-97f3-4151-851a-1123e61a21e2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:12.377019 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5a9b10a9-97f3-4151-851a-1123e61a21e2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:12.377470 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5a9b10a9-97f3-4151-851a-1123e61a21e2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:12.378609 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5a9b10a9-97f3-4151-851a-1123e61a21e2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:12.379055 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5a9b10a9-97f3-4151-851a-1123e61a21e2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:12.416025 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5a9b10a9-97f3-4151-851a-1123e61a21e2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049532 Dec 15 12:48:12.416743 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 671/1327] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:12 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:12.578938 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-564cc109-68a0-49a2-8d50-95605ef4996c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:12.579471 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-564cc109-68a0-49a2-8d50-95605ef4996c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:12.585910 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-564cc109-68a0-49a2-8d50-95605ef4996c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:12.586356 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-564cc109-68a0-49a2-8d50-95605ef4996c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:12.587134 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-564cc109-68a0-49a2-8d50-95605ef4996c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:12.587567 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-564cc109-68a0-49a2-8d50-95605ef4996c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:12.733857 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-564cc109-68a0-49a2-8d50-95605ef4996c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:12.742914 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-564cc109-68a0-49a2-8d50-95605ef4996c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:12.744410 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-564cc109-68a0-49a2-8d50-95605ef4996c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:12.745616 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-564cc109-68a0-49a2-8d50-95605ef4996c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.170484 Dec 15 12:48:12.746174 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 657/1328] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:48:12 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:48:12.877657 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5d5869d1-e902-436b-8d11-0bfc3b79cc0d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:12.878528 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5d5869d1-e902-436b-8d11-0bfc3b79cc0d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:12.884873 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5d5869d1-e902-436b-8d11-0bfc3b79cc0d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:12.885319 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5d5869d1-e902-436b-8d11-0bfc3b79cc0d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:12.886135 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5d5869d1-e902-436b-8d11-0bfc3b79cc0d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:12.886575 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5d5869d1-e902-436b-8d11-0bfc3b79cc0d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:12.917027 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5d5869d1-e902-436b-8d11-0bfc3b79cc0d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043134 Dec 15 12:48:12.917665 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 672/1329] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:12 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:13.427795 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-066146eb-0af4-458a-9088-64f409becba5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:13.428740 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-066146eb-0af4-458a-9088-64f409becba5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:13.434611 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-066146eb-0af4-458a-9088-64f409becba5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:13.435057 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-066146eb-0af4-458a-9088-64f409becba5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:13.435839 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-066146eb-0af4-458a-9088-64f409becba5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:13.436274 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-066146eb-0af4-458a-9088-64f409becba5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:13.466829 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-066146eb-0af4-458a-9088-64f409becba5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043245 Dec 15 12:48:13.467380 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 658/1330] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:13 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:13.771537 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-69329484-a9d1-4621-ae69-774fde252f96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:13.772381 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-69329484-a9d1-4621-ae69-774fde252f96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:13.778408 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-69329484-a9d1-4621-ae69-774fde252f96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:13.778859 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-69329484-a9d1-4621-ae69-774fde252f96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:13.779632 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-69329484-a9d1-4621-ae69-774fde252f96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:13.780071 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-69329484-a9d1-4621-ae69-774fde252f96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:13.922975 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-69329484-a9d1-4621-ae69-774fde252f96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:13.928094 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fa4a2e0e-0c81-45a8-9ba9-9368f91e211e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:13.929009 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fa4a2e0e-0c81-45a8-9ba9-9368f91e211e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:13.931850 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-69329484-a9d1-4621-ae69-774fde252f96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:13.933334 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-69329484-a9d1-4621-ae69-774fde252f96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:13.934581 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-69329484-a9d1-4621-ae69-774fde252f96 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.167248 Dec 15 12:48:13.935136 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 673/1331] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:48:13 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:48:13.935387 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fa4a2e0e-0c81-45a8-9ba9-9368f91e211e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:13.935901 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fa4a2e0e-0c81-45a8-9ba9-9368f91e211e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:13.936719 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fa4a2e0e-0c81-45a8-9ba9-9368f91e211e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:13.937156 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fa4a2e0e-0c81-45a8-9ba9-9368f91e211e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:13.967357 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fa4a2e0e-0c81-45a8-9ba9-9368f91e211e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042932 Dec 15 12:48:13.967937 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 659/1332] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:13 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:14.478129 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e446c7e7-6d3d-4c83-bd4f-e80a0c0c13ff tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:14.479049 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e446c7e7-6d3d-4c83-bd4f-e80a0c0c13ff tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:14.485024 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e446c7e7-6d3d-4c83-bd4f-e80a0c0c13ff tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:14.485560 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e446c7e7-6d3d-4c83-bd4f-e80a0c0c13ff tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:14.486388 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e446c7e7-6d3d-4c83-bd4f-e80a0c0c13ff tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:14.486827 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e446c7e7-6d3d-4c83-bd4f-e80a0c0c13ff tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:14.518502 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e446c7e7-6d3d-4c83-bd4f-e80a0c0c13ff tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044049 Dec 15 12:48:14.519100 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 674/1333] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:14 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:48:14.953911 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-54dd43c0-4ade-4b86-8a4f-bf990f7fb447 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:14.954576 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-54dd43c0-4ade-4b86-8a4f-bf990f7fb447 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:14.961676 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-54dd43c0-4ade-4b86-8a4f-bf990f7fb447 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:14.962127 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-54dd43c0-4ade-4b86-8a4f-bf990f7fb447 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:14.962916 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-54dd43c0-4ade-4b86-8a4f-bf990f7fb447 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:14.963351 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-54dd43c0-4ade-4b86-8a4f-bf990f7fb447 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:14.983239 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b41baed3-f794-44b4-9c34-1cdedb639977 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:14.984206 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b41baed3-f794-44b4-9c34-1cdedb639977 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:14.990596 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b41baed3-f794-44b4-9c34-1cdedb639977 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:14.991041 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b41baed3-f794-44b4-9c34-1cdedb639977 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:14.991825 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b41baed3-f794-44b4-9c34-1cdedb639977 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:14.992251 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b41baed3-f794-44b4-9c34-1cdedb639977 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:15.023413 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b41baed3-f794-44b4-9c34-1cdedb639977 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043859 Dec 15 12:48:15.023990 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 675/1334] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:14 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:15.107393 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-54dd43c0-4ade-4b86-8a4f-bf990f7fb447 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:15.116172 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-54dd43c0-4ade-4b86-8a4f-bf990f7fb447 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:15.117717 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-54dd43c0-4ade-4b86-8a4f-bf990f7fb447 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:15.118900 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-54dd43c0-4ade-4b86-8a4f-bf990f7fb447 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.168743 Dec 15 12:48:15.119468 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 660/1335] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:48:14 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:48:15.529845 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1960056e-4a38-496c-90ad-64aea5b1f54c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:15.530750 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1960056e-4a38-496c-90ad-64aea5b1f54c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:15.536683 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1960056e-4a38-496c-90ad-64aea5b1f54c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:15.537133 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1960056e-4a38-496c-90ad-64aea5b1f54c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:15.537944 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1960056e-4a38-496c-90ad-64aea5b1f54c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:15.538385 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1960056e-4a38-496c-90ad-64aea5b1f54c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:15.573845 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1960056e-4a38-496c-90ad-64aea5b1f54c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047686 Dec 15 12:48:15.574429 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 676/1336] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:15 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:16.035009 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0e596544-202c-4f2b-91f0-a41dae09d3d2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:16.036026 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0e596544-202c-4f2b-91f0-a41dae09d3d2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:16.042251 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e596544-202c-4f2b-91f0-a41dae09d3d2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:16.042692 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e596544-202c-4f2b-91f0-a41dae09d3d2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:16.043469 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e596544-202c-4f2b-91f0-a41dae09d3d2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:16.043894 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e596544-202c-4f2b-91f0-a41dae09d3d2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:16.074312 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0e596544-202c-4f2b-91f0-a41dae09d3d2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042958 Dec 15 12:48:16.075044 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 661/1337] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:16 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:16.137732 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-27d792f2-8b8c-4c0a-ab42-b35b8a6ce850 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:16.138322 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-27d792f2-8b8c-4c0a-ab42-b35b8a6ce850 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:16.144804 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-27d792f2-8b8c-4c0a-ab42-b35b8a6ce850 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:16.145266 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-27d792f2-8b8c-4c0a-ab42-b35b8a6ce850 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:16.146065 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-27d792f2-8b8c-4c0a-ab42-b35b8a6ce850 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:16.146502 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-27d792f2-8b8c-4c0a-ab42-b35b8a6ce850 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:16.283859 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-27d792f2-8b8c-4c0a-ab42-b35b8a6ce850 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:16.292843 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-27d792f2-8b8c-4c0a-ab42-b35b8a6ce850 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:16.294392 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-27d792f2-8b8c-4c0a-ab42-b35b8a6ce850 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:16.295565 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-27d792f2-8b8c-4c0a-ab42-b35b8a6ce850 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.161617 Dec 15 12:48:16.296132 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 677/1338] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:48:16 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:48:16.584172 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f6c1401a-8c66-48e1-8402-2457d2d9d346 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:16.585104 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f6c1401a-8c66-48e1-8402-2457d2d9d346 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:16.590906 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f6c1401a-8c66-48e1-8402-2457d2d9d346 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:16.591346 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f6c1401a-8c66-48e1-8402-2457d2d9d346 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:16.592110 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f6c1401a-8c66-48e1-8402-2457d2d9d346 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:16.592544 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f6c1401a-8c66-48e1-8402-2457d2d9d346 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:16.623304 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f6c1401a-8c66-48e1-8402-2457d2d9d346 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042829 Dec 15 12:48:16.623861 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 662/1339] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:16 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:17.086457 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-df4c3866-438e-42a8-b5c5-bc041de641cd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:17.087382 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-df4c3866-438e-42a8-b5c5-bc041de641cd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:17.093190 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df4c3866-438e-42a8-b5c5-bc041de641cd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:17.093682 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df4c3866-438e-42a8-b5c5-bc041de641cd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:17.094463 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df4c3866-438e-42a8-b5c5-bc041de641cd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:17.094899 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df4c3866-438e-42a8-b5c5-bc041de641cd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:17.125847 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-df4c3866-438e-42a8-b5c5-bc041de641cd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043071 Dec 15 12:48:17.126419 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 678/1340] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:17 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:17.314357 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6610d2b9-b12c-42b6-b345-560aa3446dde tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:17.314997 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6610d2b9-b12c-42b6-b345-560aa3446dde tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:17.322063 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6610d2b9-b12c-42b6-b345-560aa3446dde tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:17.322517 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6610d2b9-b12c-42b6-b345-560aa3446dde tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:17.323342 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6610d2b9-b12c-42b6-b345-560aa3446dde tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:17.323780 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6610d2b9-b12c-42b6-b345-560aa3446dde tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:17.460092 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6610d2b9-b12c-42b6-b345-560aa3446dde tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:17.468129 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6610d2b9-b12c-42b6-b345-560aa3446dde tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:17.469630 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6610d2b9-b12c-42b6-b345-560aa3446dde tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:17.470758 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6610d2b9-b12c-42b6-b345-560aa3446dde tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.160176 Dec 15 12:48:17.471311 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 663/1341] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:48:17 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:48:17.635451 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-efdb126f-f9f6-42be-993b-22ec2d5e40fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:48:17.636385 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-efdb126f-f9f6-42be-993b-22ec2d5e40fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:17.642880 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-efdb126f-f9f6-42be-993b-22ec2d5e40fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:17.643322 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-efdb126f-f9f6-42be-993b-22ec2d5e40fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:17.644143 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-efdb126f-f9f6-42be-993b-22ec2d5e40fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:17.644581 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-efdb126f-f9f6-42be-993b-22ec2d5e40fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:17.747764 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-efdb126f-f9f6-42be-993b-22ec2d5e40fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "POST /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/action" status: 200 len: 93458 microversion: 2.1 time: 0.115715 Dec 15 12:48:17.748463 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 679/1342] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 12:48:17 2021] POST /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a/action => generated 93458 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:18.137531 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f88d0abc-0eb8-4dbb-bd3a-8b2b4e2e68b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:18.138476 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f88d0abc-0eb8-4dbb-bd3a-8b2b4e2e68b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:18.145029 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f88d0abc-0eb8-4dbb-bd3a-8b2b4e2e68b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:18.145470 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f88d0abc-0eb8-4dbb-bd3a-8b2b4e2e68b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:18.146263 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f88d0abc-0eb8-4dbb-bd3a-8b2b4e2e68b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:18.146694 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f88d0abc-0eb8-4dbb-bd3a-8b2b4e2e68b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:18.178229 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f88d0abc-0eb8-4dbb-bd3a-8b2b4e2e68b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044431 Dec 15 12:48:18.178796 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 664/1343] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:18 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:18.489949 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-860b7252-cff4-43a3-b3a5-b1fffe1b5816 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:18.490646 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-860b7252-cff4-43a3-b3a5-b1fffe1b5816 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:18.497552 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-860b7252-cff4-43a3-b3a5-b1fffe1b5816 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:18.498004 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-860b7252-cff4-43a3-b3a5-b1fffe1b5816 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:18.498787 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-860b7252-cff4-43a3-b3a5-b1fffe1b5816 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:18.499223 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-860b7252-cff4-43a3-b3a5-b1fffe1b5816 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:18.635375 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-860b7252-cff4-43a3-b3a5-b1fffe1b5816 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:18.644578 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-860b7252-cff4-43a3-b3a5-b1fffe1b5816 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:18.646127 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-860b7252-cff4-43a3-b3a5-b1fffe1b5816 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:18.647306 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-860b7252-cff4-43a3-b3a5-b1fffe1b5816 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.162112 Dec 15 12:48:18.647863 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 680/1344] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:48:18 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:48:19.189290 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-44117d03-e8aa-4895-b228-5d4b335cdd3d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:19.191631 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-44117d03-e8aa-4895-b228-5d4b335cdd3d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:19.196794 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-44117d03-e8aa-4895-b228-5d4b335cdd3d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:19.197231 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-44117d03-e8aa-4895-b228-5d4b335cdd3d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:19.198320 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-44117d03-e8aa-4895-b228-5d4b335cdd3d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:19.198779 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-44117d03-e8aa-4895-b228-5d4b335cdd3d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:19.231503 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-44117d03-e8aa-4895-b228-5d4b335cdd3d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045868 Dec 15 12:48:19.232053 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 665/1345] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:19 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:19.665333 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b1e1d265-73da-436f-9b91-4802c03ffba3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:19.665978 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b1e1d265-73da-436f-9b91-4802c03ffba3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:19.672944 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b1e1d265-73da-436f-9b91-4802c03ffba3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:19.673390 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b1e1d265-73da-436f-9b91-4802c03ffba3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:19.674239 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b1e1d265-73da-436f-9b91-4802c03ffba3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:19.674665 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b1e1d265-73da-436f-9b91-4802c03ffba3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:19.809649 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b1e1d265-73da-436f-9b91-4802c03ffba3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:19.818635 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b1e1d265-73da-436f-9b91-4802c03ffba3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:19.820142 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b1e1d265-73da-436f-9b91-4802c03ffba3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:19.821294 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b1e1d265-73da-436f-9b91-4802c03ffba3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.159698 Dec 15 12:48:19.821877 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 681/1346] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:48:19 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:48:20.243874 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c77db80a-816a-498a-84f3-9c812bd1c7a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:20.252289 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c77db80a-816a-498a-84f3-9c812bd1c7a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:20.260460 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c77db80a-816a-498a-84f3-9c812bd1c7a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:20.260908 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c77db80a-816a-498a-84f3-9c812bd1c7a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:20.261730 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c77db80a-816a-498a-84f3-9c812bd1c7a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:20.262163 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c77db80a-816a-498a-84f3-9c812bd1c7a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:20.293289 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c77db80a-816a-498a-84f3-9c812bd1c7a5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053206 Dec 15 12:48:20.293884 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 666/1347] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:20 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:20.839736 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bd2f0534-143a-4ddb-a265-f29002e85256 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:20.840348 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bd2f0534-143a-4ddb-a265-f29002e85256 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:20.846672 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bd2f0534-143a-4ddb-a265-f29002e85256 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:20.847702 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bd2f0534-143a-4ddb-a265-f29002e85256 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:20.848648 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bd2f0534-143a-4ddb-a265-f29002e85256 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:20.849077 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bd2f0534-143a-4ddb-a265-f29002e85256 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:20.990943 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-bd2f0534-143a-4ddb-a265-f29002e85256 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:20.999221 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-bd2f0534-143a-4ddb-a265-f29002e85256 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:21.000727 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-bd2f0534-143a-4ddb-a265-f29002e85256 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:21.001918 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bd2f0534-143a-4ddb-a265-f29002e85256 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.165867 Dec 15 12:48:21.002473 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 682/1348] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:48:20 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:48:21.306520 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9eecfe93-f3e0-4335-b32d-5527077f9333 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:21.307429 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9eecfe93-f3e0-4335-b32d-5527077f9333 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:21.314085 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9eecfe93-f3e0-4335-b32d-5527077f9333 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:21.314650 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9eecfe93-f3e0-4335-b32d-5527077f9333 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:21.315327 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9eecfe93-f3e0-4335-b32d-5527077f9333 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:21.316369 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9eecfe93-f3e0-4335-b32d-5527077f9333 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:21.353291 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9eecfe93-f3e0-4335-b32d-5527077f9333 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051044 Dec 15 12:48:21.353887 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 667/1349] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:21 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:22.020544 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-dfca461f-5cc3-4ac4-9df3-b98e8e670f85 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:22.021161 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-dfca461f-5cc3-4ac4-9df3-b98e8e670f85 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:22.027781 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dfca461f-5cc3-4ac4-9df3-b98e8e670f85 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:22.028235 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dfca461f-5cc3-4ac4-9df3-b98e8e670f85 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:22.029022 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dfca461f-5cc3-4ac4-9df3-b98e8e670f85 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:22.029453 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dfca461f-5cc3-4ac4-9df3-b98e8e670f85 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:22.171395 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-dfca461f-5cc3-4ac4-9df3-b98e8e670f85 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:22.180898 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-dfca461f-5cc3-4ac4-9df3-b98e8e670f85 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:22.182425 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-dfca461f-5cc3-4ac4-9df3-b98e8e670f85 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:22.183582 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-dfca461f-5cc3-4ac4-9df3-b98e8e670f85 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.167125 Dec 15 12:48:22.184146 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 683/1350] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:48:22 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 12:48:22.364601 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d592b605-809a-4adf-b662-0df22efcc4aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:22.365541 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d592b605-809a-4adf-b662-0df22efcc4aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:22.372444 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d592b605-809a-4adf-b662-0df22efcc4aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:22.372875 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d592b605-809a-4adf-b662-0df22efcc4aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:22.373704 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d592b605-809a-4adf-b662-0df22efcc4aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:22.374137 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d592b605-809a-4adf-b662-0df22efcc4aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:22.405696 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d592b605-809a-4adf-b662-0df22efcc4aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045128 Dec 15 12:48:22.406258 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 668/1351] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:22 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:23.201056 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-64e6bb6b-43ed-4dca-a1dc-cb61960ffd30 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:23.201709 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-64e6bb6b-43ed-4dca-a1dc-cb61960ffd30 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:23.208002 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-64e6bb6b-43ed-4dca-a1dc-cb61960ffd30 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:23.208441 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-64e6bb6b-43ed-4dca-a1dc-cb61960ffd30 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:23.209216 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-64e6bb6b-43ed-4dca-a1dc-cb61960ffd30 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:23.209684 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-64e6bb6b-43ed-4dca-a1dc-cb61960ffd30 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:23.348748 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-64e6bb6b-43ed-4dca-a1dc-cb61960ffd30 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:23.356941 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-64e6bb6b-43ed-4dca-a1dc-cb61960ffd30 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:23.358457 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-64e6bb6b-43ed-4dca-a1dc-cb61960ffd30 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:48:23.359609 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-64e6bb6b-43ed-4dca-a1dc-cb61960ffd30 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 200 len: 1753 microversion: 2.20 time: 0.162282 Dec 15 12:48:23.360176 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 684/1352] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 12:48:23 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 12:48:23.418138 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8353e16c-0765-4ae8-b71f-6390486f0e1a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:23.419044 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8353e16c-0765-4ae8-b71f-6390486f0e1a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:23.425869 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8353e16c-0765-4ae8-b71f-6390486f0e1a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:23.426305 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8353e16c-0765-4ae8-b71f-6390486f0e1a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:23.427138 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8353e16c-0765-4ae8-b71f-6390486f0e1a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:23.427616 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8353e16c-0765-4ae8-b71f-6390486f0e1a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:23.430594 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b9b8ef33-4ec0-41ac-a15b-b5bfaf301ff0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:23.431093 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b9b8ef33-4ec0-41ac-a15b-b5bfaf301ff0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:23.436751 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b9b8ef33-4ec0-41ac-a15b-b5bfaf301ff0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:23.437198 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b9b8ef33-4ec0-41ac-a15b-b5bfaf301ff0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:23.438016 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b9b8ef33-4ec0-41ac-a15b-b5bfaf301ff0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:23.438456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b9b8ef33-4ec0-41ac-a15b-b5bfaf301ff0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:23.457920 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8353e16c-0765-4ae8-b71f-6390486f0e1a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043284 Dec 15 12:48:23.458404 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 669/1353] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:23 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:48:23.516837 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.wsgi [None req-b9b8ef33-4ec0-41ac-a15b-b5bfaf301ff0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] HTTP exception thrown: Cannot 'detach_volume' instance ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 while it is in task_state spawning Dec 15 12:48:23.517429 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b9b8ef33-4ec0-41ac-a15b-b5bfaf301ff0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Returning 409 to user: Cannot 'detach_volume' instance ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 while it is in task_state spawning {{(pid=122614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:48:23.518285 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b9b8ef33-4ec0-41ac-a15b-b5bfaf301ff0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments/576fc6de-ae11-4b3b-ba2c-44c2f85edfd6" status: 409 len: 155 microversion: 2.20 time: 0.091850 Dec 15 12:48:23.518899 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 685/1354] 10.222.0.76 () {60 vars in 1456 bytes} [Wed Dec 15 12:48:23 2021] DELETE /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments/576fc6de-ae11-4b3b-ba2c-44c2f85edfd6 => generated 155 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 380 bytes (2 switches on core 0) Dec 15 12:48:23.528213 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b1855839-2dc6-4dca-88d8-7373c4ab8d3a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:23.529154 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b1855839-2dc6-4dca-88d8-7373c4ab8d3a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:23.535754 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1855839-2dc6-4dca-88d8-7373c4ab8d3a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:23.536190 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1855839-2dc6-4dca-88d8-7373c4ab8d3a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:23.536974 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1855839-2dc6-4dca-88d8-7373c4ab8d3a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:23.537401 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1855839-2dc6-4dca-88d8-7373c4ab8d3a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:23.566143 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b1855839-2dc6-4dca-88d8-7373c4ab8d3a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041747 Dec 15 12:48:23.566697 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 670/1355] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:23 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:24.469846 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d0643467-5488-4a3c-96e6-2e5399e6fbbd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:24.470853 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d0643467-5488-4a3c-96e6-2e5399e6fbbd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:24.478326 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d0643467-5488-4a3c-96e6-2e5399e6fbbd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:24.478770 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d0643467-5488-4a3c-96e6-2e5399e6fbbd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:24.479557 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d0643467-5488-4a3c-96e6-2e5399e6fbbd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:24.479991 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d0643467-5488-4a3c-96e6-2e5399e6fbbd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:24.509279 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d0643467-5488-4a3c-96e6-2e5399e6fbbd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043196 Dec 15 12:48:24.509865 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 686/1356] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:24 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:24.578206 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9b5fa641-747c-45bc-aa9e-43707dc97f72 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:24.579023 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9b5fa641-747c-45bc-aa9e-43707dc97f72 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:24.585747 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9b5fa641-747c-45bc-aa9e-43707dc97f72 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:24.586195 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9b5fa641-747c-45bc-aa9e-43707dc97f72 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:24.586963 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9b5fa641-747c-45bc-aa9e-43707dc97f72 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:24.587390 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9b5fa641-747c-45bc-aa9e-43707dc97f72 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:24.616133 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9b5fa641-747c-45bc-aa9e-43707dc97f72 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041770 Dec 15 12:48:24.616692 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 671/1357] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:24 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:25.520902 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d1261a26-dd70-4945-84fa-dad3c7fab589 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:25.521820 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d1261a26-dd70-4945-84fa-dad3c7fab589 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:25.528032 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d1261a26-dd70-4945-84fa-dad3c7fab589 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:25.528479 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d1261a26-dd70-4945-84fa-dad3c7fab589 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:25.529254 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d1261a26-dd70-4945-84fa-dad3c7fab589 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:25.529722 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d1261a26-dd70-4945-84fa-dad3c7fab589 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:25.567321 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d1261a26-dd70-4945-84fa-dad3c7fab589 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050162 Dec 15 12:48:25.567818 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 687/1358] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:25 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:25.628089 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0e40e938-8b79-4852-b582-2c9ff1ce1c5c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:25.628995 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0e40e938-8b79-4852-b582-2c9ff1ce1c5c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:25.635621 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e40e938-8b79-4852-b582-2c9ff1ce1c5c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:25.636065 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e40e938-8b79-4852-b582-2c9ff1ce1c5c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:25.636845 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e40e938-8b79-4852-b582-2c9ff1ce1c5c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:25.637309 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e40e938-8b79-4852-b582-2c9ff1ce1c5c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:25.668727 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0e40e938-8b79-4852-b582-2c9ff1ce1c5c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044383 Dec 15 12:48:25.669307 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 672/1359] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:25 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:26.578870 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-46c11f0b-2b3f-4998-9da2-ab866ec346c3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:26.579696 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-46c11f0b-2b3f-4998-9da2-ab866ec346c3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:26.586031 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-46c11f0b-2b3f-4998-9da2-ab866ec346c3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:26.586480 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-46c11f0b-2b3f-4998-9da2-ab866ec346c3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:26.587276 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-46c11f0b-2b3f-4998-9da2-ab866ec346c3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:26.587714 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-46c11f0b-2b3f-4998-9da2-ab866ec346c3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:26.618755 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-46c11f0b-2b3f-4998-9da2-ab866ec346c3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043774 Dec 15 12:48:26.619363 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 688/1360] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:26 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:26.681015 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2c7db92c-c9c2-48f4-b3d4-a4e96b22802a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:26.681952 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2c7db92c-c9c2-48f4-b3d4-a4e96b22802a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:26.688329 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2c7db92c-c9c2-48f4-b3d4-a4e96b22802a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:26.688776 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2c7db92c-c9c2-48f4-b3d4-a4e96b22802a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:26.689579 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2c7db92c-c9c2-48f4-b3d4-a4e96b22802a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:26.690012 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2c7db92c-c9c2-48f4-b3d4-a4e96b22802a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:26.727842 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2c7db92c-c9c2-48f4-b3d4-a4e96b22802a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050617 Dec 15 12:48:26.728407 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 673/1361] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:26 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:27.631148 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5346bbe6-b25e-4f2e-9887-e76caf721a2b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:27.632062 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5346bbe6-b25e-4f2e-9887-e76caf721a2b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:27.639012 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5346bbe6-b25e-4f2e-9887-e76caf721a2b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:27.639766 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5346bbe6-b25e-4f2e-9887-e76caf721a2b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:27.641146 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5346bbe6-b25e-4f2e-9887-e76caf721a2b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:27.642053 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5346bbe6-b25e-4f2e-9887-e76caf721a2b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:27.677480 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5346bbe6-b25e-4f2e-9887-e76caf721a2b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050936 Dec 15 12:48:27.678065 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 689/1362] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:27 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:27.741103 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fe55bbf2-3aeb-4455-b59d-b0df04a6734b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:27.742055 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fe55bbf2-3aeb-4455-b59d-b0df04a6734b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:27.748020 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fe55bbf2-3aeb-4455-b59d-b0df04a6734b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:27.748471 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fe55bbf2-3aeb-4455-b59d-b0df04a6734b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:27.749256 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fe55bbf2-3aeb-4455-b59d-b0df04a6734b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:27.749727 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fe55bbf2-3aeb-4455-b59d-b0df04a6734b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:27.786275 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fe55bbf2-3aeb-4455-b59d-b0df04a6734b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050069 Dec 15 12:48:27.786837 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 674/1363] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:27 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:28.688282 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3cce05b3-05db-4a91-a7ab-4da3fb82ace9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:28.693940 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3cce05b3-05db-4a91-a7ab-4da3fb82ace9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:28.697671 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3cce05b3-05db-4a91-a7ab-4da3fb82ace9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:28.698127 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3cce05b3-05db-4a91-a7ab-4da3fb82ace9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:28.698966 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3cce05b3-05db-4a91-a7ab-4da3fb82ace9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:28.699399 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3cce05b3-05db-4a91-a7ab-4da3fb82ace9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:28.729035 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3cce05b3-05db-4a91-a7ab-4da3fb82ace9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044525 Dec 15 12:48:28.729603 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 690/1364] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:28 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:48:28.799657 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c8dfd074-0fed-41e4-9da9-5a0b4a758e54 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:28.801361 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c8dfd074-0fed-41e4-9da9-5a0b4a758e54 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:28.808106 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c8dfd074-0fed-41e4-9da9-5a0b4a758e54 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:28.808544 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c8dfd074-0fed-41e4-9da9-5a0b4a758e54 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:28.809328 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c8dfd074-0fed-41e4-9da9-5a0b4a758e54 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:28.809780 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c8dfd074-0fed-41e4-9da9-5a0b4a758e54 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:28.839352 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c8dfd074-0fed-41e4-9da9-5a0b4a758e54 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045109 Dec 15 12:48:28.839895 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 675/1365] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:28 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:29.742956 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4d28e48b-3af5-4846-a868-0846098dc16f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:29.744460 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4d28e48b-3af5-4846-a868-0846098dc16f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:29.751362 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4d28e48b-3af5-4846-a868-0846098dc16f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:29.751819 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4d28e48b-3af5-4846-a868-0846098dc16f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:29.752612 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4d28e48b-3af5-4846-a868-0846098dc16f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:29.753049 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4d28e48b-3af5-4846-a868-0846098dc16f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:29.781902 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4d28e48b-3af5-4846-a868-0846098dc16f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045316 Dec 15 12:48:29.782455 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 691/1366] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:29 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:29.851943 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-87b0d89f-69f7-4939-9e8a-ac4b85c44598 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:29.852839 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-87b0d89f-69f7-4939-9e8a-ac4b85c44598 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:29.859069 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-87b0d89f-69f7-4939-9e8a-ac4b85c44598 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:29.859507 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-87b0d89f-69f7-4939-9e8a-ac4b85c44598 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:29.860272 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-87b0d89f-69f7-4939-9e8a-ac4b85c44598 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:29.860694 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-87b0d89f-69f7-4939-9e8a-ac4b85c44598 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:29.890050 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-87b0d89f-69f7-4939-9e8a-ac4b85c44598 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042674 Dec 15 12:48:29.890603 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 676/1367] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:29 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:30.793479 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-22cc31bc-d42d-4e9f-abd4-1e6b9af85f4f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:30.794398 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-22cc31bc-d42d-4e9f-abd4-1e6b9af85f4f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:30.800717 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-22cc31bc-d42d-4e9f-abd4-1e6b9af85f4f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:30.801191 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-22cc31bc-d42d-4e9f-abd4-1e6b9af85f4f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:30.802018 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-22cc31bc-d42d-4e9f-abd4-1e6b9af85f4f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:30.802442 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-22cc31bc-d42d-4e9f-abd4-1e6b9af85f4f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:30.830903 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-22cc31bc-d42d-4e9f-abd4-1e6b9af85f4f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041063 Dec 15 12:48:30.831477 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 692/1368] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:30 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:30.902210 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0a5c6467-671b-46b7-9e43-46083600accc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:30.903120 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0a5c6467-671b-46b7-9e43-46083600accc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:30.909381 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0a5c6467-671b-46b7-9e43-46083600accc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:30.909923 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0a5c6467-671b-46b7-9e43-46083600accc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:30.910757 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0a5c6467-671b-46b7-9e43-46083600accc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:30.911191 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0a5c6467-671b-46b7-9e43-46083600accc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:30.946183 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0a5c6467-671b-46b7-9e43-46083600accc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047701 Dec 15 12:48:30.946875 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 677/1369] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:30 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:31.843186 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-81c33efd-9cea-485c-92a9-55e51b011488 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:31.844090 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-81c33efd-9cea-485c-92a9-55e51b011488 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:31.850371 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-81c33efd-9cea-485c-92a9-55e51b011488 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:31.850819 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-81c33efd-9cea-485c-92a9-55e51b011488 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:31.851605 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-81c33efd-9cea-485c-92a9-55e51b011488 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:31.852042 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-81c33efd-9cea-485c-92a9-55e51b011488 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:31.883131 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-81c33efd-9cea-485c-92a9-55e51b011488 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043604 Dec 15 12:48:31.883715 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 693/1370] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:31 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:31.957738 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d180f073-3770-4be1-97b2-39fc00cfb18b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:31.958559 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d180f073-3770-4be1-97b2-39fc00cfb18b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:31.964751 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d180f073-3770-4be1-97b2-39fc00cfb18b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:31.965192 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d180f073-3770-4be1-97b2-39fc00cfb18b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:31.966000 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d180f073-3770-4be1-97b2-39fc00cfb18b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:31.966434 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d180f073-3770-4be1-97b2-39fc00cfb18b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:31.996708 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d180f073-3770-4be1-97b2-39fc00cfb18b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043000 Dec 15 12:48:31.997265 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 678/1371] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:31 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:32.894096 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a1af515e-35d7-44ed-a119-9b0cadc3cf7f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:32.895008 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a1af515e-35d7-44ed-a119-9b0cadc3cf7f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:32.901290 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a1af515e-35d7-44ed-a119-9b0cadc3cf7f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:32.901771 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a1af515e-35d7-44ed-a119-9b0cadc3cf7f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:32.902548 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a1af515e-35d7-44ed-a119-9b0cadc3cf7f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:32.902984 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a1af515e-35d7-44ed-a119-9b0cadc3cf7f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:32.933673 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a1af515e-35d7-44ed-a119-9b0cadc3cf7f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043327 Dec 15 12:48:32.934233 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 694/1372] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:32 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:33.009217 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bbf1463d-0ee9-452c-9af6-4fa04082cba1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:33.010375 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bbf1463d-0ee9-452c-9af6-4fa04082cba1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:33.016620 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bbf1463d-0ee9-452c-9af6-4fa04082cba1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:33.017088 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bbf1463d-0ee9-452c-9af6-4fa04082cba1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:33.017946 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bbf1463d-0ee9-452c-9af6-4fa04082cba1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:33.018380 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bbf1463d-0ee9-452c-9af6-4fa04082cba1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:33.048610 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bbf1463d-0ee9-452c-9af6-4fa04082cba1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043458 Dec 15 12:48:33.049184 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 679/1373] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:33 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:33.944558 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7f3b8c35-5eda-48a8-bb43-da551a6c8d65 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:33.945464 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7f3b8c35-5eda-48a8-bb43-da551a6c8d65 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:33.951843 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7f3b8c35-5eda-48a8-bb43-da551a6c8d65 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:33.952287 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7f3b8c35-5eda-48a8-bb43-da551a6c8d65 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:33.953094 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7f3b8c35-5eda-48a8-bb43-da551a6c8d65 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:33.953553 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7f3b8c35-5eda-48a8-bb43-da551a6c8d65 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:33.984838 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7f3b8c35-5eda-48a8-bb43-da551a6c8d65 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043982 Dec 15 12:48:33.985406 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 695/1374] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:33 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:34.060294 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-59b38184-2d36-4686-b151-678a7ec09e8c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:34.061200 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-59b38184-2d36-4686-b151-678a7ec09e8c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:34.071362 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-59b38184-2d36-4686-b151-678a7ec09e8c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:34.071811 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-59b38184-2d36-4686-b151-678a7ec09e8c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:34.072616 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-59b38184-2d36-4686-b151-678a7ec09e8c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:34.073055 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-59b38184-2d36-4686-b151-678a7ec09e8c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:34.103184 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-59b38184-2d36-4686-b151-678a7ec09e8c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046674 Dec 15 12:48:34.103740 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 680/1375] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:34 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:34.996883 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-921807a0-3ada-41b0-a398-1a84a76f25d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:34.997812 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-921807a0-3ada-41b0-a398-1a84a76f25d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:35.005229 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-921807a0-3ada-41b0-a398-1a84a76f25d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:35.006003 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-921807a0-3ada-41b0-a398-1a84a76f25d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:35.006844 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-921807a0-3ada-41b0-a398-1a84a76f25d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:35.007283 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-921807a0-3ada-41b0-a398-1a84a76f25d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:35.037948 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-921807a0-3ada-41b0-a398-1a84a76f25d0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044674 Dec 15 12:48:35.038529 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 696/1376] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:34 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:35.115452 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e66b3d44-431d-4745-9299-2f330c03f30f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:35.116372 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e66b3d44-431d-4745-9299-2f330c03f30f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:35.122837 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e66b3d44-431d-4745-9299-2f330c03f30f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:35.123283 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e66b3d44-431d-4745-9299-2f330c03f30f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:35.124074 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e66b3d44-431d-4745-9299-2f330c03f30f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:35.124506 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e66b3d44-431d-4745-9299-2f330c03f30f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:35.154656 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e66b3d44-431d-4745-9299-2f330c03f30f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043595 Dec 15 12:48:35.155287 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 681/1377] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:35 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:36.049413 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8e176263-b54a-46f2-b6ce-21c210d6c558 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:36.051188 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8e176263-b54a-46f2-b6ce-21c210d6c558 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:36.057690 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8e176263-b54a-46f2-b6ce-21c210d6c558 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:36.058143 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8e176263-b54a-46f2-b6ce-21c210d6c558 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:36.058942 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8e176263-b54a-46f2-b6ce-21c210d6c558 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:36.059378 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8e176263-b54a-46f2-b6ce-21c210d6c558 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:36.087847 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8e176263-b54a-46f2-b6ce-21c210d6c558 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042242 Dec 15 12:48:36.088400 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 697/1378] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:36 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:36.166382 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d22cf390-355b-49d3-baab-d1869c47598e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:36.167321 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d22cf390-355b-49d3-baab-d1869c47598e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:36.173565 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d22cf390-355b-49d3-baab-d1869c47598e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:36.174046 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d22cf390-355b-49d3-baab-d1869c47598e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:36.174825 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d22cf390-355b-49d3-baab-d1869c47598e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:36.175381 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d22cf390-355b-49d3-baab-d1869c47598e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:36.205119 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d22cf390-355b-49d3-baab-d1869c47598e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042355 Dec 15 12:48:36.205655 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 682/1379] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:36 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:37.099623 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e5fd8d3f-cc8b-46ee-ae51-4453e9a71e02 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:37.100482 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e5fd8d3f-cc8b-46ee-ae51-4453e9a71e02 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:37.106828 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e5fd8d3f-cc8b-46ee-ae51-4453e9a71e02 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:37.107270 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e5fd8d3f-cc8b-46ee-ae51-4453e9a71e02 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:37.108055 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e5fd8d3f-cc8b-46ee-ae51-4453e9a71e02 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:37.108495 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e5fd8d3f-cc8b-46ee-ae51-4453e9a71e02 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:37.137845 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e5fd8d3f-cc8b-46ee-ae51-4453e9a71e02 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042229 Dec 15 12:48:37.138395 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 698/1380] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:37 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:37.217385 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e631ebb3-4990-4806-b2c8-ed54b5142b78 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:37.218321 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e631ebb3-4990-4806-b2c8-ed54b5142b78 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:37.224556 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e631ebb3-4990-4806-b2c8-ed54b5142b78 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:37.225031 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e631ebb3-4990-4806-b2c8-ed54b5142b78 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:37.225845 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e631ebb3-4990-4806-b2c8-ed54b5142b78 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:37.226281 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e631ebb3-4990-4806-b2c8-ed54b5142b78 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:37.257268 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e631ebb3-4990-4806-b2c8-ed54b5142b78 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043562 Dec 15 12:48:37.257711 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 683/1381] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:37 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:38.149362 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0ac13d13-cf94-400b-b017-5956be60264e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:38.150335 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0ac13d13-cf94-400b-b017-5956be60264e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:38.156531 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0ac13d13-cf94-400b-b017-5956be60264e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:38.156977 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0ac13d13-cf94-400b-b017-5956be60264e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:38.157780 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0ac13d13-cf94-400b-b017-5956be60264e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:38.158218 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0ac13d13-cf94-400b-b017-5956be60264e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:38.188406 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0ac13d13-cf94-400b-b017-5956be60264e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042778 Dec 15 12:48:38.189303 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 699/1382] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:38 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:38.268410 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8c786659-1243-4785-82c9-8c5838f48dcd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:38.269320 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8c786659-1243-4785-82c9-8c5838f48dcd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:38.275767 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c786659-1243-4785-82c9-8c5838f48dcd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:38.276212 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c786659-1243-4785-82c9-8c5838f48dcd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:38.276991 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c786659-1243-4785-82c9-8c5838f48dcd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:38.277431 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c786659-1243-4785-82c9-8c5838f48dcd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:38.313911 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8c786659-1243-4785-82c9-8c5838f48dcd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049227 Dec 15 12:48:38.314494 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 684/1383] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:38 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:39.199699 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ee021cb3-120c-4d1d-b21a-45e7c4bf0d63 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:39.200596 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ee021cb3-120c-4d1d-b21a-45e7c4bf0d63 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:39.206749 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ee021cb3-120c-4d1d-b21a-45e7c4bf0d63 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:39.207907 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ee021cb3-120c-4d1d-b21a-45e7c4bf0d63 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:39.208677 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ee021cb3-120c-4d1d-b21a-45e7c4bf0d63 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:39.209106 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ee021cb3-120c-4d1d-b21a-45e7c4bf0d63 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:39.237122 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ee021cb3-120c-4d1d-b21a-45e7c4bf0d63 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041086 Dec 15 12:48:39.237735 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 700/1384] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:39 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:39.326308 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-452ec31e-c0e7-459d-ad00-63dd11478258 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:39.327220 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-452ec31e-c0e7-459d-ad00-63dd11478258 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:39.333598 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-452ec31e-c0e7-459d-ad00-63dd11478258 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:39.334047 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-452ec31e-c0e7-459d-ad00-63dd11478258 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:39.334831 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-452ec31e-c0e7-459d-ad00-63dd11478258 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:39.335267 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-452ec31e-c0e7-459d-ad00-63dd11478258 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:39.370244 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-452ec31e-c0e7-459d-ad00-63dd11478258 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047733 Dec 15 12:48:39.370810 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 685/1385] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:39 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:48:40.248959 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-09787b2d-7b21-42d8-b6ca-1414cd4c0f39 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:40.249892 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-09787b2d-7b21-42d8-b6ca-1414cd4c0f39 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:40.256674 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-09787b2d-7b21-42d8-b6ca-1414cd4c0f39 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:40.257120 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-09787b2d-7b21-42d8-b6ca-1414cd4c0f39 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:40.257965 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-09787b2d-7b21-42d8-b6ca-1414cd4c0f39 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:40.258402 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-09787b2d-7b21-42d8-b6ca-1414cd4c0f39 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:40.289108 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-09787b2d-7b21-42d8-b6ca-1414cd4c0f39 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043833 Dec 15 12:48:40.289730 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 701/1386] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:40 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:40.382814 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-40f5f297-5cff-43ce-aa73-e48af4460079 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:40.383723 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-40f5f297-5cff-43ce-aa73-e48af4460079 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:40.390214 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-40f5f297-5cff-43ce-aa73-e48af4460079 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:40.390667 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-40f5f297-5cff-43ce-aa73-e48af4460079 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:40.391465 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-40f5f297-5cff-43ce-aa73-e48af4460079 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:40.391900 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-40f5f297-5cff-43ce-aa73-e48af4460079 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:40.426959 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-40f5f297-5cff-43ce-aa73-e48af4460079 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048147 Dec 15 12:48:40.427539 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 686/1387] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:40 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:48:41.301420 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-80eccb0e-c138-4735-a719-13393c8cbec8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:41.302376 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-80eccb0e-c138-4735-a719-13393c8cbec8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:41.308778 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-80eccb0e-c138-4735-a719-13393c8cbec8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:41.309228 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-80eccb0e-c138-4735-a719-13393c8cbec8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:41.310059 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-80eccb0e-c138-4735-a719-13393c8cbec8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:41.310506 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-80eccb0e-c138-4735-a719-13393c8cbec8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:41.341353 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-80eccb0e-c138-4735-a719-13393c8cbec8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044240 Dec 15 12:48:41.341974 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 702/1388] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:41 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:41.444618 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7e528e89-4c59-49bb-ba21-c8c39847d618 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:41.445694 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7e528e89-4c59-49bb-ba21-c8c39847d618 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:41.452506 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7e528e89-4c59-49bb-ba21-c8c39847d618 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:41.452958 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7e528e89-4c59-49bb-ba21-c8c39847d618 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:41.453821 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7e528e89-4c59-49bb-ba21-c8c39847d618 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:41.454260 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7e528e89-4c59-49bb-ba21-c8c39847d618 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:41.484532 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7e528e89-4c59-49bb-ba21-c8c39847d618 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045262 Dec 15 12:48:41.485126 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 687/1389] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:41 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:42.352772 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-51b361a1-b67f-49d6-9c86-37571909c5ef tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:42.354291 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-51b361a1-b67f-49d6-9c86-37571909c5ef tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:42.360674 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-51b361a1-b67f-49d6-9c86-37571909c5ef tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:42.361112 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-51b361a1-b67f-49d6-9c86-37571909c5ef tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:42.361923 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-51b361a1-b67f-49d6-9c86-37571909c5ef tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:42.362351 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-51b361a1-b67f-49d6-9c86-37571909c5ef tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:42.397373 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-51b361a1-b67f-49d6-9c86-37571909c5ef tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048555 Dec 15 12:48:42.397981 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 703/1390] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:42 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:42.496248 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-74e80fa3-b879-49a5-b1a4-45ce2341d461 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:42.497165 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-74e80fa3-b879-49a5-b1a4-45ce2341d461 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:42.503317 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-74e80fa3-b879-49a5-b1a4-45ce2341d461 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:42.503809 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-74e80fa3-b879-49a5-b1a4-45ce2341d461 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:42.505003 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-74e80fa3-b879-49a5-b1a4-45ce2341d461 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:42.505441 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-74e80fa3-b879-49a5-b1a4-45ce2341d461 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:42.538145 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-74e80fa3-b879-49a5-b1a4-45ce2341d461 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045495 Dec 15 12:48:42.539248 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 688/1391] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:42 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:43.408214 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a18b7c51-b38e-4dfd-9cc2-f8ce7b1c3b7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:43.409156 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a18b7c51-b38e-4dfd-9cc2-f8ce7b1c3b7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:43.415994 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a18b7c51-b38e-4dfd-9cc2-f8ce7b1c3b7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:43.416442 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a18b7c51-b38e-4dfd-9cc2-f8ce7b1c3b7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:43.417286 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a18b7c51-b38e-4dfd-9cc2-f8ce7b1c3b7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:43.417763 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a18b7c51-b38e-4dfd-9cc2-f8ce7b1c3b7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:43.449282 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a18b7c51-b38e-4dfd-9cc2-f8ce7b1c3b7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044764 Dec 15 12:48:43.449869 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 704/1392] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:43 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:43.549363 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a338df0b-92d1-49f6-b3b9-6a6d972dd2d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:43.550213 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a338df0b-92d1-49f6-b3b9-6a6d972dd2d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:43.557266 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a338df0b-92d1-49f6-b3b9-6a6d972dd2d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:43.557760 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a338df0b-92d1-49f6-b3b9-6a6d972dd2d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:43.558545 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a338df0b-92d1-49f6-b3b9-6a6d972dd2d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:43.558979 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a338df0b-92d1-49f6-b3b9-6a6d972dd2d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:43.594247 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a338df0b-92d1-49f6-b3b9-6a6d972dd2d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048705 Dec 15 12:48:43.594801 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 689/1393] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:43 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:44.461554 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-054b79b9-27e9-42c1-ae8d-23dc5bdb9847 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:44.462600 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-054b79b9-27e9-42c1-ae8d-23dc5bdb9847 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:44.468815 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-054b79b9-27e9-42c1-ae8d-23dc5bdb9847 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:44.469254 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-054b79b9-27e9-42c1-ae8d-23dc5bdb9847 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:44.470060 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-054b79b9-27e9-42c1-ae8d-23dc5bdb9847 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:44.470488 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-054b79b9-27e9-42c1-ae8d-23dc5bdb9847 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:44.498483 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-054b79b9-27e9-42c1-ae8d-23dc5bdb9847 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041567 Dec 15 12:48:44.499033 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 705/1394] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:44 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:44.606940 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-09258c8c-8158-4bca-b4a5-c66ff7d843c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:44.607411 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-09258c8c-8158-4bca-b4a5-c66ff7d843c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:44.621354 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-09258c8c-8158-4bca-b4a5-c66ff7d843c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:44.621824 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-09258c8c-8158-4bca-b4a5-c66ff7d843c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:44.622636 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-09258c8c-8158-4bca-b4a5-c66ff7d843c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:44.623070 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-09258c8c-8158-4bca-b4a5-c66ff7d843c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:44.655745 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-09258c8c-8158-4bca-b4a5-c66ff7d843c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053135 Dec 15 12:48:44.656317 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 690/1395] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:44 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:45.510855 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d24300e2-c371-492c-b4b5-6f86fc7fa14c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:45.511784 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d24300e2-c371-492c-b4b5-6f86fc7fa14c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:45.518525 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d24300e2-c371-492c-b4b5-6f86fc7fa14c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:45.518979 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d24300e2-c371-492c-b4b5-6f86fc7fa14c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:45.520425 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d24300e2-c371-492c-b4b5-6f86fc7fa14c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:45.520860 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d24300e2-c371-492c-b4b5-6f86fc7fa14c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:45.551059 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d24300e2-c371-492c-b4b5-6f86fc7fa14c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044012 Dec 15 12:48:45.551551 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 706/1396] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:45 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:45.675190 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2c2ecdfa-9ecb-4099-8a5c-51a55c35732b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:45.677420 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2c2ecdfa-9ecb-4099-8a5c-51a55c35732b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:45.687869 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2c2ecdfa-9ecb-4099-8a5c-51a55c35732b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:45.689025 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2c2ecdfa-9ecb-4099-8a5c-51a55c35732b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:45.690810 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2c2ecdfa-9ecb-4099-8a5c-51a55c35732b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:45.691670 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2c2ecdfa-9ecb-4099-8a5c-51a55c35732b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:45.734769 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2c2ecdfa-9ecb-4099-8a5c-51a55c35732b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066640 Dec 15 12:48:45.735331 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 691/1397] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:45 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:48:46.563129 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ba2873fb-563e-4eeb-a9c5-219bca6043ff tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:46.564079 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ba2873fb-563e-4eeb-a9c5-219bca6043ff tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:46.571099 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ba2873fb-563e-4eeb-a9c5-219bca6043ff tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:46.571546 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ba2873fb-563e-4eeb-a9c5-219bca6043ff tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:46.572332 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ba2873fb-563e-4eeb-a9c5-219bca6043ff tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:46.572769 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ba2873fb-563e-4eeb-a9c5-219bca6043ff tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:46.603103 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ba2873fb-563e-4eeb-a9c5-219bca6043ff tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043751 Dec 15 12:48:46.603683 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 707/1398] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:46 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:46.747128 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ef73b5cd-ff3a-4567-80ef-f777142293f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:46.748414 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ef73b5cd-ff3a-4567-80ef-f777142293f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:46.755443 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ef73b5cd-ff3a-4567-80ef-f777142293f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:46.756148 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ef73b5cd-ff3a-4567-80ef-f777142293f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:46.756931 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ef73b5cd-ff3a-4567-80ef-f777142293f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:46.757362 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ef73b5cd-ff3a-4567-80ef-f777142293f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:46.795543 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ef73b5cd-ff3a-4567-80ef-f777142293f7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052293 Dec 15 12:48:46.796087 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 692/1399] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:46 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:47.614878 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7f5ace3d-df31-49e6-b55d-91ce9387f604 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:47.615785 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7f5ace3d-df31-49e6-b55d-91ce9387f604 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:47.622050 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7f5ace3d-df31-49e6-b55d-91ce9387f604 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:47.622497 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7f5ace3d-df31-49e6-b55d-91ce9387f604 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:47.623280 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7f5ace3d-df31-49e6-b55d-91ce9387f604 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:47.623713 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7f5ace3d-df31-49e6-b55d-91ce9387f604 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:47.657859 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7f5ace3d-df31-49e6-b55d-91ce9387f604 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047298 Dec 15 12:48:47.658455 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 708/1400] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:47 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:47.807012 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b6e0f656-299f-42f1-a90f-2863c4fa5a5b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:47.808077 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b6e0f656-299f-42f1-a90f-2863c4fa5a5b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:47.814467 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b6e0f656-299f-42f1-a90f-2863c4fa5a5b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:47.814905 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b6e0f656-299f-42f1-a90f-2863c4fa5a5b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:47.815686 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b6e0f656-299f-42f1-a90f-2863c4fa5a5b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:47.816696 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b6e0f656-299f-42f1-a90f-2863c4fa5a5b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:47.844967 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b6e0f656-299f-42f1-a90f-2863c4fa5a5b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041786 Dec 15 12:48:47.845526 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 693/1401] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:47 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:48:48.669470 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-dc8a2d1e-54d9-403e-804c-54bc78cf212b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:48.670421 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-dc8a2d1e-54d9-403e-804c-54bc78cf212b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:48.676720 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dc8a2d1e-54d9-403e-804c-54bc78cf212b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:48.677170 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dc8a2d1e-54d9-403e-804c-54bc78cf212b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:48.677985 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dc8a2d1e-54d9-403e-804c-54bc78cf212b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:48.678423 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dc8a2d1e-54d9-403e-804c-54bc78cf212b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:48.716671 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-dc8a2d1e-54d9-403e-804c-54bc78cf212b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050905 Dec 15 12:48:48.717279 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 709/1402] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:48 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:48.856716 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f838766e-365b-4f6e-a88a-2fc637fe1d1f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:48.857668 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f838766e-365b-4f6e-a88a-2fc637fe1d1f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:48.864036 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f838766e-365b-4f6e-a88a-2fc637fe1d1f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:48.864458 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f838766e-365b-4f6e-a88a-2fc637fe1d1f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:48.865230 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f838766e-365b-4f6e-a88a-2fc637fe1d1f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:48.865684 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f838766e-365b-4f6e-a88a-2fc637fe1d1f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:48.896181 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f838766e-365b-4f6e-a88a-2fc637fe1d1f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043229 Dec 15 12:48:48.903798 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 694/1403] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:48 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:49.727781 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3dcad4f7-24c2-4196-b774-c8f7b3255b94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:49.728750 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3dcad4f7-24c2-4196-b774-c8f7b3255b94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:49.735657 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3dcad4f7-24c2-4196-b774-c8f7b3255b94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:49.736107 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3dcad4f7-24c2-4196-b774-c8f7b3255b94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:49.736911 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3dcad4f7-24c2-4196-b774-c8f7b3255b94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:49.737350 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3dcad4f7-24c2-4196-b774-c8f7b3255b94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:49.768110 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3dcad4f7-24c2-4196-b774-c8f7b3255b94 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043682 Dec 15 12:48:49.769098 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 710/1404] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:49 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:49.914632 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1b6f2784-1ce1-4023-9d12-f56478b9050b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:49.915535 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1b6f2784-1ce1-4023-9d12-f56478b9050b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:49.921854 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b6f2784-1ce1-4023-9d12-f56478b9050b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:49.922242 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b6f2784-1ce1-4023-9d12-f56478b9050b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:49.923023 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b6f2784-1ce1-4023-9d12-f56478b9050b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:49.923455 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b6f2784-1ce1-4023-9d12-f56478b9050b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:49.954794 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1b6f2784-1ce1-4023-9d12-f56478b9050b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043957 Dec 15 12:48:49.955352 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 695/1405] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:49 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:50.780640 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e1f84629-c223-40d0-b8d5-f2fba35b32f5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:50.781577 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e1f84629-c223-40d0-b8d5-f2fba35b32f5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:50.788652 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e1f84629-c223-40d0-b8d5-f2fba35b32f5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:50.789090 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e1f84629-c223-40d0-b8d5-f2fba35b32f5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:50.789905 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e1f84629-c223-40d0-b8d5-f2fba35b32f5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:50.790343 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e1f84629-c223-40d0-b8d5-f2fba35b32f5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:50.819334 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e1f84629-c223-40d0-b8d5-f2fba35b32f5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042556 Dec 15 12:48:50.819901 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 711/1406] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:50 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:50.966122 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-77b8e24b-38e6-4285-95f2-e04063f5d94b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:50.967017 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-77b8e24b-38e6-4285-95f2-e04063f5d94b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:50.973567 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-77b8e24b-38e6-4285-95f2-e04063f5d94b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:50.974054 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-77b8e24b-38e6-4285-95f2-e04063f5d94b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:50.974846 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-77b8e24b-38e6-4285-95f2-e04063f5d94b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:50.975281 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-77b8e24b-38e6-4285-95f2-e04063f5d94b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:51.006508 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-77b8e24b-38e6-4285-95f2-e04063f5d94b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043859 Dec 15 12:48:51.007072 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 696/1407] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:50 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:51.830969 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1f5b0a30-6fe5-4edd-9556-fcf8ed1fa5cd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:51.832035 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1f5b0a30-6fe5-4edd-9556-fcf8ed1fa5cd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:51.838568 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1f5b0a30-6fe5-4edd-9556-fcf8ed1fa5cd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:51.839009 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1f5b0a30-6fe5-4edd-9556-fcf8ed1fa5cd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:51.839790 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1f5b0a30-6fe5-4edd-9556-fcf8ed1fa5cd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:51.840220 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1f5b0a30-6fe5-4edd-9556-fcf8ed1fa5cd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:51.869590 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1f5b0a30-6fe5-4edd-9556-fcf8ed1fa5cd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042384 Dec 15 12:48:51.870149 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 712/1408] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:51 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:52.018061 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a1894aea-4985-4331-88d4-6d00003490ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:52.018965 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a1894aea-4985-4331-88d4-6d00003490ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:52.025783 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1894aea-4985-4331-88d4-6d00003490ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:52.026231 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1894aea-4985-4331-88d4-6d00003490ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:52.027054 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1894aea-4985-4331-88d4-6d00003490ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:52.027571 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1894aea-4985-4331-88d4-6d00003490ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:52.058208 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a1894aea-4985-4331-88d4-6d00003490ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043904 Dec 15 12:48:52.058758 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 697/1409] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:52 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:52.886937 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b553a221-e43b-4b6d-bc63-4427cbb8f266 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:52.887842 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b553a221-e43b-4b6d-bc63-4427cbb8f266 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:52.894822 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b553a221-e43b-4b6d-bc63-4427cbb8f266 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:52.895263 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b553a221-e43b-4b6d-bc63-4427cbb8f266 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:52.896045 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b553a221-e43b-4b6d-bc63-4427cbb8f266 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:52.896487 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b553a221-e43b-4b6d-bc63-4427cbb8f266 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:52.926486 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b553a221-e43b-4b6d-bc63-4427cbb8f266 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043243 Dec 15 12:48:52.927350 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 713/1410] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:52 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:53.069721 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-921ca2cc-5ed9-4d94-bdc1-70f19083403c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:53.070748 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-921ca2cc-5ed9-4d94-bdc1-70f19083403c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:53.078011 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-921ca2cc-5ed9-4d94-bdc1-70f19083403c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:53.078452 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-921ca2cc-5ed9-4d94-bdc1-70f19083403c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:53.079280 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-921ca2cc-5ed9-4d94-bdc1-70f19083403c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:53.079709 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-921ca2cc-5ed9-4d94-bdc1-70f19083403c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:53.109462 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-921ca2cc-5ed9-4d94-bdc1-70f19083403c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043624 Dec 15 12:48:53.110040 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 698/1411] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:53 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:53.938617 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5fe6b433-b356-43bc-92d2-b539882ddafd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:53.939515 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5fe6b433-b356-43bc-92d2-b539882ddafd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:53.945765 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5fe6b433-b356-43bc-92d2-b539882ddafd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:53.946207 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5fe6b433-b356-43bc-92d2-b539882ddafd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:53.946973 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5fe6b433-b356-43bc-92d2-b539882ddafd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:53.947396 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5fe6b433-b356-43bc-92d2-b539882ddafd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:53.977425 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5fe6b433-b356-43bc-92d2-b539882ddafd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042533 Dec 15 12:48:53.978012 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 714/1412] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:53 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:48:54.121456 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fe35eb58-835a-41c9-9ecd-5dd3b0a5de43 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:54.122384 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fe35eb58-835a-41c9-9ecd-5dd3b0a5de43 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:54.128793 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fe35eb58-835a-41c9-9ecd-5dd3b0a5de43 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:54.129260 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fe35eb58-835a-41c9-9ecd-5dd3b0a5de43 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:54.130069 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fe35eb58-835a-41c9-9ecd-5dd3b0a5de43 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:54.130499 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fe35eb58-835a-41c9-9ecd-5dd3b0a5de43 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:54.158962 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fe35eb58-835a-41c9-9ecd-5dd3b0a5de43 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041467 Dec 15 12:48:54.159508 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 699/1413] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:54 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:54.988864 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-96880a30-e457-4c77-b2ee-4cb981d95a70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:54.989790 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-96880a30-e457-4c77-b2ee-4cb981d95a70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:54.996007 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-96880a30-e457-4c77-b2ee-4cb981d95a70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:54.996462 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-96880a30-e457-4c77-b2ee-4cb981d95a70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:54.997308 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-96880a30-e457-4c77-b2ee-4cb981d95a70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:54.997775 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-96880a30-e457-4c77-b2ee-4cb981d95a70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:55.028571 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-96880a30-e457-4c77-b2ee-4cb981d95a70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043409 Dec 15 12:48:55.029141 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 715/1414] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:54 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:55.171648 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-825b045e-a5d5-4a2a-b96f-1ec06fa54c63 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:55.172556 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-825b045e-a5d5-4a2a-b96f-1ec06fa54c63 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:55.179460 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-825b045e-a5d5-4a2a-b96f-1ec06fa54c63 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:55.179906 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-825b045e-a5d5-4a2a-b96f-1ec06fa54c63 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:55.180690 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-825b045e-a5d5-4a2a-b96f-1ec06fa54c63 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:55.181125 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-825b045e-a5d5-4a2a-b96f-1ec06fa54c63 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:55.212948 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-825b045e-a5d5-4a2a-b96f-1ec06fa54c63 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045093 Dec 15 12:48:55.213572 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 700/1415] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:55 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:56.040845 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-809696b2-c35b-4772-b00d-ba7c96397246 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:56.041837 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-809696b2-c35b-4772-b00d-ba7c96397246 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:56.048284 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-809696b2-c35b-4772-b00d-ba7c96397246 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:56.048746 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-809696b2-c35b-4772-b00d-ba7c96397246 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:56.049564 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-809696b2-c35b-4772-b00d-ba7c96397246 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:56.050005 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-809696b2-c35b-4772-b00d-ba7c96397246 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:56.078040 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-809696b2-c35b-4772-b00d-ba7c96397246 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041149 Dec 15 12:48:56.078602 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 716/1416] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:56 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:56.225100 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-20ac52f6-3d1d-4dbf-a322-3bbf2b754796 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:56.226029 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-20ac52f6-3d1d-4dbf-a322-3bbf2b754796 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:56.232270 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-20ac52f6-3d1d-4dbf-a322-3bbf2b754796 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:56.232721 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-20ac52f6-3d1d-4dbf-a322-3bbf2b754796 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:56.233519 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-20ac52f6-3d1d-4dbf-a322-3bbf2b754796 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:56.233961 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-20ac52f6-3d1d-4dbf-a322-3bbf2b754796 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:56.265536 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-20ac52f6-3d1d-4dbf-a322-3bbf2b754796 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044157 Dec 15 12:48:56.266121 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 701/1417] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:56 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:57.090305 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fd9f033c-f241-4edb-99da-fef8c7c55187 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:57.091224 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fd9f033c-f241-4edb-99da-fef8c7c55187 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:57.098147 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fd9f033c-f241-4edb-99da-fef8c7c55187 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:57.098600 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fd9f033c-f241-4edb-99da-fef8c7c55187 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:57.099389 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fd9f033c-f241-4edb-99da-fef8c7c55187 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:57.099826 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fd9f033c-f241-4edb-99da-fef8c7c55187 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:57.128958 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fd9f033c-f241-4edb-99da-fef8c7c55187 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042464 Dec 15 12:48:57.129526 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 717/1418] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:57 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:57.278321 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f7888321-6d05-40f9-8a08-b7367a5e9373 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:57.279228 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f7888321-6d05-40f9-8a08-b7367a5e9373 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:57.286155 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f7888321-6d05-40f9-8a08-b7367a5e9373 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:57.286603 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f7888321-6d05-40f9-8a08-b7367a5e9373 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:57.287463 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f7888321-6d05-40f9-8a08-b7367a5e9373 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:57.287822 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f7888321-6d05-40f9-8a08-b7367a5e9373 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:57.318386 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f7888321-6d05-40f9-8a08-b7367a5e9373 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043820 Dec 15 12:48:57.318959 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 702/1419] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:57 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:58.140846 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b6ea39cc-3c13-4723-b29a-b0cc6a870829 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:58.141778 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b6ea39cc-3c13-4723-b29a-b0cc6a870829 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:58.148376 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b6ea39cc-3c13-4723-b29a-b0cc6a870829 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:58.148823 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b6ea39cc-3c13-4723-b29a-b0cc6a870829 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:58.149612 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b6ea39cc-3c13-4723-b29a-b0cc6a870829 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:58.150044 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b6ea39cc-3c13-4723-b29a-b0cc6a870829 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:58.179586 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b6ea39cc-3c13-4723-b29a-b0cc6a870829 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042409 Dec 15 12:48:58.180154 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 718/1420] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:58 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:58.330271 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6899b35d-dd32-4fff-8c5e-b6cbc58a7f4b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:58.331182 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6899b35d-dd32-4fff-8c5e-b6cbc58a7f4b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:58.337825 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6899b35d-dd32-4fff-8c5e-b6cbc58a7f4b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:58.338257 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6899b35d-dd32-4fff-8c5e-b6cbc58a7f4b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:58.339102 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6899b35d-dd32-4fff-8c5e-b6cbc58a7f4b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:58.339540 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6899b35d-dd32-4fff-8c5e-b6cbc58a7f4b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:58.369757 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6899b35d-dd32-4fff-8c5e-b6cbc58a7f4b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043231 Dec 15 12:48:58.370318 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 703/1421] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:58 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:48:59.190586 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5300e0d9-3922-43c0-9047-3d1443660f50 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:59.191645 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5300e0d9-3922-43c0-9047-3d1443660f50 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:59.198467 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5300e0d9-3922-43c0-9047-3d1443660f50 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:59.198906 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5300e0d9-3922-43c0-9047-3d1443660f50 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:59.199679 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5300e0d9-3922-43c0-9047-3d1443660f50 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:59.200108 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5300e0d9-3922-43c0-9047-3d1443660f50 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:59.231622 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5300e0d9-3922-43c0-9047-3d1443660f50 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044740 Dec 15 12:48:59.232194 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 719/1422] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:48:59 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:48:59.382922 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c87f162a-6a73-4a1d-8de1-4d030af4a2e4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:48:59.383842 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c87f162a-6a73-4a1d-8de1-4d030af4a2e4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:48:59.390152 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c87f162a-6a73-4a1d-8de1-4d030af4a2e4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:59.390598 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c87f162a-6a73-4a1d-8de1-4d030af4a2e4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:59.391382 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c87f162a-6a73-4a1d-8de1-4d030af4a2e4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:48:59.391820 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c87f162a-6a73-4a1d-8de1-4d030af4a2e4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:48:59.421623 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c87f162a-6a73-4a1d-8de1-4d030af4a2e4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043370 Dec 15 12:48:59.422179 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 704/1423] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:48:59 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:00.244569 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9ff7d4a2-0207-4c0a-85cb-c45b1de79994 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:00.246091 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9ff7d4a2-0207-4c0a-85cb-c45b1de79994 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:00.252418 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9ff7d4a2-0207-4c0a-85cb-c45b1de79994 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:00.252908 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9ff7d4a2-0207-4c0a-85cb-c45b1de79994 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:00.253865 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9ff7d4a2-0207-4c0a-85cb-c45b1de79994 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:00.254469 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9ff7d4a2-0207-4c0a-85cb-c45b1de79994 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:00.284839 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9ff7d4a2-0207-4c0a-85cb-c45b1de79994 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044081 Dec 15 12:49:00.285397 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 720/1424] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:00 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:00.440141 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6aa432d7-53c0-47db-a0cb-4cd33f781f8b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:00.441085 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6aa432d7-53c0-47db-a0cb-4cd33f781f8b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:00.447525 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6aa432d7-53c0-47db-a0cb-4cd33f781f8b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:00.447991 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6aa432d7-53c0-47db-a0cb-4cd33f781f8b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:00.448760 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6aa432d7-53c0-47db-a0cb-4cd33f781f8b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:00.449196 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6aa432d7-53c0-47db-a0cb-4cd33f781f8b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:00.485204 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6aa432d7-53c0-47db-a0cb-4cd33f781f8b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048800 Dec 15 12:49:00.485834 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 705/1425] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:00 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:01.296156 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0def17ee-be20-43c7-b9b5-172ebc9968bc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:01.297058 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0def17ee-be20-43c7-b9b5-172ebc9968bc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:01.303593 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0def17ee-be20-43c7-b9b5-172ebc9968bc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:01.304041 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0def17ee-be20-43c7-b9b5-172ebc9968bc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:01.304843 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0def17ee-be20-43c7-b9b5-172ebc9968bc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:01.305300 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0def17ee-be20-43c7-b9b5-172ebc9968bc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:01.335187 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0def17ee-be20-43c7-b9b5-172ebc9968bc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042713 Dec 15 12:49:01.335747 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 721/1426] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:01 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:01.496442 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3dfd2e1d-112e-434f-8312-a90320f93c9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:01.497391 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3dfd2e1d-112e-434f-8312-a90320f93c9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:01.503647 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3dfd2e1d-112e-434f-8312-a90320f93c9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:01.504079 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3dfd2e1d-112e-434f-8312-a90320f93c9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:01.505412 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3dfd2e1d-112e-434f-8312-a90320f93c9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:01.506130 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3dfd2e1d-112e-434f-8312-a90320f93c9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:01.537361 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3dfd2e1d-112e-434f-8312-a90320f93c9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044815 Dec 15 12:49:01.537944 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 706/1427] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:01 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:02.347201 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5ae7c8fe-f5f4-4b0b-95b9-9d5e9c95528b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:02.348128 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5ae7c8fe-f5f4-4b0b-95b9-9d5e9c95528b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:02.358311 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5ae7c8fe-f5f4-4b0b-95b9-9d5e9c95528b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:02.358762 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5ae7c8fe-f5f4-4b0b-95b9-9d5e9c95528b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:02.359573 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5ae7c8fe-f5f4-4b0b-95b9-9d5e9c95528b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:02.360010 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5ae7c8fe-f5f4-4b0b-95b9-9d5e9c95528b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:02.392348 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5ae7c8fe-f5f4-4b0b-95b9-9d5e9c95528b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048845 Dec 15 12:49:02.393160 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 722/1428] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:02 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:02.548180 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e37da73f-23f5-4035-95b9-fc78e9cedeb6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:02.549135 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e37da73f-23f5-4035-95b9-fc78e9cedeb6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:02.556418 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e37da73f-23f5-4035-95b9-fc78e9cedeb6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:02.556874 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e37da73f-23f5-4035-95b9-fc78e9cedeb6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:02.557753 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e37da73f-23f5-4035-95b9-fc78e9cedeb6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:02.558187 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e37da73f-23f5-4035-95b9-fc78e9cedeb6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:02.589531 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e37da73f-23f5-4035-95b9-fc78e9cedeb6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045064 Dec 15 12:49:02.590396 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 707/1429] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:02 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:03.404860 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-90b3e209-cb4b-4254-b9b7-4a1dc3481181 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:03.405794 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-90b3e209-cb4b-4254-b9b7-4a1dc3481181 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:03.412038 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-90b3e209-cb4b-4254-b9b7-4a1dc3481181 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:03.412487 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-90b3e209-cb4b-4254-b9b7-4a1dc3481181 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:03.413260 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-90b3e209-cb4b-4254-b9b7-4a1dc3481181 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:03.413725 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-90b3e209-cb4b-4254-b9b7-4a1dc3481181 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:03.444008 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-90b3e209-cb4b-4254-b9b7-4a1dc3481181 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042664 Dec 15 12:49:03.444600 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 723/1430] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:03 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:03.602745 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-25696ef3-9716-4e07-8cda-aa6c1b306faf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:03.603571 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-25696ef3-9716-4e07-8cda-aa6c1b306faf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:03.609946 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-25696ef3-9716-4e07-8cda-aa6c1b306faf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:03.610383 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-25696ef3-9716-4e07-8cda-aa6c1b306faf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:03.611169 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-25696ef3-9716-4e07-8cda-aa6c1b306faf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:03.611593 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-25696ef3-9716-4e07-8cda-aa6c1b306faf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:03.641652 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-25696ef3-9716-4e07-8cda-aa6c1b306faf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043935 Dec 15 12:49:03.642215 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 708/1431] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:03 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:04.455784 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a66eca28-88bc-47cd-81df-c01d28fd2f27 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:04.456729 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a66eca28-88bc-47cd-81df-c01d28fd2f27 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:04.463656 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a66eca28-88bc-47cd-81df-c01d28fd2f27 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:04.464103 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a66eca28-88bc-47cd-81df-c01d28fd2f27 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:04.464882 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a66eca28-88bc-47cd-81df-c01d28fd2f27 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:04.465319 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a66eca28-88bc-47cd-81df-c01d28fd2f27 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:04.501907 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a66eca28-88bc-47cd-81df-c01d28fd2f27 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049890 Dec 15 12:49:04.502479 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 724/1432] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:04 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:04.653236 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f6040ff9-641f-43a1-9bda-2c12c608bbc3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:04.654170 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f6040ff9-641f-43a1-9bda-2c12c608bbc3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:04.660506 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f6040ff9-641f-43a1-9bda-2c12c608bbc3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:04.661023 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f6040ff9-641f-43a1-9bda-2c12c608bbc3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:04.661857 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f6040ff9-641f-43a1-9bda-2c12c608bbc3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:04.662291 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f6040ff9-641f-43a1-9bda-2c12c608bbc3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:04.691389 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f6040ff9-641f-43a1-9bda-2c12c608bbc3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042036 Dec 15 12:49:04.691934 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 709/1433] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:04 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:05.514471 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-aa61f95c-0cac-42a4-9baf-eee85cb12164 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:05.515389 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-aa61f95c-0cac-42a4-9baf-eee85cb12164 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:05.522574 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa61f95c-0cac-42a4-9baf-eee85cb12164 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:05.523030 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa61f95c-0cac-42a4-9baf-eee85cb12164 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:05.523817 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa61f95c-0cac-42a4-9baf-eee85cb12164 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:05.524253 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa61f95c-0cac-42a4-9baf-eee85cb12164 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:05.555352 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-aa61f95c-0cac-42a4-9baf-eee85cb12164 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044471 Dec 15 12:49:05.555826 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 725/1434] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:05 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:05.703952 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e6a9f5e7-cd5d-4add-bedb-a622d7983141 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:05.704859 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e6a9f5e7-cd5d-4add-bedb-a622d7983141 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:05.712125 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e6a9f5e7-cd5d-4add-bedb-a622d7983141 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:05.712569 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e6a9f5e7-cd5d-4add-bedb-a622d7983141 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:05.713348 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e6a9f5e7-cd5d-4add-bedb-a622d7983141 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:05.713821 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e6a9f5e7-cd5d-4add-bedb-a622d7983141 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:05.744814 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e6a9f5e7-cd5d-4add-bedb-a622d7983141 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044605 Dec 15 12:49:05.745398 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 710/1435] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:05 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:06.566373 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8a9e2b03-0d64-4b97-bde2-9ef290373aca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:06.567969 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8a9e2b03-0d64-4b97-bde2-9ef290373aca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:06.580718 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8a9e2b03-0d64-4b97-bde2-9ef290373aca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:06.581168 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8a9e2b03-0d64-4b97-bde2-9ef290373aca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:06.582004 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8a9e2b03-0d64-4b97-bde2-9ef290373aca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:06.582445 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8a9e2b03-0d64-4b97-bde2-9ef290373aca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:06.612323 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8a9e2b03-0d64-4b97-bde2-9ef290373aca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049887 Dec 15 12:49:06.613032 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 726/1436] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:06 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:06.756841 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8c87d1e0-d795-40f7-9fdd-c8271df82965 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:06.757768 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8c87d1e0-d795-40f7-9fdd-c8271df82965 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:06.764015 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c87d1e0-d795-40f7-9fdd-c8271df82965 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:06.764463 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c87d1e0-d795-40f7-9fdd-c8271df82965 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:06.765237 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c87d1e0-d795-40f7-9fdd-c8271df82965 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:06.765704 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c87d1e0-d795-40f7-9fdd-c8271df82965 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:06.795966 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8c87d1e0-d795-40f7-9fdd-c8271df82965 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043240 Dec 15 12:49:06.796526 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 711/1437] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:06 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:07.624533 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-39050c71-3c0f-4e5a-be96-a573b91b8dc1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:07.625351 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-39050c71-3c0f-4e5a-be96-a573b91b8dc1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:07.631941 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-39050c71-3c0f-4e5a-be96-a573b91b8dc1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:07.632379 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-39050c71-3c0f-4e5a-be96-a573b91b8dc1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:07.633153 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-39050c71-3c0f-4e5a-be96-a573b91b8dc1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:07.633638 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-39050c71-3c0f-4e5a-be96-a573b91b8dc1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:07.664499 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-39050c71-3c0f-4e5a-be96-a573b91b8dc1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043702 Dec 15 12:49:07.665078 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 727/1438] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:07 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:07.807513 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-796ce8bf-05c7-476b-bc96-3a196a65e98a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:07.808417 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-796ce8bf-05c7-476b-bc96-3a196a65e98a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:07.814682 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-796ce8bf-05c7-476b-bc96-3a196a65e98a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:07.815133 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-796ce8bf-05c7-476b-bc96-3a196a65e98a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:07.815916 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-796ce8bf-05c7-476b-bc96-3a196a65e98a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:07.816355 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-796ce8bf-05c7-476b-bc96-3a196a65e98a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:07.848250 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-796ce8bf-05c7-476b-bc96-3a196a65e98a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044436 Dec 15 12:49:07.848846 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 712/1439] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:07 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:08.676302 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-826b9b00-afe3-4453-93f6-9c6664bac340 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:08.678070 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-826b9b00-afe3-4453-93f6-9c6664bac340 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:08.684414 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-826b9b00-afe3-4453-93f6-9c6664bac340 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:08.684865 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-826b9b00-afe3-4453-93f6-9c6664bac340 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:08.685699 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-826b9b00-afe3-4453-93f6-9c6664bac340 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:08.686136 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-826b9b00-afe3-4453-93f6-9c6664bac340 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:08.715720 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-826b9b00-afe3-4453-93f6-9c6664bac340 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042958 Dec 15 12:49:08.716325 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 728/1440] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:08 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:08.859603 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-11ef378d-c17c-4473-b0fd-e9c0dac0dc43 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:08.860626 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-11ef378d-c17c-4473-b0fd-e9c0dac0dc43 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:08.876290 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-11ef378d-c17c-4473-b0fd-e9c0dac0dc43 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:08.876919 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-11ef378d-c17c-4473-b0fd-e9c0dac0dc43 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:08.878386 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-11ef378d-c17c-4473-b0fd-e9c0dac0dc43 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:08.879136 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-11ef378d-c17c-4473-b0fd-e9c0dac0dc43 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:08.914681 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-11ef378d-c17c-4473-b0fd-e9c0dac0dc43 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058808 Dec 15 12:49:08.915239 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 713/1441] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:08 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:09.727992 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-baba8640-d7ef-43ec-b52b-a056abf39043 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:09.729068 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-baba8640-d7ef-43ec-b52b-a056abf39043 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:09.735361 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-baba8640-d7ef-43ec-b52b-a056abf39043 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:09.735804 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-baba8640-d7ef-43ec-b52b-a056abf39043 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:09.736569 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-baba8640-d7ef-43ec-b52b-a056abf39043 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:09.736997 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-baba8640-d7ef-43ec-b52b-a056abf39043 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:09.768759 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-baba8640-d7ef-43ec-b52b-a056abf39043 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044932 Dec 15 12:49:09.769351 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 729/1442] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:09 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:09.926346 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5750487b-f731-4b33-b8c8-7fa34374ecec tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:09.927257 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5750487b-f731-4b33-b8c8-7fa34374ecec tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:09.934373 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5750487b-f731-4b33-b8c8-7fa34374ecec tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:09.934760 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5750487b-f731-4b33-b8c8-7fa34374ecec tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:09.935545 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5750487b-f731-4b33-b8c8-7fa34374ecec tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:09.935986 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5750487b-f731-4b33-b8c8-7fa34374ecec tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:09.972541 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5750487b-f731-4b33-b8c8-7fa34374ecec tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049869 Dec 15 12:49:09.973145 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 714/1443] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:09 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:10.780420 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-27b32f34-3925-4259-9fba-8d8ecafec7ca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:10.781322 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-27b32f34-3925-4259-9fba-8d8ecafec7ca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:10.788324 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-27b32f34-3925-4259-9fba-8d8ecafec7ca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:10.788761 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-27b32f34-3925-4259-9fba-8d8ecafec7ca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:10.789561 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-27b32f34-3925-4259-9fba-8d8ecafec7ca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:10.789981 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-27b32f34-3925-4259-9fba-8d8ecafec7ca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:10.820615 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-27b32f34-3925-4259-9fba-8d8ecafec7ca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043934 Dec 15 12:49:10.821186 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 730/1444] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:10 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:10.984229 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8a347a5b-e0a0-45f8-9b34-82264ebdde3c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:10.985134 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8a347a5b-e0a0-45f8-9b34-82264ebdde3c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:10.992535 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8a347a5b-e0a0-45f8-9b34-82264ebdde3c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:10.992993 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8a347a5b-e0a0-45f8-9b34-82264ebdde3c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:10.993805 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8a347a5b-e0a0-45f8-9b34-82264ebdde3c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:10.994245 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8a347a5b-e0a0-45f8-9b34-82264ebdde3c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:11.029357 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8a347a5b-e0a0-45f8-9b34-82264ebdde3c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048874 Dec 15 12:49:11.029994 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 715/1445] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:10 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:11.832196 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f6b0047a-bc04-4f1c-8e1e-90b887f44b68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:11.833096 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f6b0047a-bc04-4f1c-8e1e-90b887f44b68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:11.839990 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f6b0047a-bc04-4f1c-8e1e-90b887f44b68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:11.840442 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f6b0047a-bc04-4f1c-8e1e-90b887f44b68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:11.841292 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f6b0047a-bc04-4f1c-8e1e-90b887f44b68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:11.841772 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f6b0047a-bc04-4f1c-8e1e-90b887f44b68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:11.873718 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f6b0047a-bc04-4f1c-8e1e-90b887f44b68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045214 Dec 15 12:49:11.874493 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 731/1446] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:11 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:12.041169 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2175916b-4ea3-4ab7-a5ef-17533bcd9e84 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:12.042022 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2175916b-4ea3-4ab7-a5ef-17533bcd9e84 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:12.048265 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2175916b-4ea3-4ab7-a5ef-17533bcd9e84 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:12.049242 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2175916b-4ea3-4ab7-a5ef-17533bcd9e84 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:12.050555 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2175916b-4ea3-4ab7-a5ef-17533bcd9e84 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:12.051186 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2175916b-4ea3-4ab7-a5ef-17533bcd9e84 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:12.082994 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2175916b-4ea3-4ab7-a5ef-17533bcd9e84 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046247 Dec 15 12:49:12.084036 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 716/1447] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:12 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:12.885990 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bf3d363d-08ab-43c6-b7c4-35969105c141 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:12.886946 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bf3d363d-08ab-43c6-b7c4-35969105c141 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:12.893776 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bf3d363d-08ab-43c6-b7c4-35969105c141 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:12.894226 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bf3d363d-08ab-43c6-b7c4-35969105c141 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:12.895027 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bf3d363d-08ab-43c6-b7c4-35969105c141 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:12.895460 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bf3d363d-08ab-43c6-b7c4-35969105c141 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:12.924751 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bf3d363d-08ab-43c6-b7c4-35969105c141 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042542 Dec 15 12:49:12.925318 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 732/1448] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:12 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:13.100698 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-70a761f4-050a-4471-87a5-7d4ce97fcf9a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:13.101737 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-70a761f4-050a-4471-87a5-7d4ce97fcf9a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:13.108302 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-70a761f4-050a-4471-87a5-7d4ce97fcf9a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:13.108737 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-70a761f4-050a-4471-87a5-7d4ce97fcf9a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:13.109535 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-70a761f4-050a-4471-87a5-7d4ce97fcf9a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:13.109966 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-70a761f4-050a-4471-87a5-7d4ce97fcf9a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:13.138876 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-70a761f4-050a-4471-87a5-7d4ce97fcf9a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047203 Dec 15 12:49:13.139345 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 717/1449] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:13 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:13.936488 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-dcf95dba-cb63-495d-b525-3005e978b070 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:13.937382 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-dcf95dba-cb63-495d-b525-3005e978b070 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:13.944070 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dcf95dba-cb63-495d-b525-3005e978b070 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:13.944508 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dcf95dba-cb63-495d-b525-3005e978b070 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:13.945277 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dcf95dba-cb63-495d-b525-3005e978b070 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:13.945736 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dcf95dba-cb63-495d-b525-3005e978b070 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:13.976206 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-dcf95dba-cb63-495d-b525-3005e978b070 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043271 Dec 15 12:49:13.977156 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 733/1450] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:13 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:14.150640 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-55837464-b40a-42c1-888d-eda58d437589 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:14.151540 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-55837464-b40a-42c1-888d-eda58d437589 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:14.158644 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-55837464-b40a-42c1-888d-eda58d437589 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:14.159082 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-55837464-b40a-42c1-888d-eda58d437589 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:14.159876 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-55837464-b40a-42c1-888d-eda58d437589 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:14.160321 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-55837464-b40a-42c1-888d-eda58d437589 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:14.191915 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-55837464-b40a-42c1-888d-eda58d437589 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045042 Dec 15 12:49:14.192451 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 718/1451] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:14 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:14.987064 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0f073411-698f-4901-b17f-603aac426ad4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:14.987976 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0f073411-698f-4901-b17f-603aac426ad4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:14.994380 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0f073411-698f-4901-b17f-603aac426ad4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:14.994828 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0f073411-698f-4901-b17f-603aac426ad4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:14.995611 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0f073411-698f-4901-b17f-603aac426ad4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:14.996046 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0f073411-698f-4901-b17f-603aac426ad4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:15.027519 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0f073411-698f-4901-b17f-603aac426ad4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044129 Dec 15 12:49:15.028125 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 734/1452] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:14 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:15.204137 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a0f456d0-1bb5-4c72-8c67-fa21d44bbed2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:15.205195 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a0f456d0-1bb5-4c72-8c67-fa21d44bbed2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:15.214120 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a0f456d0-1bb5-4c72-8c67-fa21d44bbed2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:15.214686 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a0f456d0-1bb5-4c72-8c67-fa21d44bbed2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:15.215510 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a0f456d0-1bb5-4c72-8c67-fa21d44bbed2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:15.216007 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a0f456d0-1bb5-4c72-8c67-fa21d44bbed2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:15.247992 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a0f456d0-1bb5-4c72-8c67-fa21d44bbed2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047603 Dec 15 12:49:15.248458 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 719/1453] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:15 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:16.039615 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-306d50a2-e828-4d5e-9161-e9438e9428f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:16.040514 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-306d50a2-e828-4d5e-9161-e9438e9428f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:16.046775 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-306d50a2-e828-4d5e-9161-e9438e9428f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:16.047214 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-306d50a2-e828-4d5e-9161-e9438e9428f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:16.047979 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-306d50a2-e828-4d5e-9161-e9438e9428f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:16.048404 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-306d50a2-e828-4d5e-9161-e9438e9428f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:16.078709 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-306d50a2-e828-4d5e-9161-e9438e9428f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043436 Dec 15 12:49:16.079272 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 735/1454] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:16 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:16.259769 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-203fb084-2f16-4090-b0db-bc6d3a6f99ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:16.260707 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-203fb084-2f16-4090-b0db-bc6d3a6f99ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:16.267269 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-203fb084-2f16-4090-b0db-bc6d3a6f99ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:16.267707 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-203fb084-2f16-4090-b0db-bc6d3a6f99ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:16.268522 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-203fb084-2f16-4090-b0db-bc6d3a6f99ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:16.268963 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-203fb084-2f16-4090-b0db-bc6d3a6f99ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:16.300711 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-203fb084-2f16-4090-b0db-bc6d3a6f99ce tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044897 Dec 15 12:49:16.301311 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 720/1455] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:16 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:17.090773 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e24faf66-d9bf-45a8-8e62-36df8fe003ec tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:17.091583 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e24faf66-d9bf-45a8-8e62-36df8fe003ec tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:17.098058 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e24faf66-d9bf-45a8-8e62-36df8fe003ec tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:17.098517 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e24faf66-d9bf-45a8-8e62-36df8fe003ec tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:17.099347 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e24faf66-d9bf-45a8-8e62-36df8fe003ec tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:17.099773 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e24faf66-d9bf-45a8-8e62-36df8fe003ec tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:17.130147 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e24faf66-d9bf-45a8-8e62-36df8fe003ec tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043185 Dec 15 12:49:17.131633 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 736/1456] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:17 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:17.312364 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c50bccdd-d545-4fa5-a675-1b3e02b507c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:17.313324 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c50bccdd-d545-4fa5-a675-1b3e02b507c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:17.320580 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c50bccdd-d545-4fa5-a675-1b3e02b507c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:17.321028 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c50bccdd-d545-4fa5-a675-1b3e02b507c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:17.321877 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c50bccdd-d545-4fa5-a675-1b3e02b507c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:17.322297 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c50bccdd-d545-4fa5-a675-1b3e02b507c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:17.350993 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c50bccdd-d545-4fa5-a675-1b3e02b507c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042493 Dec 15 12:49:17.351506 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 721/1457] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:17 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:18.142464 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bbacb143-408e-4142-8843-bdc517a53fa3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:18.143374 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bbacb143-408e-4142-8843-bdc517a53fa3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:18.150604 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bbacb143-408e-4142-8843-bdc517a53fa3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:18.151055 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bbacb143-408e-4142-8843-bdc517a53fa3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:18.151849 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bbacb143-408e-4142-8843-bdc517a53fa3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:18.152290 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bbacb143-408e-4142-8843-bdc517a53fa3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:18.184471 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bbacb143-408e-4142-8843-bdc517a53fa3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045683 Dec 15 12:49:18.185258 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 737/1458] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:18 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:18.362606 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5846f004-7e21-45e9-bac3-dce63bb89cfb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:18.363514 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5846f004-7e21-45e9-bac3-dce63bb89cfb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:18.370407 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5846f004-7e21-45e9-bac3-dce63bb89cfb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:18.370861 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5846f004-7e21-45e9-bac3-dce63bb89cfb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:18.371714 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5846f004-7e21-45e9-bac3-dce63bb89cfb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:18.372154 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5846f004-7e21-45e9-bac3-dce63bb89cfb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:18.403527 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5846f004-7e21-45e9-bac3-dce63bb89cfb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044594 Dec 15 12:49:18.404008 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 722/1459] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:18 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:49:19.195948 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0a228182-559d-4cac-999b-9b7b3e6172ad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:19.196941 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0a228182-559d-4cac-999b-9b7b3e6172ad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:19.204312 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0a228182-559d-4cac-999b-9b7b3e6172ad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:19.204769 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0a228182-559d-4cac-999b-9b7b3e6172ad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:19.205606 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0a228182-559d-4cac-999b-9b7b3e6172ad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:19.206047 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0a228182-559d-4cac-999b-9b7b3e6172ad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:19.236600 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0a228182-559d-4cac-999b-9b7b3e6172ad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044421 Dec 15 12:49:19.237160 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 738/1460] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:19 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:19.416145 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5ca20b41-2463-4269-b273-7f453c5e0122 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:19.417192 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5ca20b41-2463-4269-b273-7f453c5e0122 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:19.424441 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ca20b41-2463-4269-b273-7f453c5e0122 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:19.424888 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ca20b41-2463-4269-b273-7f453c5e0122 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:19.425699 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ca20b41-2463-4269-b273-7f453c5e0122 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:19.426134 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ca20b41-2463-4269-b273-7f453c5e0122 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:19.454865 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5ca20b41-2463-4269-b273-7f453c5e0122 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043137 Dec 15 12:49:19.455326 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 723/1461] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:19 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:20.250123 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a9a49df2-8ccc-4985-b5ef-fac88dac2749 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:20.250941 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a9a49df2-8ccc-4985-b5ef-fac88dac2749 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:20.257813 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a9a49df2-8ccc-4985-b5ef-fac88dac2749 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:20.258269 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a9a49df2-8ccc-4985-b5ef-fac88dac2749 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:20.259060 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a9a49df2-8ccc-4985-b5ef-fac88dac2749 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:20.259496 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a9a49df2-8ccc-4985-b5ef-fac88dac2749 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:20.290901 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a9a49df2-8ccc-4985-b5ef-fac88dac2749 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044624 Dec 15 12:49:20.291469 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 739/1462] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:20 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:20.466773 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-82882e44-0917-4a90-b6ef-723585edbe6e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:20.467681 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-82882e44-0917-4a90-b6ef-723585edbe6e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:20.474621 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-82882e44-0917-4a90-b6ef-723585edbe6e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:20.475090 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-82882e44-0917-4a90-b6ef-723585edbe6e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:20.475866 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-82882e44-0917-4a90-b6ef-723585edbe6e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:20.476299 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-82882e44-0917-4a90-b6ef-723585edbe6e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:20.506981 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-82882e44-0917-4a90-b6ef-723585edbe6e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043757 Dec 15 12:49:20.507522 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 724/1463] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:20 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:21.301815 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a7d7ce70-5da0-4ad2-b546-3d38ca201534 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:21.303399 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a7d7ce70-5da0-4ad2-b546-3d38ca201534 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:21.309352 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a7d7ce70-5da0-4ad2-b546-3d38ca201534 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:21.309833 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a7d7ce70-5da0-4ad2-b546-3d38ca201534 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:21.310620 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a7d7ce70-5da0-4ad2-b546-3d38ca201534 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:21.311050 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a7d7ce70-5da0-4ad2-b546-3d38ca201534 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:21.339919 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a7d7ce70-5da0-4ad2-b546-3d38ca201534 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041642 Dec 15 12:49:21.340677 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 740/1464] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:21 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:21.518600 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-298ce890-b9c4-441c-9261-0cb787fedea3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:21.519529 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-298ce890-b9c4-441c-9261-0cb787fedea3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:21.525857 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-298ce890-b9c4-441c-9261-0cb787fedea3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:21.526302 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-298ce890-b9c4-441c-9261-0cb787fedea3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:21.527071 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-298ce890-b9c4-441c-9261-0cb787fedea3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:21.527500 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-298ce890-b9c4-441c-9261-0cb787fedea3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:21.560135 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-298ce890-b9c4-441c-9261-0cb787fedea3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045190 Dec 15 12:49:21.560612 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 725/1465] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:21 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:22.351650 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b387f363-2cd6-4fc1-b445-621d69703d7f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:22.352582 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b387f363-2cd6-4fc1-b445-621d69703d7f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:22.358764 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b387f363-2cd6-4fc1-b445-621d69703d7f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:22.359205 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b387f363-2cd6-4fc1-b445-621d69703d7f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:22.359987 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b387f363-2cd6-4fc1-b445-621d69703d7f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:22.360494 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b387f363-2cd6-4fc1-b445-621d69703d7f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:22.391986 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b387f363-2cd6-4fc1-b445-621d69703d7f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044519 Dec 15 12:49:22.392565 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 741/1466] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:22 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:22.571756 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b0008260-1a92-4081-8fe7-4fc3d42a8481 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:22.572589 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b0008260-1a92-4081-8fe7-4fc3d42a8481 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:22.578887 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b0008260-1a92-4081-8fe7-4fc3d42a8481 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:22.579330 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b0008260-1a92-4081-8fe7-4fc3d42a8481 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:22.580118 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b0008260-1a92-4081-8fe7-4fc3d42a8481 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:22.580553 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b0008260-1a92-4081-8fe7-4fc3d42a8481 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:22.612710 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b0008260-1a92-4081-8fe7-4fc3d42a8481 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044813 Dec 15 12:49:22.613263 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 726/1467] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:22 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:23.402788 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-79dbf39c-eac3-4730-ae89-8530e41ef13b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:23.403707 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-79dbf39c-eac3-4730-ae89-8530e41ef13b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:23.409853 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-79dbf39c-eac3-4730-ae89-8530e41ef13b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:23.410305 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-79dbf39c-eac3-4730-ae89-8530e41ef13b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:23.412432 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-79dbf39c-eac3-4730-ae89-8530e41ef13b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:23.412432 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-79dbf39c-eac3-4730-ae89-8530e41ef13b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:23.442329 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-79dbf39c-eac3-4730-ae89-8530e41ef13b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043173 Dec 15 12:49:23.443527 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 742/1468] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:23 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:49:23.624421 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-00e23d34-bcb3-4dc9-a62b-18ef48cf11d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:23.625274 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-00e23d34-bcb3-4dc9-a62b-18ef48cf11d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:23.639136 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-00e23d34-bcb3-4dc9-a62b-18ef48cf11d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:23.639585 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-00e23d34-bcb3-4dc9-a62b-18ef48cf11d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:23.640381 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-00e23d34-bcb3-4dc9-a62b-18ef48cf11d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:23.640818 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-00e23d34-bcb3-4dc9-a62b-18ef48cf11d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:23.671489 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-00e23d34-bcb3-4dc9-a62b-18ef48cf11d6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050883 Dec 15 12:49:23.672052 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 727/1469] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:23 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:24.454137 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ce02387d-25f6-49cf-a9d3-dd09d5ad6e62 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:24.455046 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ce02387d-25f6-49cf-a9d3-dd09d5ad6e62 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:24.462610 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce02387d-25f6-49cf-a9d3-dd09d5ad6e62 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:24.463062 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce02387d-25f6-49cf-a9d3-dd09d5ad6e62 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:24.463855 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce02387d-25f6-49cf-a9d3-dd09d5ad6e62 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:24.464330 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce02387d-25f6-49cf-a9d3-dd09d5ad6e62 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:24.498201 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ce02387d-25f6-49cf-a9d3-dd09d5ad6e62 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047693 Dec 15 12:49:24.498773 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 743/1470] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:24 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:24.684096 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ce0238f6-208d-474f-8216-562c7cc69282 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:24.685001 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ce0238f6-208d-474f-8216-562c7cc69282 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:24.691420 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ce0238f6-208d-474f-8216-562c7cc69282 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:24.691868 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ce0238f6-208d-474f-8216-562c7cc69282 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:24.692651 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ce0238f6-208d-474f-8216-562c7cc69282 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:24.693687 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ce0238f6-208d-474f-8216-562c7cc69282 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:24.723182 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ce0238f6-208d-474f-8216-562c7cc69282 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042837 Dec 15 12:49:24.723737 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 728/1471] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:24 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:25.510000 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a66d4e5f-048c-456f-b035-51d94a2399ec tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:25.510796 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a66d4e5f-048c-456f-b035-51d94a2399ec tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:25.518321 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a66d4e5f-048c-456f-b035-51d94a2399ec tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:25.518760 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a66d4e5f-048c-456f-b035-51d94a2399ec tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:25.519562 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a66d4e5f-048c-456f-b035-51d94a2399ec tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:25.519987 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a66d4e5f-048c-456f-b035-51d94a2399ec tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:25.550798 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a66d4e5f-048c-456f-b035-51d94a2399ec tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045439 Dec 15 12:49:25.551361 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 744/1472] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:25 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:25.735067 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-476cf0ec-9560-477a-8e96-abb48702e002 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:25.735964 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-476cf0ec-9560-477a-8e96-abb48702e002 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:25.743025 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-476cf0ec-9560-477a-8e96-abb48702e002 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:25.743469 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-476cf0ec-9560-477a-8e96-abb48702e002 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:25.744257 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-476cf0ec-9560-477a-8e96-abb48702e002 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:25.744689 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-476cf0ec-9560-477a-8e96-abb48702e002 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:25.775096 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-476cf0ec-9560-477a-8e96-abb48702e002 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043662 Dec 15 12:49:25.775589 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 729/1473] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:25 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:26.562438 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-cd9bce13-797d-44b9-81f9-a1dfa9d3aac5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:26.563405 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-cd9bce13-797d-44b9-81f9-a1dfa9d3aac5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:26.571154 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cd9bce13-797d-44b9-81f9-a1dfa9d3aac5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:26.571601 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cd9bce13-797d-44b9-81f9-a1dfa9d3aac5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:26.572396 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cd9bce13-797d-44b9-81f9-a1dfa9d3aac5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:26.572827 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cd9bce13-797d-44b9-81f9-a1dfa9d3aac5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:26.602747 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-cd9bce13-797d-44b9-81f9-a1dfa9d3aac5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044157 Dec 15 12:49:26.603327 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 745/1474] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:26 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:26.787741 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f1e44643-059a-4205-a52f-d535e82d3c63 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:26.788665 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f1e44643-059a-4205-a52f-d535e82d3c63 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:26.795092 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f1e44643-059a-4205-a52f-d535e82d3c63 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:26.795551 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f1e44643-059a-4205-a52f-d535e82d3c63 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:26.796328 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f1e44643-059a-4205-a52f-d535e82d3c63 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:26.796760 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f1e44643-059a-4205-a52f-d535e82d3c63 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:26.827988 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f1e44643-059a-4205-a52f-d535e82d3c63 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044506 Dec 15 12:49:26.831432 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 730/1475] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:26 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:27.614011 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-555e127c-a8a4-4e65-86fe-bd9f16168597 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:27.615823 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-555e127c-a8a4-4e65-86fe-bd9f16168597 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:27.622497 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-555e127c-a8a4-4e65-86fe-bd9f16168597 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:27.622947 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-555e127c-a8a4-4e65-86fe-bd9f16168597 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:27.623749 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-555e127c-a8a4-4e65-86fe-bd9f16168597 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:27.624187 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-555e127c-a8a4-4e65-86fe-bd9f16168597 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:27.654959 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-555e127c-a8a4-4e65-86fe-bd9f16168597 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044662 Dec 15 12:49:27.655531 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 746/1476] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:27 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:27.840211 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-413fd1b5-86a0-45ee-9e84-7a90ad0ed59d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:27.841121 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-413fd1b5-86a0-45ee-9e84-7a90ad0ed59d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:27.847028 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-413fd1b5-86a0-45ee-9e84-7a90ad0ed59d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:27.847528 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-413fd1b5-86a0-45ee-9e84-7a90ad0ed59d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:27.848249 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-413fd1b5-86a0-45ee-9e84-7a90ad0ed59d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:27.848682 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-413fd1b5-86a0-45ee-9e84-7a90ad0ed59d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:27.879135 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-413fd1b5-86a0-45ee-9e84-7a90ad0ed59d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042778 Dec 15 12:49:27.879749 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 731/1477] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:27 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:28.666532 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-af9a5c91-459e-44f6-9490-4b6ac9279116 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:28.668241 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-af9a5c91-459e-44f6-9490-4b6ac9279116 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:28.674745 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-af9a5c91-459e-44f6-9490-4b6ac9279116 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:28.675188 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-af9a5c91-459e-44f6-9490-4b6ac9279116 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:28.675979 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-af9a5c91-459e-44f6-9490-4b6ac9279116 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:28.676414 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-af9a5c91-459e-44f6-9490-4b6ac9279116 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:28.705651 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-af9a5c91-459e-44f6-9490-4b6ac9279116 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043037 Dec 15 12:49:28.706408 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 747/1478] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:28 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:28.891514 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4236b2ed-652b-4f7d-8c5b-a4720dd1977f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:28.892411 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4236b2ed-652b-4f7d-8c5b-a4720dd1977f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:28.899827 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4236b2ed-652b-4f7d-8c5b-a4720dd1977f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:28.900270 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4236b2ed-652b-4f7d-8c5b-a4720dd1977f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:28.901046 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4236b2ed-652b-4f7d-8c5b-a4720dd1977f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:28.901488 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4236b2ed-652b-4f7d-8c5b-a4720dd1977f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:28.932527 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4236b2ed-652b-4f7d-8c5b-a4720dd1977f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044214 Dec 15 12:49:28.932751 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 732/1479] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:28 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:49:29.717976 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-22a77321-ba5f-40b1-a30c-dd2fcea64f6f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:29.718899 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-22a77321-ba5f-40b1-a30c-dd2fcea64f6f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:29.725718 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-22a77321-ba5f-40b1-a30c-dd2fcea64f6f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:29.726174 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-22a77321-ba5f-40b1-a30c-dd2fcea64f6f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:29.726961 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-22a77321-ba5f-40b1-a30c-dd2fcea64f6f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:29.727447 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-22a77321-ba5f-40b1-a30c-dd2fcea64f6f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:29.759376 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-22a77321-ba5f-40b1-a30c-dd2fcea64f6f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045080 Dec 15 12:49:29.759960 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 748/1480] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:29 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:29.944939 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1e2c5720-55d2-425c-af91-770ed839ad2c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:29.945814 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1e2c5720-55d2-425c-af91-770ed839ad2c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:29.952189 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1e2c5720-55d2-425c-af91-770ed839ad2c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:29.952637 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1e2c5720-55d2-425c-af91-770ed839ad2c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:29.953433 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1e2c5720-55d2-425c-af91-770ed839ad2c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:29.953914 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1e2c5720-55d2-425c-af91-770ed839ad2c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:29.992150 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1e2c5720-55d2-425c-af91-770ed839ad2c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051646 Dec 15 12:49:29.992709 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 733/1481] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:29 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:30.771507 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3a5b7caf-e714-4484-8fcc-b83447523f68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:30.772417 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3a5b7caf-e714-4484-8fcc-b83447523f68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:30.778805 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3a5b7caf-e714-4484-8fcc-b83447523f68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:30.779252 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3a5b7caf-e714-4484-8fcc-b83447523f68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:30.780031 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3a5b7caf-e714-4484-8fcc-b83447523f68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:30.780469 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3a5b7caf-e714-4484-8fcc-b83447523f68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:30.810533 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3a5b7caf-e714-4484-8fcc-b83447523f68 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043011 Dec 15 12:49:30.811103 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 749/1482] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:30 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:31.003931 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-64e91d20-545c-416f-90f3-3f3f6409f93c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:31.004895 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-64e91d20-545c-416f-90f3-3f3f6409f93c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:31.011807 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-64e91d20-545c-416f-90f3-3f3f6409f93c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:31.012254 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-64e91d20-545c-416f-90f3-3f3f6409f93c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:31.013049 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-64e91d20-545c-416f-90f3-3f3f6409f93c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:31.013477 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-64e91d20-545c-416f-90f3-3f3f6409f93c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:31.042893 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-64e91d20-545c-416f-90f3-3f3f6409f93c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042845 Dec 15 12:49:31.043441 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 734/1483] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:30 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:31.822035 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b150ca68-39db-4b49-8c78-15efddb25c01 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:31.822940 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b150ca68-39db-4b49-8c78-15efddb25c01 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:31.829133 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b150ca68-39db-4b49-8c78-15efddb25c01 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:31.829602 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b150ca68-39db-4b49-8c78-15efddb25c01 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:31.830376 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b150ca68-39db-4b49-8c78-15efddb25c01 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:31.830806 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b150ca68-39db-4b49-8c78-15efddb25c01 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:31.861516 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b150ca68-39db-4b49-8c78-15efddb25c01 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043858 Dec 15 12:49:31.862104 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 750/1484] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:31 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:32.054836 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5321504a-9b99-4936-93a3-10b8993b3d9c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:32.055740 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5321504a-9b99-4936-93a3-10b8993b3d9c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:32.062055 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5321504a-9b99-4936-93a3-10b8993b3d9c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:32.062501 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5321504a-9b99-4936-93a3-10b8993b3d9c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:32.063279 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5321504a-9b99-4936-93a3-10b8993b3d9c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:32.063712 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5321504a-9b99-4936-93a3-10b8993b3d9c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:32.093743 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5321504a-9b99-4936-93a3-10b8993b3d9c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042818 Dec 15 12:49:32.094292 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 735/1485] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:32 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:32.873435 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-dcd79d55-137f-4fb3-b76b-8499b12e6215 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:32.874281 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-dcd79d55-137f-4fb3-b76b-8499b12e6215 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:32.880842 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dcd79d55-137f-4fb3-b76b-8499b12e6215 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:32.881578 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dcd79d55-137f-4fb3-b76b-8499b12e6215 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:32.882415 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dcd79d55-137f-4fb3-b76b-8499b12e6215 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:32.882852 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dcd79d55-137f-4fb3-b76b-8499b12e6215 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:32.913799 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-dcd79d55-137f-4fb3-b76b-8499b12e6215 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044239 Dec 15 12:49:32.914364 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 751/1486] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:32 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:33.106185 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-cd39feb6-b342-4925-83ae-772f785021c5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:33.107109 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-cd39feb6-b342-4925-83ae-772f785021c5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:33.113245 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cd39feb6-b342-4925-83ae-772f785021c5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:33.113715 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cd39feb6-b342-4925-83ae-772f785021c5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:33.114596 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cd39feb6-b342-4925-83ae-772f785021c5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:33.115035 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cd39feb6-b342-4925-83ae-772f785021c5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:33.145263 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cd39feb6-b342-4925-83ae-772f785021c5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042822 Dec 15 12:49:33.146382 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 736/1487] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:33 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:33.924088 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2da85473-c504-4295-a370-acac882423c5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:33.926459 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2da85473-c504-4295-a370-acac882423c5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:33.933781 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2da85473-c504-4295-a370-acac882423c5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:33.934237 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2da85473-c504-4295-a370-acac882423c5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:33.935047 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2da85473-c504-4295-a370-acac882423c5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:33.935485 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2da85473-c504-4295-a370-acac882423c5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:33.964675 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2da85473-c504-4295-a370-acac882423c5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044304 Dec 15 12:49:33.965235 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 752/1488] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:33 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:34.157756 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-64a93016-ab1c-478f-845e-e08f7c49d19a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:34.158692 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-64a93016-ab1c-478f-845e-e08f7c49d19a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:34.165611 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-64a93016-ab1c-478f-845e-e08f7c49d19a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:34.166057 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-64a93016-ab1c-478f-845e-e08f7c49d19a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:34.166834 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-64a93016-ab1c-478f-845e-e08f7c49d19a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:34.167306 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-64a93016-ab1c-478f-845e-e08f7c49d19a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:34.197820 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-64a93016-ab1c-478f-845e-e08f7c49d19a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043698 Dec 15 12:49:34.198307 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 737/1489] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:34 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:34.977401 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-65b30d3a-8565-4716-9452-7924ba156b34 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:34.978353 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-65b30d3a-8565-4716-9452-7924ba156b34 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:34.985583 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-65b30d3a-8565-4716-9452-7924ba156b34 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:34.986382 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-65b30d3a-8565-4716-9452-7924ba156b34 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:34.987273 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-65b30d3a-8565-4716-9452-7924ba156b34 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:34.988070 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-65b30d3a-8565-4716-9452-7924ba156b34 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:35.019073 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-65b30d3a-8565-4716-9452-7924ba156b34 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046843 Dec 15 12:49:35.019648 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 753/1490] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:34 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:35.209434 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9f5ef4c6-96f4-4f14-a93c-7ff6f814f3b4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:35.210365 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9f5ef4c6-96f4-4f14-a93c-7ff6f814f3b4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:35.216725 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9f5ef4c6-96f4-4f14-a93c-7ff6f814f3b4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:35.217175 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9f5ef4c6-96f4-4f14-a93c-7ff6f814f3b4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:35.217988 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9f5ef4c6-96f4-4f14-a93c-7ff6f814f3b4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:35.218434 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9f5ef4c6-96f4-4f14-a93c-7ff6f814f3b4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:35.253472 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9f5ef4c6-96f4-4f14-a93c-7ff6f814f3b4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047687 Dec 15 12:49:35.253982 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 738/1491] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:35 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:36.220764 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-57a37fa7-081a-440d-a114-b1c358323c7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:36.221746 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-57a37fa7-081a-440d-a114-b1c358323c7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:36.228477 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-57a37fa7-081a-440d-a114-b1c358323c7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:36.228922 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-57a37fa7-081a-440d-a114-b1c358323c7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:36.229744 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-57a37fa7-081a-440d-a114-b1c358323c7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:36.230178 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-57a37fa7-081a-440d-a114-b1c358323c7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:36.259202 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-57a37fa7-081a-440d-a114-b1c358323c7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.231629 Dec 15 12:49:36.259956 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 754/1492] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:36 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:36.265906 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1c043489-23a7-4a21-85ba-19adc7b08a2e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:36.266802 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1c043489-23a7-4a21-85ba-19adc7b08a2e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:36.274087 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1c043489-23a7-4a21-85ba-19adc7b08a2e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:36.274532 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1c043489-23a7-4a21-85ba-19adc7b08a2e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:36.275333 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1c043489-23a7-4a21-85ba-19adc7b08a2e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:36.275762 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1c043489-23a7-4a21-85ba-19adc7b08a2e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:36.307938 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1c043489-23a7-4a21-85ba-19adc7b08a2e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045741 Dec 15 12:49:36.308497 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 739/1493] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:36 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:37.271115 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fd95ac3a-2d07-46d8-852e-84ead2971257 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:37.272032 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fd95ac3a-2d07-46d8-852e-84ead2971257 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:37.278539 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fd95ac3a-2d07-46d8-852e-84ead2971257 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:37.278987 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fd95ac3a-2d07-46d8-852e-84ead2971257 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:37.279789 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fd95ac3a-2d07-46d8-852e-84ead2971257 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:37.280228 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fd95ac3a-2d07-46d8-852e-84ead2971257 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:37.316090 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fd95ac3a-2d07-46d8-852e-84ead2971257 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048702 Dec 15 12:49:37.317033 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 755/1494] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:37 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:37.320126 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-44799932-3bff-4c02-98f8-dcb6e640da23 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:37.321116 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-44799932-3bff-4c02-98f8-dcb6e640da23 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:37.327485 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-44799932-3bff-4c02-98f8-dcb6e640da23 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:37.327923 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-44799932-3bff-4c02-98f8-dcb6e640da23 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:37.328708 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-44799932-3bff-4c02-98f8-dcb6e640da23 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:37.329139 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-44799932-3bff-4c02-98f8-dcb6e640da23 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:37.358447 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-44799932-3bff-4c02-98f8-dcb6e640da23 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042584 Dec 15 12:49:37.358994 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 740/1495] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:37 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:38.308691 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 12:49:38.308961 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 12:49:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 12:49:38.327527 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-edd2ed39-6f6c-4231-8901-deb8380cc171 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:38.328430 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-edd2ed39-6f6c-4231-8901-deb8380cc171 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:38.334856 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-edd2ed39-6f6c-4231-8901-deb8380cc171 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:38.335389 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-edd2ed39-6f6c-4231-8901-deb8380cc171 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:38.336051 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-edd2ed39-6f6c-4231-8901-deb8380cc171 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:38.336495 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-edd2ed39-6f6c-4231-8901-deb8380cc171 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:38.368166 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-edd2ed39-6f6c-4231-8901-deb8380cc171 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044198 Dec 15 12:49:38.371430 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-89a35ed0-ba90-48d4-9d03-94581b8bb206 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:38.372107 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 756/1496] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:38 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:38.372425 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-89a35ed0-ba90-48d4-9d03-94581b8bb206 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:38.378880 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-89a35ed0-ba90-48d4-9d03-94581b8bb206 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:38.379332 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-89a35ed0-ba90-48d4-9d03-94581b8bb206 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:38.380766 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-89a35ed0-ba90-48d4-9d03-94581b8bb206 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:38.381562 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-89a35ed0-ba90-48d4-9d03-94581b8bb206 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:38.414547 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-89a35ed0-ba90-48d4-9d03-94581b8bb206 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047311 Dec 15 12:49:38.415086 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 741/1497] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:38 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:39.379473 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-19272698-b16b-47c2-b51d-5ae4bb8e66c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:39.380964 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-19272698-b16b-47c2-b51d-5ae4bb8e66c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:39.387627 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-19272698-b16b-47c2-b51d-5ae4bb8e66c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:39.388066 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-19272698-b16b-47c2-b51d-5ae4bb8e66c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:39.388871 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-19272698-b16b-47c2-b51d-5ae4bb8e66c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:39.389301 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-19272698-b16b-47c2-b51d-5ae4bb8e66c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:39.420026 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-19272698-b16b-47c2-b51d-5ae4bb8e66c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044206 Dec 15 12:49:39.420587 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 757/1498] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:39 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:39.426060 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9653ffc6-6726-484d-b4cf-58b51ac62f6b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:39.427205 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9653ffc6-6726-484d-b4cf-58b51ac62f6b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:39.433488 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9653ffc6-6726-484d-b4cf-58b51ac62f6b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:39.433977 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9653ffc6-6726-484d-b4cf-58b51ac62f6b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:39.434745 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9653ffc6-6726-484d-b4cf-58b51ac62f6b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:39.435175 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9653ffc6-6726-484d-b4cf-58b51ac62f6b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:39.466601 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9653ffc6-6726-484d-b4cf-58b51ac62f6b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044240 Dec 15 12:49:39.467158 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 742/1499] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:39 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:49:40.431676 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a6883006-0325-4cd0-a2d7-1a2f0d1ca504 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:40.432498 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a6883006-0325-4cd0-a2d7-1a2f0d1ca504 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:40.439167 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a6883006-0325-4cd0-a2d7-1a2f0d1ca504 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:40.439607 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a6883006-0325-4cd0-a2d7-1a2f0d1ca504 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:40.440456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a6883006-0325-4cd0-a2d7-1a2f0d1ca504 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:40.440887 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a6883006-0325-4cd0-a2d7-1a2f0d1ca504 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:40.471019 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a6883006-0325-4cd0-a2d7-1a2f0d1ca504 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043061 Dec 15 12:49:40.471619 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 758/1500] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:40 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:49:40.479640 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-599e4359-b3e3-43eb-b2dd-ecf8be330e6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:40.480550 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-599e4359-b3e3-43eb-b2dd-ecf8be330e6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:40.492616 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-599e4359-b3e3-43eb-b2dd-ecf8be330e6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:40.493065 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-599e4359-b3e3-43eb-b2dd-ecf8be330e6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:40.493902 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-599e4359-b3e3-43eb-b2dd-ecf8be330e6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:40.494328 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-599e4359-b3e3-43eb-b2dd-ecf8be330e6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:40.524236 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-599e4359-b3e3-43eb-b2dd-ecf8be330e6f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048433 Dec 15 12:49:40.524785 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 743/1501] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:40 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:41.483509 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6ae7d3e6-48d5-405b-87d1-bf79b7f4fe29 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:41.484317 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6ae7d3e6-48d5-405b-87d1-bf79b7f4fe29 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:41.490903 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6ae7d3e6-48d5-405b-87d1-bf79b7f4fe29 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:41.491346 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6ae7d3e6-48d5-405b-87d1-bf79b7f4fe29 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:41.492142 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6ae7d3e6-48d5-405b-87d1-bf79b7f4fe29 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:41.492568 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6ae7d3e6-48d5-405b-87d1-bf79b7f4fe29 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:41.522680 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6ae7d3e6-48d5-405b-87d1-bf79b7f4fe29 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043098 Dec 15 12:49:41.523356 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 759/1502] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:41 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:41.535880 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3c9301cf-d1a5-4a28-bf94-2a87881a0c91 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:41.537080 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3c9301cf-d1a5-4a28-bf94-2a87881a0c91 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:41.543354 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c9301cf-d1a5-4a28-bf94-2a87881a0c91 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:41.543964 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c9301cf-d1a5-4a28-bf94-2a87881a0c91 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:41.544572 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c9301cf-d1a5-4a28-bf94-2a87881a0c91 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:41.545002 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c9301cf-d1a5-4a28-bf94-2a87881a0c91 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:41.575120 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3c9301cf-d1a5-4a28-bf94-2a87881a0c91 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042991 Dec 15 12:49:41.575685 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 744/1503] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:41 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:42.534420 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-312af513-79d5-4535-819d-8d40e516ad52 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:42.535317 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-312af513-79d5-4535-819d-8d40e516ad52 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:42.541724 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-312af513-79d5-4535-819d-8d40e516ad52 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:42.542164 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-312af513-79d5-4535-819d-8d40e516ad52 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:42.542933 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-312af513-79d5-4535-819d-8d40e516ad52 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:42.543359 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-312af513-79d5-4535-819d-8d40e516ad52 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:42.572503 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-312af513-79d5-4535-819d-8d40e516ad52 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041703 Dec 15 12:49:42.573012 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 760/1504] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:42 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:42.588171 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-45e6d391-52ed-4e74-8f7f-b868d69a8621 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:42.589075 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-45e6d391-52ed-4e74-8f7f-b868d69a8621 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:42.595431 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-45e6d391-52ed-4e74-8f7f-b868d69a8621 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:42.595874 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-45e6d391-52ed-4e74-8f7f-b868d69a8621 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:42.596651 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-45e6d391-52ed-4e74-8f7f-b868d69a8621 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:42.597084 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-45e6d391-52ed-4e74-8f7f-b868d69a8621 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:42.626901 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-45e6d391-52ed-4e74-8f7f-b868d69a8621 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042392 Dec 15 12:49:42.627489 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 745/1505] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:42 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:43.584645 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1526a224-91b8-4a47-9e01-3074423a690c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:43.585479 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1526a224-91b8-4a47-9e01-3074423a690c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:43.591649 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1526a224-91b8-4a47-9e01-3074423a690c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:43.592086 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1526a224-91b8-4a47-9e01-3074423a690c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:43.592879 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1526a224-91b8-4a47-9e01-3074423a690c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:43.593313 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1526a224-91b8-4a47-9e01-3074423a690c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:43.623545 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1526a224-91b8-4a47-9e01-3074423a690c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043375 Dec 15 12:49:43.624133 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 761/1506] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:43 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:43.639313 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-24b3f750-013e-40dd-bd68-803b67d1b54d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:43.640241 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-24b3f750-013e-40dd-bd68-803b67d1b54d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:43.646985 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-24b3f750-013e-40dd-bd68-803b67d1b54d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:43.647421 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-24b3f750-013e-40dd-bd68-803b67d1b54d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:43.648190 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-24b3f750-013e-40dd-bd68-803b67d1b54d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:43.648617 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-24b3f750-013e-40dd-bd68-803b67d1b54d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:43.683942 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-24b3f750-013e-40dd-bd68-803b67d1b54d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048329 Dec 15 12:49:43.684502 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 746/1507] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:43 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:44.194699 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 12:49:44.194939 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 12:49:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 12:49:44.638200 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fe6912d4-93b2-43a5-a92f-46dc9b052303 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:44.639170 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fe6912d4-93b2-43a5-a92f-46dc9b052303 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:44.648729 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe6912d4-93b2-43a5-a92f-46dc9b052303 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:44.649378 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe6912d4-93b2-43a5-a92f-46dc9b052303 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:44.650237 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe6912d4-93b2-43a5-a92f-46dc9b052303 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:44.650674 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe6912d4-93b2-43a5-a92f-46dc9b052303 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:44.682736 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fe6912d4-93b2-43a5-a92f-46dc9b052303 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049788 Dec 15 12:49:44.683293 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 762/1508] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:44 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:44.840446 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-01101eb1-b62f-4433-a354-2db81612a4d0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:44.841344 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-01101eb1-b62f-4433-a354-2db81612a4d0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:44.847359 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-01101eb1-b62f-4433-a354-2db81612a4d0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:44.847808 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-01101eb1-b62f-4433-a354-2db81612a4d0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:44.848627 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-01101eb1-b62f-4433-a354-2db81612a4d0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:44.849204 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-01101eb1-b62f-4433-a354-2db81612a4d0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:44.887690 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-01101eb1-b62f-4433-a354-2db81612a4d0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.196501 Dec 15 12:49:44.888253 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 747/1509] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:44 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:45.693825 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-68e0911a-0d72-4f22-b3c3-6bfc4a3af201 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:45.694726 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-68e0911a-0d72-4f22-b3c3-6bfc4a3af201 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:45.700961 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-68e0911a-0d72-4f22-b3c3-6bfc4a3af201 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:45.701400 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-68e0911a-0d72-4f22-b3c3-6bfc4a3af201 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:45.702223 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-68e0911a-0d72-4f22-b3c3-6bfc4a3af201 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:45.702662 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-68e0911a-0d72-4f22-b3c3-6bfc4a3af201 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:45.734599 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-68e0911a-0d72-4f22-b3c3-6bfc4a3af201 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044873 Dec 15 12:49:45.735147 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 763/1510] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:45 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:45.899930 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f9998e8c-0792-44d3-822f-7475aad20651 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:45.900837 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f9998e8c-0792-44d3-822f-7475aad20651 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:45.907169 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f9998e8c-0792-44d3-822f-7475aad20651 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:45.907619 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f9998e8c-0792-44d3-822f-7475aad20651 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:45.908532 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f9998e8c-0792-44d3-822f-7475aad20651 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:45.908980 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f9998e8c-0792-44d3-822f-7475aad20651 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:45.941065 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f9998e8c-0792-44d3-822f-7475aad20651 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045400 Dec 15 12:49:45.941655 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 748/1511] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:45 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:46.747095 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f30f0f8a-33f5-431b-8d1d-39d43e333120 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:46.747933 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f30f0f8a-33f5-431b-8d1d-39d43e333120 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:46.754370 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f30f0f8a-33f5-431b-8d1d-39d43e333120 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:46.754954 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f30f0f8a-33f5-431b-8d1d-39d43e333120 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:46.755749 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f30f0f8a-33f5-431b-8d1d-39d43e333120 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:46.756436 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f30f0f8a-33f5-431b-8d1d-39d43e333120 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:46.784581 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f30f0f8a-33f5-431b-8d1d-39d43e333120 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041630 Dec 15 12:49:46.785128 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 764/1512] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:46 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:46.953548 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3ebe2fc1-4108-4841-afe5-2e96b06e00d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:46.954483 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3ebe2fc1-4108-4841-afe5-2e96b06e00d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:46.961982 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3ebe2fc1-4108-4841-afe5-2e96b06e00d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:46.962433 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3ebe2fc1-4108-4841-afe5-2e96b06e00d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:46.963235 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3ebe2fc1-4108-4841-afe5-2e96b06e00d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:46.963675 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3ebe2fc1-4108-4841-afe5-2e96b06e00d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:46.992938 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3ebe2fc1-4108-4841-afe5-2e96b06e00d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043345 Dec 15 12:49:46.993496 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 749/1513] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:46 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:47.796683 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7fa9fbd4-5323-4cae-b3be-1a1b091aa2eb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:47.797612 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7fa9fbd4-5323-4cae-b3be-1a1b091aa2eb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:47.804053 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7fa9fbd4-5323-4cae-b3be-1a1b091aa2eb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:47.804500 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7fa9fbd4-5323-4cae-b3be-1a1b091aa2eb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:47.805273 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7fa9fbd4-5323-4cae-b3be-1a1b091aa2eb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:47.805734 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7fa9fbd4-5323-4cae-b3be-1a1b091aa2eb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:47.835362 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7fa9fbd4-5323-4cae-b3be-1a1b091aa2eb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042303 Dec 15 12:49:47.835943 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 765/1514] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:47 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:48.004483 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-63bd5df6-bb86-4d51-ba8e-ec4458b7b22f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:48.005951 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-63bd5df6-bb86-4d51-ba8e-ec4458b7b22f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:48.012453 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-63bd5df6-bb86-4d51-ba8e-ec4458b7b22f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:48.012906 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-63bd5df6-bb86-4d51-ba8e-ec4458b7b22f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:48.013721 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-63bd5df6-bb86-4d51-ba8e-ec4458b7b22f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:48.014167 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-63bd5df6-bb86-4d51-ba8e-ec4458b7b22f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:48.044158 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-63bd5df6-bb86-4d51-ba8e-ec4458b7b22f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043598 Dec 15 12:49:48.044771 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 750/1515] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:47 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:49:48.846975 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-cc35fbf7-0b33-4432-aa39-fc05ad66071e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:48.847910 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-cc35fbf7-0b33-4432-aa39-fc05ad66071e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:48.854361 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cc35fbf7-0b33-4432-aa39-fc05ad66071e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:48.854815 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cc35fbf7-0b33-4432-aa39-fc05ad66071e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:48.855598 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cc35fbf7-0b33-4432-aa39-fc05ad66071e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:48.856035 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cc35fbf7-0b33-4432-aa39-fc05ad66071e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:48.887099 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-cc35fbf7-0b33-4432-aa39-fc05ad66071e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043825 Dec 15 12:49:48.887690 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 766/1516] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:48 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:49.056741 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-031fe878-b63b-4299-8272-6a2682ed8873 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:49.057578 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-031fe878-b63b-4299-8272-6a2682ed8873 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:49.063752 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-031fe878-b63b-4299-8272-6a2682ed8873 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:49.064192 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-031fe878-b63b-4299-8272-6a2682ed8873 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:49.064970 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-031fe878-b63b-4299-8272-6a2682ed8873 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:49.065385 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-031fe878-b63b-4299-8272-6a2682ed8873 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:49.094509 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-031fe878-b63b-4299-8272-6a2682ed8873 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041575 Dec 15 12:49:49.095088 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 751/1517] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:49 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:49.898582 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d8015e43-1058-4994-a299-79fe51d144a9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:49.899491 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d8015e43-1058-4994-a299-79fe51d144a9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:49.905802 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d8015e43-1058-4994-a299-79fe51d144a9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:49.906253 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d8015e43-1058-4994-a299-79fe51d144a9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:49.907035 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d8015e43-1058-4994-a299-79fe51d144a9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:49.907470 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d8015e43-1058-4994-a299-79fe51d144a9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:49.939297 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d8015e43-1058-4994-a299-79fe51d144a9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044110 Dec 15 12:49:49.939975 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 767/1518] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:49 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:50.107095 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-32b5a6d2-305d-46c3-8bca-4fdc3a1fef17 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:50.107916 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-32b5a6d2-305d-46c3-8bca-4fdc3a1fef17 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:50.114869 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-32b5a6d2-305d-46c3-8bca-4fdc3a1fef17 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:50.115320 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-32b5a6d2-305d-46c3-8bca-4fdc3a1fef17 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:50.116109 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-32b5a6d2-305d-46c3-8bca-4fdc3a1fef17 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:50.116544 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-32b5a6d2-305d-46c3-8bca-4fdc3a1fef17 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:50.147622 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-32b5a6d2-305d-46c3-8bca-4fdc3a1fef17 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044373 Dec 15 12:49:50.148186 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 752/1519] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:50 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:50.950520 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7c4e1c3f-95d7-4e71-8ac0-e5123d12e2ec tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:50.951425 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7c4e1c3f-95d7-4e71-8ac0-e5123d12e2ec tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:50.958134 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7c4e1c3f-95d7-4e71-8ac0-e5123d12e2ec tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:50.958696 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7c4e1c3f-95d7-4e71-8ac0-e5123d12e2ec tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:50.959481 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7c4e1c3f-95d7-4e71-8ac0-e5123d12e2ec tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:50.959918 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7c4e1c3f-95d7-4e71-8ac0-e5123d12e2ec tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:50.990938 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7c4e1c3f-95d7-4e71-8ac0-e5123d12e2ec tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044161 Dec 15 12:49:50.991504 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 768/1520] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:50 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:51.159254 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-04dec889-4fad-40ab-af85-7e72af999473 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:51.160197 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-04dec889-4fad-40ab-af85-7e72af999473 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:51.167104 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-04dec889-4fad-40ab-af85-7e72af999473 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:51.167550 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-04dec889-4fad-40ab-af85-7e72af999473 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:51.168324 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-04dec889-4fad-40ab-af85-7e72af999473 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:51.168759 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-04dec889-4fad-40ab-af85-7e72af999473 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:51.199097 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-04dec889-4fad-40ab-af85-7e72af999473 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043555 Dec 15 12:49:51.199660 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 753/1521] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:51 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:52.002406 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-61823ae7-fc94-4cce-8290-d11976d6074a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:52.003234 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-61823ae7-fc94-4cce-8290-d11976d6074a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:52.010301 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-61823ae7-fc94-4cce-8290-d11976d6074a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:52.010758 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-61823ae7-fc94-4cce-8290-d11976d6074a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:52.011569 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-61823ae7-fc94-4cce-8290-d11976d6074a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:52.011992 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-61823ae7-fc94-4cce-8290-d11976d6074a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:52.041171 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-61823ae7-fc94-4cce-8290-d11976d6074a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042623 Dec 15 12:49:52.041752 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 769/1522] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:51 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:52.211184 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c39720a9-b409-4764-b92a-f0351490e028 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:52.212096 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c39720a9-b409-4764-b92a-f0351490e028 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:52.218917 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c39720a9-b409-4764-b92a-f0351490e028 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:52.219366 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c39720a9-b409-4764-b92a-f0351490e028 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:52.220168 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c39720a9-b409-4764-b92a-f0351490e028 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:52.220605 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c39720a9-b409-4764-b92a-f0351490e028 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:52.249599 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c39720a9-b409-4764-b92a-f0351490e028 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042797 Dec 15 12:49:52.250082 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 754/1523] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:52 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:53.054170 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5bc2d694-20cd-441c-8e36-c1dec0d123ea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:53.055110 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5bc2d694-20cd-441c-8e36-c1dec0d123ea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:53.061340 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5bc2d694-20cd-441c-8e36-c1dec0d123ea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:53.061808 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5bc2d694-20cd-441c-8e36-c1dec0d123ea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:53.062588 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5bc2d694-20cd-441c-8e36-c1dec0d123ea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:53.063015 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5bc2d694-20cd-441c-8e36-c1dec0d123ea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:53.091403 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5bc2d694-20cd-441c-8e36-c1dec0d123ea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042079 Dec 15 12:49:53.091986 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 770/1524] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:53 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:53.261381 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ccea7b57-c421-4531-bf74-95eac1af3c78 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:53.262287 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ccea7b57-c421-4531-bf74-95eac1af3c78 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:53.268611 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ccea7b57-c421-4531-bf74-95eac1af3c78 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:53.269049 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ccea7b57-c421-4531-bf74-95eac1af3c78 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:53.269854 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ccea7b57-c421-4531-bf74-95eac1af3c78 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:53.270829 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ccea7b57-c421-4531-bf74-95eac1af3c78 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:53.300277 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ccea7b57-c421-4531-bf74-95eac1af3c78 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042979 Dec 15 12:49:53.300837 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 755/1525] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:53 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:54.103717 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f7d5f5f3-2bbc-438b-973c-04bc8f40b1b3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:54.104627 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f7d5f5f3-2bbc-438b-973c-04bc8f40b1b3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:54.110959 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f7d5f5f3-2bbc-438b-973c-04bc8f40b1b3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:54.111412 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f7d5f5f3-2bbc-438b-973c-04bc8f40b1b3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:54.112186 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f7d5f5f3-2bbc-438b-973c-04bc8f40b1b3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:54.112625 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f7d5f5f3-2bbc-438b-973c-04bc8f40b1b3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:54.141830 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f7d5f5f3-2bbc-438b-973c-04bc8f40b1b3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041758 Dec 15 12:49:54.142413 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 771/1526] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:54 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:49:54.320615 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-67d0f5fd-63a8-4046-b15a-f0f542d704e6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:54.321537 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-67d0f5fd-63a8-4046-b15a-f0f542d704e6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:54.327761 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-67d0f5fd-63a8-4046-b15a-f0f542d704e6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:54.328209 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-67d0f5fd-63a8-4046-b15a-f0f542d704e6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:54.328990 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-67d0f5fd-63a8-4046-b15a-f0f542d704e6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:54.329426 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-67d0f5fd-63a8-4046-b15a-f0f542d704e6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:54.361235 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-67d0f5fd-63a8-4046-b15a-f0f542d704e6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044904 Dec 15 12:49:54.361858 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 756/1527] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:54 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:55.153586 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8e0677bd-6bd8-4ee2-9644-41ee2fa89acf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:55.154498 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8e0677bd-6bd8-4ee2-9644-41ee2fa89acf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:55.161200 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8e0677bd-6bd8-4ee2-9644-41ee2fa89acf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:55.161717 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8e0677bd-6bd8-4ee2-9644-41ee2fa89acf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:55.162492 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8e0677bd-6bd8-4ee2-9644-41ee2fa89acf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:55.162926 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8e0677bd-6bd8-4ee2-9644-41ee2fa89acf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:55.193006 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8e0677bd-6bd8-4ee2-9644-41ee2fa89acf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043096 Dec 15 12:49:55.193620 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 772/1528] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:55 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:55.372226 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2f91447f-aedd-4ea4-bd1d-8876ecb41346 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:55.373128 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2f91447f-aedd-4ea4-bd1d-8876ecb41346 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:55.379556 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2f91447f-aedd-4ea4-bd1d-8876ecb41346 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:55.380000 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2f91447f-aedd-4ea4-bd1d-8876ecb41346 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:55.380772 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2f91447f-aedd-4ea4-bd1d-8876ecb41346 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:55.381462 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2f91447f-aedd-4ea4-bd1d-8876ecb41346 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:55.412777 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2f91447f-aedd-4ea4-bd1d-8876ecb41346 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044328 Dec 15 12:49:55.413332 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 757/1529] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:55 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:56.204168 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fa1e8c35-e49c-47bc-90f9-565145aefb70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:56.205068 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fa1e8c35-e49c-47bc-90f9-565145aefb70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:56.211834 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fa1e8c35-e49c-47bc-90f9-565145aefb70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:56.212283 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fa1e8c35-e49c-47bc-90f9-565145aefb70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:56.213057 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fa1e8c35-e49c-47bc-90f9-565145aefb70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:56.213485 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fa1e8c35-e49c-47bc-90f9-565145aefb70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:56.250272 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fa1e8c35-e49c-47bc-90f9-565145aefb70 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049780 Dec 15 12:49:56.250826 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 773/1530] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:56 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:56.424243 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5d8a645a-b486-4104-b4b8-2721e06e7e22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:56.425175 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5d8a645a-b486-4104-b4b8-2721e06e7e22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:56.431229 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5d8a645a-b486-4104-b4b8-2721e06e7e22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:56.431671 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5d8a645a-b486-4104-b4b8-2721e06e7e22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:56.432497 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5d8a645a-b486-4104-b4b8-2721e06e7e22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:56.432948 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5d8a645a-b486-4104-b4b8-2721e06e7e22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:56.464933 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5d8a645a-b486-4104-b4b8-2721e06e7e22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044407 Dec 15 12:49:56.465484 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 758/1531] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:56 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:57.261917 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6b715be8-82da-460e-9fa6-dc4e15db0a35 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:57.262829 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6b715be8-82da-460e-9fa6-dc4e15db0a35 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:57.269562 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6b715be8-82da-460e-9fa6-dc4e15db0a35 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:57.270062 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6b715be8-82da-460e-9fa6-dc4e15db0a35 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:57.270879 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6b715be8-82da-460e-9fa6-dc4e15db0a35 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:57.271310 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6b715be8-82da-460e-9fa6-dc4e15db0a35 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:57.301064 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6b715be8-82da-460e-9fa6-dc4e15db0a35 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042880 Dec 15 12:49:57.302327 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 774/1532] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:57 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:49:57.476610 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4ed82f67-083b-4e39-adfc-baaa65423d8e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:57.477582 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4ed82f67-083b-4e39-adfc-baaa65423d8e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:57.483736 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4ed82f67-083b-4e39-adfc-baaa65423d8e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:57.484179 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4ed82f67-083b-4e39-adfc-baaa65423d8e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:57.485011 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4ed82f67-083b-4e39-adfc-baaa65423d8e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:57.485444 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4ed82f67-083b-4e39-adfc-baaa65423d8e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:57.515489 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4ed82f67-083b-4e39-adfc-baaa65423d8e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043450 Dec 15 12:49:57.516047 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 759/1533] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:57 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:58.313006 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b0fbc08d-ef2f-4a1e-a7bf-637727080f1c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:58.313997 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b0fbc08d-ef2f-4a1e-a7bf-637727080f1c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:58.321236 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b0fbc08d-ef2f-4a1e-a7bf-637727080f1c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:58.321744 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b0fbc08d-ef2f-4a1e-a7bf-637727080f1c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:58.322523 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b0fbc08d-ef2f-4a1e-a7bf-637727080f1c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:58.323032 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b0fbc08d-ef2f-4a1e-a7bf-637727080f1c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:58.352390 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b0fbc08d-ef2f-4a1e-a7bf-637727080f1c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043365 Dec 15 12:49:58.352953 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 775/1534] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:58 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:49:58.527634 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e8b09af2-d41b-4d25-a456-0c50eb572336 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:58.528466 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e8b09af2-d41b-4d25-a456-0c50eb572336 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:58.534862 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e8b09af2-d41b-4d25-a456-0c50eb572336 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:58.535319 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e8b09af2-d41b-4d25-a456-0c50eb572336 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:58.536222 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e8b09af2-d41b-4d25-a456-0c50eb572336 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:58.536661 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e8b09af2-d41b-4d25-a456-0c50eb572336 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:58.566274 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e8b09af2-d41b-4d25-a456-0c50eb572336 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042787 Dec 15 12:49:58.567488 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 760/1535] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:58 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:59.364276 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c917f88f-509e-406f-bc5e-8ab4c061e27b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:59.365359 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c917f88f-509e-406f-bc5e-8ab4c061e27b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:59.371700 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c917f88f-509e-406f-bc5e-8ab4c061e27b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:59.372226 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c917f88f-509e-406f-bc5e-8ab4c061e27b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:59.373652 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c917f88f-509e-406f-bc5e-8ab4c061e27b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:59.374453 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c917f88f-509e-406f-bc5e-8ab4c061e27b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:59.404059 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c917f88f-509e-406f-bc5e-8ab4c061e27b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043836 Dec 15 12:49:59.405136 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 776/1536] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:49:59 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 12:49:59.578656 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-998aa701-4d18-40a3-b03c-89ccd2fb1c2c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:49:59.579474 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-998aa701-4d18-40a3-b03c-89ccd2fb1c2c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:49:59.586342 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-998aa701-4d18-40a3-b03c-89ccd2fb1c2c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:59.586791 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-998aa701-4d18-40a3-b03c-89ccd2fb1c2c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:59.587596 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-998aa701-4d18-40a3-b03c-89ccd2fb1c2c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:49:59.588030 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-998aa701-4d18-40a3-b03c-89ccd2fb1c2c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:49:59.618410 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-998aa701-4d18-40a3-b03c-89ccd2fb1c2c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043422 Dec 15 12:49:59.619160 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 761/1537] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:49:59 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:49:59.944055 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 12:49:59.944309 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 12:49:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 12:50:00.416821 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-943a2ba1-6068-48a7-85a6-346106f6c4b9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:00.417761 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-943a2ba1-6068-48a7-85a6-346106f6c4b9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:00.423549 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-943a2ba1-6068-48a7-85a6-346106f6c4b9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:00.423997 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-943a2ba1-6068-48a7-85a6-346106f6c4b9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:00.424776 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-943a2ba1-6068-48a7-85a6-346106f6c4b9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:00.425215 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-943a2ba1-6068-48a7-85a6-346106f6c4b9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:00.460122 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-943a2ba1-6068-48a7-85a6-346106f6c4b9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047133 Dec 15 12:50:00.460719 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 777/1538] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:50:00 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:50:00.630245 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1e6f553f-4f1d-40c1-8a79-53cdd957b52c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:00.631507 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1e6f553f-4f1d-40c1-8a79-53cdd957b52c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:00.637734 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1e6f553f-4f1d-40c1-8a79-53cdd957b52c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:00.638185 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1e6f553f-4f1d-40c1-8a79-53cdd957b52c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:00.638958 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1e6f553f-4f1d-40c1-8a79-53cdd957b52c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:00.639385 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1e6f553f-4f1d-40c1-8a79-53cdd957b52c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:00.672059 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1e6f553f-4f1d-40c1-8a79-53cdd957b52c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045569 Dec 15 12:50:00.672623 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 762/1539] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:00 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:01.471006 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b73e3163-abe7-458a-90bb-1edd0bda3ffa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:01.471919 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b73e3163-abe7-458a-90bb-1edd0bda3ffa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:01.478397 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b73e3163-abe7-458a-90bb-1edd0bda3ffa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:01.478845 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b73e3163-abe7-458a-90bb-1edd0bda3ffa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:01.479632 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b73e3163-abe7-458a-90bb-1edd0bda3ffa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:01.480069 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b73e3163-abe7-458a-90bb-1edd0bda3ffa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:01.511268 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b73e3163-abe7-458a-90bb-1edd0bda3ffa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044033 Dec 15 12:50:01.511832 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 778/1540] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:50:01 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:50:01.683742 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b0015487-181f-4b69-93f5-c7712b288d5a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:01.684653 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b0015487-181f-4b69-93f5-c7712b288d5a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:01.691019 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b0015487-181f-4b69-93f5-c7712b288d5a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:01.691466 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b0015487-181f-4b69-93f5-c7712b288d5a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:01.692823 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b0015487-181f-4b69-93f5-c7712b288d5a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:01.693370 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b0015487-181f-4b69-93f5-c7712b288d5a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:01.724042 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b0015487-181f-4b69-93f5-c7712b288d5a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044071 Dec 15 12:50:01.724598 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 763/1541] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:01 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:02.523241 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-460c9969-88dc-4f97-b0ff-d0eee75acc5c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:02.524137 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-460c9969-88dc-4f97-b0ff-d0eee75acc5c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:02.530379 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-460c9969-88dc-4f97-b0ff-d0eee75acc5c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:02.530820 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-460c9969-88dc-4f97-b0ff-d0eee75acc5c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:02.531592 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-460c9969-88dc-4f97-b0ff-d0eee75acc5c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:02.532019 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-460c9969-88dc-4f97-b0ff-d0eee75acc5c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:02.562559 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-460c9969-88dc-4f97-b0ff-d0eee75acc5c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043494 Dec 15 12:50:02.563027 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 779/1542] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:50:02 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:50:02.735479 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0d785f5f-4fce-4d7a-8174-938fd01d3fdf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:02.736386 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0d785f5f-4fce-4d7a-8174-938fd01d3fdf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:02.743588 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0d785f5f-4fce-4d7a-8174-938fd01d3fdf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:02.744056 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0d785f5f-4fce-4d7a-8174-938fd01d3fdf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:02.745545 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0d785f5f-4fce-4d7a-8174-938fd01d3fdf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:02.746193 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0d785f5f-4fce-4d7a-8174-938fd01d3fdf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:02.779661 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0d785f5f-4fce-4d7a-8174-938fd01d3fdf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048221 Dec 15 12:50:02.780212 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 764/1543] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:02 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:03.573974 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-103ad187-b152-43ac-aecc-69ea71d73cda tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:03.574794 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-103ad187-b152-43ac-aecc-69ea71d73cda tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:03.581441 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-103ad187-b152-43ac-aecc-69ea71d73cda tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:03.581919 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-103ad187-b152-43ac-aecc-69ea71d73cda tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:03.582826 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-103ad187-b152-43ac-aecc-69ea71d73cda tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:03.583262 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-103ad187-b152-43ac-aecc-69ea71d73cda tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:03.615024 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-103ad187-b152-43ac-aecc-69ea71d73cda tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044846 Dec 15 12:50:03.615580 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 780/1544] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:50:03 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:50:03.792254 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-540a5b6e-64f9-4843-a0d6-c0311d2909f4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:03.793185 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-540a5b6e-64f9-4843-a0d6-c0311d2909f4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:03.799513 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-540a5b6e-64f9-4843-a0d6-c0311d2909f4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:03.799953 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-540a5b6e-64f9-4843-a0d6-c0311d2909f4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:03.800728 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-540a5b6e-64f9-4843-a0d6-c0311d2909f4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:03.801180 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-540a5b6e-64f9-4843-a0d6-c0311d2909f4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:03.829643 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-540a5b6e-64f9-4843-a0d6-c0311d2909f4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041194 Dec 15 12:50:03.830114 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 765/1545] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:03 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:04.626268 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8208f767-680a-4037-90f8-71ca505d5d8f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:04.630275 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8208f767-680a-4037-90f8-71ca505d5d8f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:04.637068 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8208f767-680a-4037-90f8-71ca505d5d8f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:04.637523 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8208f767-680a-4037-90f8-71ca505d5d8f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:04.638317 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8208f767-680a-4037-90f8-71ca505d5d8f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:04.638743 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8208f767-680a-4037-90f8-71ca505d5d8f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:04.667733 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8208f767-680a-4037-90f8-71ca505d5d8f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045883 Dec 15 12:50:04.668301 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 781/1546] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:50:04 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:50:04.842128 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1ad4c2f2-e6e5-4c65-89d5-ca5429cf288d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:04.842964 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1ad4c2f2-e6e5-4c65-89d5-ca5429cf288d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:04.850267 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1ad4c2f2-e6e5-4c65-89d5-ca5429cf288d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:04.850707 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1ad4c2f2-e6e5-4c65-89d5-ca5429cf288d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:04.851490 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1ad4c2f2-e6e5-4c65-89d5-ca5429cf288d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:04.851921 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1ad4c2f2-e6e5-4c65-89d5-ca5429cf288d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:04.881578 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1ad4c2f2-e6e5-4c65-89d5-ca5429cf288d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043141 Dec 15 12:50:04.882130 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 766/1547] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:04 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:05.679851 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-21f78326-c560-40e3-8e67-d9ef03925c11 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:05.680765 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-21f78326-c560-40e3-8e67-d9ef03925c11 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:05.687034 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-21f78326-c560-40e3-8e67-d9ef03925c11 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:05.687490 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-21f78326-c560-40e3-8e67-d9ef03925c11 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:05.688277 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-21f78326-c560-40e3-8e67-d9ef03925c11 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:05.688714 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-21f78326-c560-40e3-8e67-d9ef03925c11 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:05.717888 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-21f78326-c560-40e3-8e67-d9ef03925c11 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042333 Dec 15 12:50:05.718481 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 782/1548] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:50:05 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:50:05.893259 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7ca1832c-dfcf-4d0e-afd4-3277e131ee60 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:05.894195 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7ca1832c-dfcf-4d0e-afd4-3277e131ee60 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:05.900929 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7ca1832c-dfcf-4d0e-afd4-3277e131ee60 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:05.901376 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7ca1832c-dfcf-4d0e-afd4-3277e131ee60 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:05.902197 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7ca1832c-dfcf-4d0e-afd4-3277e131ee60 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:05.902637 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7ca1832c-dfcf-4d0e-afd4-3277e131ee60 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:05.932575 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7ca1832c-dfcf-4d0e-afd4-3277e131ee60 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043106 Dec 15 12:50:05.933185 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 767/1549] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:05 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:06.729242 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f5b64fd2-6d83-43f7-bf5e-d9447414f1b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:06.730179 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f5b64fd2-6d83-43f7-bf5e-d9447414f1b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:06.736350 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f5b64fd2-6d83-43f7-bf5e-d9447414f1b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:06.736796 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f5b64fd2-6d83-43f7-bf5e-d9447414f1b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:06.737601 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f5b64fd2-6d83-43f7-bf5e-d9447414f1b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:06.738036 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f5b64fd2-6d83-43f7-bf5e-d9447414f1b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:06.770022 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f5b64fd2-6d83-43f7-bf5e-d9447414f1b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044057 Dec 15 12:50:06.770310 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 783/1550] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:50:06 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:50:06.944873 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0a283dbf-7a0d-4750-a56f-e71c2fbb61a8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:06.945841 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0a283dbf-7a0d-4750-a56f-e71c2fbb61a8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:06.952100 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0a283dbf-7a0d-4750-a56f-e71c2fbb61a8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:06.952576 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0a283dbf-7a0d-4750-a56f-e71c2fbb61a8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:06.953363 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0a283dbf-7a0d-4750-a56f-e71c2fbb61a8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:06.953830 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0a283dbf-7a0d-4750-a56f-e71c2fbb61a8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:06.985015 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0a283dbf-7a0d-4750-a56f-e71c2fbb61a8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044533 Dec 15 12:50:06.985560 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 768/1551] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:06 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:07.781303 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6faea0b7-8f5f-4493-af0c-a2fc8cb9c5ac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:07.782257 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6faea0b7-8f5f-4493-af0c-a2fc8cb9c5ac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:07.789071 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6faea0b7-8f5f-4493-af0c-a2fc8cb9c5ac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:07.789536 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6faea0b7-8f5f-4493-af0c-a2fc8cb9c5ac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:07.790308 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6faea0b7-8f5f-4493-af0c-a2fc8cb9c5ac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:07.790737 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6faea0b7-8f5f-4493-af0c-a2fc8cb9c5ac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:07.821181 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6faea0b7-8f5f-4493-af0c-a2fc8cb9c5ac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043531 Dec 15 12:50:07.821679 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 784/1552] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:50:07 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:50:07.996296 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-93aeaf69-30f9-4531-be93-63201cace377 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:07.997201 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-93aeaf69-30f9-4531-be93-63201cace377 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:08.003459 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-93aeaf69-30f9-4531-be93-63201cace377 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:08.003907 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-93aeaf69-30f9-4531-be93-63201cace377 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:08.004770 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-93aeaf69-30f9-4531-be93-63201cace377 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:08.005204 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-93aeaf69-30f9-4531-be93-63201cace377 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:08.036663 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-93aeaf69-30f9-4531-be93-63201cace377 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044085 Dec 15 12:50:08.037248 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 769/1553] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:07 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:08.833070 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-38e935e5-752f-417d-9367-fea49336e0a0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:08.833992 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-38e935e5-752f-417d-9367-fea49336e0a0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:08.840284 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-38e935e5-752f-417d-9367-fea49336e0a0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:08.840737 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-38e935e5-752f-417d-9367-fea49336e0a0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:08.841605 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-38e935e5-752f-417d-9367-fea49336e0a0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:08.842038 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-38e935e5-752f-417d-9367-fea49336e0a0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:08.873012 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-38e935e5-752f-417d-9367-fea49336e0a0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044155 Dec 15 12:50:08.873486 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 785/1554] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:50:08 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:50:09.049970 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-59cee0c2-2c12-4c7d-ad6b-c97f7d54c513 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:09.051602 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-59cee0c2-2c12-4c7d-ad6b-c97f7d54c513 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:09.062740 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-59cee0c2-2c12-4c7d-ad6b-c97f7d54c513 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:09.063272 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-59cee0c2-2c12-4c7d-ad6b-c97f7d54c513 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:09.064128 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-59cee0c2-2c12-4c7d-ad6b-c97f7d54c513 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:09.064615 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-59cee0c2-2c12-4c7d-ad6b-c97f7d54c513 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:09.094952 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-59cee0c2-2c12-4c7d-ad6b-c97f7d54c513 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049510 Dec 15 12:50:09.095512 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 770/1555] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:09 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:09.884729 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fe2e7dc6-c79c-48ce-b844-671335bb27b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:09.885766 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fe2e7dc6-c79c-48ce-b844-671335bb27b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:09.892322 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe2e7dc6-c79c-48ce-b844-671335bb27b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:09.892795 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe2e7dc6-c79c-48ce-b844-671335bb27b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:09.893619 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe2e7dc6-c79c-48ce-b844-671335bb27b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:09.894054 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe2e7dc6-c79c-48ce-b844-671335bb27b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:09.924099 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fe2e7dc6-c79c-48ce-b844-671335bb27b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043675 Dec 15 12:50:09.924662 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 786/1556] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:50:09 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:50:10.109040 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a867c4c7-a023-4dac-a6a6-67fd454ad5a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:10.109978 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a867c4c7-a023-4dac-a6a6-67fd454ad5a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:10.116283 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a867c4c7-a023-4dac-a6a6-67fd454ad5a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:10.116721 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a867c4c7-a023-4dac-a6a6-67fd454ad5a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:10.118494 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a867c4c7-a023-4dac-a6a6-67fd454ad5a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:10.118975 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a867c4c7-a023-4dac-a6a6-67fd454ad5a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:10.150354 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a867c4c7-a023-4dac-a6a6-67fd454ad5a2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047157 Dec 15 12:50:10.150929 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 771/1557] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:10 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:50:10.935968 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-567d9a83-0fac-4355-aaa8-48fb7d9cc0a4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:10.937049 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-567d9a83-0fac-4355-aaa8-48fb7d9cc0a4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:10.943494 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-567d9a83-0fac-4355-aaa8-48fb7d9cc0a4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:10.943945 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-567d9a83-0fac-4355-aaa8-48fb7d9cc0a4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:10.944723 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-567d9a83-0fac-4355-aaa8-48fb7d9cc0a4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:10.945162 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-567d9a83-0fac-4355-aaa8-48fb7d9cc0a4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:10.973854 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-567d9a83-0fac-4355-aaa8-48fb7d9cc0a4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041049 Dec 15 12:50:10.974336 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 787/1558] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:50:10 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:50:11.162871 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-943a9a62-83a5-497b-8f33-1c6e318c1ad1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:11.163806 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-943a9a62-83a5-497b-8f33-1c6e318c1ad1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:11.170226 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-943a9a62-83a5-497b-8f33-1c6e318c1ad1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:11.170671 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-943a9a62-83a5-497b-8f33-1c6e318c1ad1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:11.171449 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-943a9a62-83a5-497b-8f33-1c6e318c1ad1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:11.171909 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-943a9a62-83a5-497b-8f33-1c6e318c1ad1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:11.202805 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-943a9a62-83a5-497b-8f33-1c6e318c1ad1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044468 Dec 15 12:50:11.203381 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 772/1559] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:11 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:11.984204 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e10161b9-626f-4955-ba4a-cb1ab600371c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:11.985120 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e10161b9-626f-4955-ba4a-cb1ab600371c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:11.991987 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e10161b9-626f-4955-ba4a-cb1ab600371c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:11.992437 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e10161b9-626f-4955-ba4a-cb1ab600371c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:11.993218 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e10161b9-626f-4955-ba4a-cb1ab600371c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:11.993694 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e10161b9-626f-4955-ba4a-cb1ab600371c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:12.022852 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e10161b9-626f-4955-ba4a-cb1ab600371c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042354 Dec 15 12:50:12.023416 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 788/1560] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 12:50:11 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 12:50:12.214470 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ad6af7c0-d0d6-4ff3-8016-7a242d38dad3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:12.215382 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ad6af7c0-d0d6-4ff3-8016-7a242d38dad3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:12.221646 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad6af7c0-d0d6-4ff3-8016-7a242d38dad3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:12.222097 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad6af7c0-d0d6-4ff3-8016-7a242d38dad3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:12.223414 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad6af7c0-d0d6-4ff3-8016-7a242d38dad3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:12.223854 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad6af7c0-d0d6-4ff3-8016-7a242d38dad3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:12.258450 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ad6af7c0-d0d6-4ff3-8016-7a242d38dad3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047699 Dec 15 12:50:12.258932 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 773/1561] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:12 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:13.034607 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-280cc976-84ba-44f6-8368-2457b9141063 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:50:13.035725 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-280cc976-84ba-44f6-8368-2457b9141063 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:13.042049 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-280cc976-84ba-44f6-8368-2457b9141063 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:13.042497 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-280cc976-84ba-44f6-8368-2457b9141063 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:13.043273 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-280cc976-84ba-44f6-8368-2457b9141063 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:13.043705 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-280cc976-84ba-44f6-8368-2457b9141063 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:13.125315 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-280cc976-84ba-44f6-8368-2457b9141063 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "POST /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/action" status: 200 len: 40551 microversion: 2.1 time: 0.094095 Dec 15 12:50:13.125945 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 789/1562] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 12:50:13 2021] POST /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3/action => generated 40551 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:13.270323 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-940e3812-06ce-45fd-a977-8abd39c86b31 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:13.271216 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-940e3812-06ce-45fd-a977-8abd39c86b31 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:13.284966 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-940e3812-06ce-45fd-a977-8abd39c86b31 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:13.285965 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-940e3812-06ce-45fd-a977-8abd39c86b31 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:13.286779 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-940e3812-06ce-45fd-a977-8abd39c86b31 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:13.287216 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-940e3812-06ce-45fd-a977-8abd39c86b31 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:13.317343 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-940e3812-06ce-45fd-a977-8abd39c86b31 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050994 Dec 15 12:50:13.317939 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 774/1563] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:13 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:14.329580 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-18aaac7e-ea7c-418d-bf9e-169f5b3baa0e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:14.330602 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-18aaac7e-ea7c-418d-bf9e-169f5b3baa0e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:14.337871 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-18aaac7e-ea7c-418d-bf9e-169f5b3baa0e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:14.338429 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-18aaac7e-ea7c-418d-bf9e-169f5b3baa0e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:14.339104 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-18aaac7e-ea7c-418d-bf9e-169f5b3baa0e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:14.339534 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-18aaac7e-ea7c-418d-bf9e-169f5b3baa0e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:14.370488 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-18aaac7e-ea7c-418d-bf9e-169f5b3baa0e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045119 Dec 15 12:50:14.371057 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 790/1564] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:14 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:15.382840 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7cc87ca7-8078-42b4-bbb8-b669a282c647 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:15.383741 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7cc87ca7-8078-42b4-bbb8-b669a282c647 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:15.390166 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7cc87ca7-8078-42b4-bbb8-b669a282c647 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:15.390609 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7cc87ca7-8078-42b4-bbb8-b669a282c647 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:15.391401 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7cc87ca7-8078-42b4-bbb8-b669a282c647 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:15.391832 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7cc87ca7-8078-42b4-bbb8-b669a282c647 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:15.421145 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7cc87ca7-8078-42b4-bbb8-b669a282c647 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042423 Dec 15 12:50:15.421768 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 775/1565] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:15 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:16.433142 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f4d19e61-01ad-479e-8fbd-f4d18b90bb8e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:16.434110 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f4d19e61-01ad-479e-8fbd-f4d18b90bb8e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:16.440374 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4d19e61-01ad-479e-8fbd-f4d18b90bb8e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:16.440822 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4d19e61-01ad-479e-8fbd-f4d18b90bb8e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:16.441633 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4d19e61-01ad-479e-8fbd-f4d18b90bb8e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:16.442073 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4d19e61-01ad-479e-8fbd-f4d18b90bb8e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:16.617702 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f4d19e61-01ad-479e-8fbd-f4d18b90bb8e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.188233 Dec 15 12:50:16.618198 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 791/1566] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:16 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:17.630095 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-cc085d3a-70a1-4d02-80e6-c08a68b7fc07 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:17.631202 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-cc085d3a-70a1-4d02-80e6-c08a68b7fc07 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:17.638505 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc085d3a-70a1-4d02-80e6-c08a68b7fc07 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:17.638955 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc085d3a-70a1-4d02-80e6-c08a68b7fc07 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:17.639748 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc085d3a-70a1-4d02-80e6-c08a68b7fc07 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:17.640182 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc085d3a-70a1-4d02-80e6-c08a68b7fc07 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:17.671232 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cc085d3a-70a1-4d02-80e6-c08a68b7fc07 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045451 Dec 15 12:50:17.671828 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 776/1567] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:17 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:18.683598 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3e1f55ed-e49e-4b1d-8e11-b384f3ef34ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:18.684515 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3e1f55ed-e49e-4b1d-8e11-b384f3ef34ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:18.691097 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3e1f55ed-e49e-4b1d-8e11-b384f3ef34ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:18.691619 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3e1f55ed-e49e-4b1d-8e11-b384f3ef34ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:18.692417 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3e1f55ed-e49e-4b1d-8e11-b384f3ef34ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:18.692849 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3e1f55ed-e49e-4b1d-8e11-b384f3ef34ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:18.724768 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3e1f55ed-e49e-4b1d-8e11-b384f3ef34ca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044870 Dec 15 12:50:18.725325 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 792/1568] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:18 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:19.736129 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4c5447c1-6016-4eb2-8ca3-697c9c5b66f9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:19.737031 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4c5447c1-6016-4eb2-8ca3-697c9c5b66f9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:19.743738 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4c5447c1-6016-4eb2-8ca3-697c9c5b66f9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:19.744180 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4c5447c1-6016-4eb2-8ca3-697c9c5b66f9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:19.744946 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4c5447c1-6016-4eb2-8ca3-697c9c5b66f9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:19.745376 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4c5447c1-6016-4eb2-8ca3-697c9c5b66f9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:19.777467 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4c5447c1-6016-4eb2-8ca3-697c9c5b66f9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044988 Dec 15 12:50:19.778051 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 777/1569] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:19 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:20.789284 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-65b7692f-ea60-4ce7-8bcc-9d0f09d39796 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:20.790169 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-65b7692f-ea60-4ce7-8bcc-9d0f09d39796 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:20.796464 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-65b7692f-ea60-4ce7-8bcc-9d0f09d39796 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:20.796910 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-65b7692f-ea60-4ce7-8bcc-9d0f09d39796 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:20.797738 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-65b7692f-ea60-4ce7-8bcc-9d0f09d39796 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:20.798176 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-65b7692f-ea60-4ce7-8bcc-9d0f09d39796 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:20.828343 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-65b7692f-ea60-4ce7-8bcc-9d0f09d39796 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042876 Dec 15 12:50:20.828898 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 793/1570] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:20 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:21.840289 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8ef3bbf8-3cb4-411b-b0d1-a7a6355c8790 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:21.841156 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8ef3bbf8-3cb4-411b-b0d1-a7a6355c8790 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:21.848097 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8ef3bbf8-3cb4-411b-b0d1-a7a6355c8790 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:21.849153 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8ef3bbf8-3cb4-411b-b0d1-a7a6355c8790 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:21.850069 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8ef3bbf8-3cb4-411b-b0d1-a7a6355c8790 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:21.850505 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8ef3bbf8-3cb4-411b-b0d1-a7a6355c8790 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:21.879320 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8ef3bbf8-3cb4-411b-b0d1-a7a6355c8790 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042940 Dec 15 12:50:21.880036 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 778/1571] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:21 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:22.890870 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c7176a30-3022-4d16-8668-ed4ce60cec2f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:22.891860 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c7176a30-3022-4d16-8668-ed4ce60cec2f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:22.899194 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c7176a30-3022-4d16-8668-ed4ce60cec2f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:22.899634 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c7176a30-3022-4d16-8668-ed4ce60cec2f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:22.900407 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c7176a30-3022-4d16-8668-ed4ce60cec2f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:22.900833 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c7176a30-3022-4d16-8668-ed4ce60cec2f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:22.929468 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c7176a30-3022-4d16-8668-ed4ce60cec2f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042413 Dec 15 12:50:22.930027 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 794/1572] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:22 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:23.941214 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c2c0ccec-c352-4ffb-af2a-ea9a413f3390 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:23.942083 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c2c0ccec-c352-4ffb-af2a-ea9a413f3390 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:23.949079 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2c0ccec-c352-4ffb-af2a-ea9a413f3390 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:23.949546 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2c0ccec-c352-4ffb-af2a-ea9a413f3390 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:23.950347 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2c0ccec-c352-4ffb-af2a-ea9a413f3390 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:23.950785 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2c0ccec-c352-4ffb-af2a-ea9a413f3390 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:23.979268 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c2c0ccec-c352-4ffb-af2a-ea9a413f3390 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042001 Dec 15 12:50:23.979824 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 779/1573] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:23 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:24.990982 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3acd879b-5b09-4c8c-8b71-5e517dba3ee9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:24.991792 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3acd879b-5b09-4c8c-8b71-5e517dba3ee9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:24.998675 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3acd879b-5b09-4c8c-8b71-5e517dba3ee9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:24.999207 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3acd879b-5b09-4c8c-8b71-5e517dba3ee9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:25.000034 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3acd879b-5b09-4c8c-8b71-5e517dba3ee9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:25.000514 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3acd879b-5b09-4c8c-8b71-5e517dba3ee9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:25.030529 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3acd879b-5b09-4c8c-8b71-5e517dba3ee9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043443 Dec 15 12:50:25.031077 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 795/1574] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:24 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:26.044921 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c88b4969-4b24-4734-96dd-e56d147626ba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:26.045787 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c88b4969-4b24-4734-96dd-e56d147626ba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:26.053212 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c88b4969-4b24-4734-96dd-e56d147626ba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:26.053707 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c88b4969-4b24-4734-96dd-e56d147626ba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:26.054493 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c88b4969-4b24-4734-96dd-e56d147626ba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:26.054930 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c88b4969-4b24-4734-96dd-e56d147626ba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:26.085084 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c88b4969-4b24-4734-96dd-e56d147626ba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046195 Dec 15 12:50:26.085705 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 780/1575] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:26 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:50:27.096371 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-93a8dd80-4947-45be-a77e-49aabba3536f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:27.097188 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-93a8dd80-4947-45be-a77e-49aabba3536f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:27.103629 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-93a8dd80-4947-45be-a77e-49aabba3536f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:27.104080 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-93a8dd80-4947-45be-a77e-49aabba3536f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:27.104871 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-93a8dd80-4947-45be-a77e-49aabba3536f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:27.105308 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-93a8dd80-4947-45be-a77e-49aabba3536f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:27.140703 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-93a8dd80-4947-45be-a77e-49aabba3536f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048103 Dec 15 12:50:27.141274 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 796/1576] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:27 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:28.152898 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d7691321-a494-4064-a951-358e542c6469 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:28.153847 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d7691321-a494-4064-a951-358e542c6469 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:28.159857 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d7691321-a494-4064-a951-358e542c6469 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:28.160306 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d7691321-a494-4064-a951-358e542c6469 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:28.161091 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d7691321-a494-4064-a951-358e542c6469 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:28.161722 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d7691321-a494-4064-a951-358e542c6469 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:28.192411 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d7691321-a494-4064-a951-358e542c6469 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043302 Dec 15 12:50:28.193496 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 781/1577] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:28 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:29.204751 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6c6fd594-87cf-4b64-9ba4-a4afe88e6f65 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:29.205580 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6c6fd594-87cf-4b64-9ba4-a4afe88e6f65 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:29.211902 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c6fd594-87cf-4b64-9ba4-a4afe88e6f65 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:29.212348 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c6fd594-87cf-4b64-9ba4-a4afe88e6f65 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:29.213124 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c6fd594-87cf-4b64-9ba4-a4afe88e6f65 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:29.213611 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c6fd594-87cf-4b64-9ba4-a4afe88e6f65 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:29.252650 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6c6fd594-87cf-4b64-9ba4-a4afe88e6f65 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051717 Dec 15 12:50:29.253190 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 797/1578] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:29 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:30.265608 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-00d3a063-0643-4657-a495-28edb530d458 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:30.266496 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-00d3a063-0643-4657-a495-28edb530d458 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:30.273863 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-00d3a063-0643-4657-a495-28edb530d458 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:30.274317 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-00d3a063-0643-4657-a495-28edb530d458 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:30.275115 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-00d3a063-0643-4657-a495-28edb530d458 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:30.275555 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-00d3a063-0643-4657-a495-28edb530d458 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:30.306128 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-00d3a063-0643-4657-a495-28edb530d458 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044598 Dec 15 12:50:30.306696 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 782/1579] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:30 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:30.885124 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9a0bf1d6-7b81-47ff-b573-71cd2357b9da tempest-TestShelveInstance-1594053736 tempest-TestShelveInstance-1594053736-project] Calling method '.version_select at 0x7f3c6892ea60>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:30.915927 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9a0bf1d6-7b81-47ff-b573-71cd2357b9da tempest-TestShelveInstance-1594053736 tempest-TestShelveInstance-1594053736-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1619478811" status: 202 len: 0 microversion: 2.1 time: 0.029310 Dec 15 12:50:30.915927 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 798/1580] 10.222.0.76 () {58 vars in 1253 bytes} [Wed Dec 15 12:50:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1619478811 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 12:50:31.318087 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6d9fd83a-64a7-4e07-b531-00594141e8f6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:31.319138 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6d9fd83a-64a7-4e07-b531-00594141e8f6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:31.325994 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d9fd83a-64a7-4e07-b531-00594141e8f6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:31.326530 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d9fd83a-64a7-4e07-b531-00594141e8f6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:31.327397 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d9fd83a-64a7-4e07-b531-00594141e8f6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:31.327904 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d9fd83a-64a7-4e07-b531-00594141e8f6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:31.362252 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6d9fd83a-64a7-4e07-b531-00594141e8f6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047851 Dec 15 12:50:31.362856 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 783/1581] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:31 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:32.374760 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-453b94be-391b-4ccf-a7d9-d307e85f07fb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:32.375659 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-453b94be-391b-4ccf-a7d9-d307e85f07fb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:32.383878 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-453b94be-391b-4ccf-a7d9-d307e85f07fb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:32.383878 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-453b94be-391b-4ccf-a7d9-d307e85f07fb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:32.384787 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-453b94be-391b-4ccf-a7d9-d307e85f07fb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:32.386758 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-453b94be-391b-4ccf-a7d9-d307e85f07fb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:32.419609 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-453b94be-391b-4ccf-a7d9-d307e85f07fb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049040 Dec 15 12:50:32.421459 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 799/1582] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:32 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:50:33.433072 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-afa7d124-8707-4102-b165-fb32bc101258 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:33.434007 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-afa7d124-8707-4102-b165-fb32bc101258 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:33.446726 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afa7d124-8707-4102-b165-fb32bc101258 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:33.447568 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afa7d124-8707-4102-b165-fb32bc101258 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:33.448141 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afa7d124-8707-4102-b165-fb32bc101258 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:33.448578 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afa7d124-8707-4102-b165-fb32bc101258 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:33.490439 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-afa7d124-8707-4102-b165-fb32bc101258 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061370 Dec 15 12:50:33.491407 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 784/1583] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:33 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:34.503586 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b543fdcd-a282-4145-8688-452364ee065f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:34.504568 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b543fdcd-a282-4145-8688-452364ee065f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:34.511920 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b543fdcd-a282-4145-8688-452364ee065f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:34.512684 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b543fdcd-a282-4145-8688-452364ee065f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:34.513653 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b543fdcd-a282-4145-8688-452364ee065f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:34.514173 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b543fdcd-a282-4145-8688-452364ee065f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:34.553020 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b543fdcd-a282-4145-8688-452364ee065f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053398 Dec 15 12:50:34.554085 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 800/1584] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:34 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:35.564171 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-23a52d87-4afb-4d8a-ab83-66f3267de3e0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:35.565128 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-23a52d87-4afb-4d8a-ab83-66f3267de3e0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:35.571530 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-23a52d87-4afb-4d8a-ab83-66f3267de3e0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:35.572098 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-23a52d87-4afb-4d8a-ab83-66f3267de3e0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:35.572967 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-23a52d87-4afb-4d8a-ab83-66f3267de3e0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:35.573604 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-23a52d87-4afb-4d8a-ab83-66f3267de3e0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:35.604360 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-23a52d87-4afb-4d8a-ab83-66f3267de3e0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043926 Dec 15 12:50:35.605200 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 785/1585] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:35 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:36.617091 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f015c785-ac50-4bcd-8102-1142af705fb0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:36.618020 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f015c785-ac50-4bcd-8102-1142af705fb0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:36.624731 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f015c785-ac50-4bcd-8102-1142af705fb0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:36.625175 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f015c785-ac50-4bcd-8102-1142af705fb0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:36.626003 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f015c785-ac50-4bcd-8102-1142af705fb0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:36.626438 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f015c785-ac50-4bcd-8102-1142af705fb0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:36.659119 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f015c785-ac50-4bcd-8102-1142af705fb0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046426 Dec 15 12:50:36.659696 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 801/1586] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:36 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:50:37.671749 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a44b6a89-9b50-48c3-8287-550444be7423 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:37.672816 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a44b6a89-9b50-48c3-8287-550444be7423 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:37.682749 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a44b6a89-9b50-48c3-8287-550444be7423 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:37.683341 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a44b6a89-9b50-48c3-8287-550444be7423 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:37.684230 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a44b6a89-9b50-48c3-8287-550444be7423 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:37.684898 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a44b6a89-9b50-48c3-8287-550444be7423 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:37.724939 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a44b6a89-9b50-48c3-8287-550444be7423 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056653 Dec 15 12:50:37.725770 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 786/1587] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:37 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:38.736688 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fa9e96fe-97d2-4a2d-bcd1-aa34e05ae5fa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:38.737636 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fa9e96fe-97d2-4a2d-bcd1-aa34e05ae5fa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:38.744763 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fa9e96fe-97d2-4a2d-bcd1-aa34e05ae5fa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:38.745211 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fa9e96fe-97d2-4a2d-bcd1-aa34e05ae5fa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:38.746042 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fa9e96fe-97d2-4a2d-bcd1-aa34e05ae5fa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:38.746474 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fa9e96fe-97d2-4a2d-bcd1-aa34e05ae5fa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:38.777047 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fa9e96fe-97d2-4a2d-bcd1-aa34e05ae5fa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044113 Dec 15 12:50:38.777773 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 802/1588] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:38 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:39.788283 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-08704317-09ae-4219-8766-2ce7f8e33e08 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:39.790070 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-08704317-09ae-4219-8766-2ce7f8e33e08 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:39.796711 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-08704317-09ae-4219-8766-2ce7f8e33e08 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:39.797154 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-08704317-09ae-4219-8766-2ce7f8e33e08 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:39.798217 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-08704317-09ae-4219-8766-2ce7f8e33e08 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:39.798652 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-08704317-09ae-4219-8766-2ce7f8e33e08 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:39.832051 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-08704317-09ae-4219-8766-2ce7f8e33e08 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047644 Dec 15 12:50:39.832625 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 787/1589] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:39 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:40.843519 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-83a9ab99-b218-498a-91f8-99cffa93741e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:40.844648 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-83a9ab99-b218-498a-91f8-99cffa93741e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:40.852718 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-83a9ab99-b218-498a-91f8-99cffa93741e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:40.853170 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-83a9ab99-b218-498a-91f8-99cffa93741e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:40.853981 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-83a9ab99-b218-498a-91f8-99cffa93741e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:40.854603 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-83a9ab99-b218-498a-91f8-99cffa93741e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:40.887365 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-83a9ab99-b218-498a-91f8-99cffa93741e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047641 Dec 15 12:50:40.888158 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 803/1590] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:40 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:41.901979 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-50cf66bb-595e-4d78-857c-9bee0ea8c698 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:41.904086 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-50cf66bb-595e-4d78-857c-9bee0ea8c698 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:41.912327 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-50cf66bb-595e-4d78-857c-9bee0ea8c698 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:41.912924 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-50cf66bb-595e-4d78-857c-9bee0ea8c698 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:41.913843 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-50cf66bb-595e-4d78-857c-9bee0ea8c698 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:41.914589 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-50cf66bb-595e-4d78-857c-9bee0ea8c698 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:41.948479 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-50cf66bb-595e-4d78-857c-9bee0ea8c698 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051475 Dec 15 12:50:41.949371 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 788/1591] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:41 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:42.964061 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-cf272a2f-8e00-465c-b738-11086a7dcac5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:42.966363 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-cf272a2f-8e00-465c-b738-11086a7dcac5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:42.981646 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cf272a2f-8e00-465c-b738-11086a7dcac5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:42.982098 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cf272a2f-8e00-465c-b738-11086a7dcac5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:42.982897 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cf272a2f-8e00-465c-b738-11086a7dcac5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:42.983338 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cf272a2f-8e00-465c-b738-11086a7dcac5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:43.017109 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-cf272a2f-8e00-465c-b738-11086a7dcac5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060480 Dec 15 12:50:43.018163 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 804/1592] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:42 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:44.029237 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9dd016ea-633f-4ea7-b336-968620fbfe94 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:44.030436 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9dd016ea-633f-4ea7-b336-968620fbfe94 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:44.037650 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9dd016ea-633f-4ea7-b336-968620fbfe94 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:44.038235 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9dd016ea-633f-4ea7-b336-968620fbfe94 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:44.039130 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9dd016ea-633f-4ea7-b336-968620fbfe94 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:44.039664 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9dd016ea-633f-4ea7-b336-968620fbfe94 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:44.074065 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9dd016ea-633f-4ea7-b336-968620fbfe94 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048529 Dec 15 12:50:44.075732 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 789/1593] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:44 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:45.087265 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b4be51e9-1bf8-482b-a8a6-bec2a9bfc723 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:45.088221 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b4be51e9-1bf8-482b-a8a6-bec2a9bfc723 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:45.095269 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b4be51e9-1bf8-482b-a8a6-bec2a9bfc723 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:45.095718 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b4be51e9-1bf8-482b-a8a6-bec2a9bfc723 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:45.096508 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b4be51e9-1bf8-482b-a8a6-bec2a9bfc723 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:45.096943 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b4be51e9-1bf8-482b-a8a6-bec2a9bfc723 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:45.133979 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b4be51e9-1bf8-482b-a8a6-bec2a9bfc723 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051653 Dec 15 12:50:45.134542 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 805/1594] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:45 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:46.146347 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-028d3488-fc7a-4da7-8820-e89a9ca0809b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:46.147510 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-028d3488-fc7a-4da7-8820-e89a9ca0809b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:46.154895 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-028d3488-fc7a-4da7-8820-e89a9ca0809b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:46.155568 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-028d3488-fc7a-4da7-8820-e89a9ca0809b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:46.156720 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-028d3488-fc7a-4da7-8820-e89a9ca0809b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:46.157282 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-028d3488-fc7a-4da7-8820-e89a9ca0809b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:46.191116 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-028d3488-fc7a-4da7-8820-e89a9ca0809b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049674 Dec 15 12:50:46.191866 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 790/1595] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:46 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:47.206072 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fe8816da-5d88-4922-a50e-6f6d56412062 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:47.207687 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fe8816da-5d88-4922-a50e-6f6d56412062 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:47.217210 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe8816da-5d88-4922-a50e-6f6d56412062 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:47.218053 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe8816da-5d88-4922-a50e-6f6d56412062 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:47.219643 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe8816da-5d88-4922-a50e-6f6d56412062 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:47.220245 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe8816da-5d88-4922-a50e-6f6d56412062 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:47.269006 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fe8816da-5d88-4922-a50e-6f6d56412062 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069288 Dec 15 12:50:47.273181 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 806/1596] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:47 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:48.280359 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8cf1701a-4d33-4f42-9895-a3d624244964 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:48.281281 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8cf1701a-4d33-4f42-9895-a3d624244964 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:48.289886 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8cf1701a-4d33-4f42-9895-a3d624244964 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:48.290338 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8cf1701a-4d33-4f42-9895-a3d624244964 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:48.300978 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8cf1701a-4d33-4f42-9895-a3d624244964 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:48.301329 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8cf1701a-4d33-4f42-9895-a3d624244964 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:48.367028 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8cf1701a-4d33-4f42-9895-a3d624244964 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090023 Dec 15 12:50:48.373668 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 791/1597] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:48 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:49.380727 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f770e638-a52b-494e-8ef7-721685247c5a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:49.381986 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f770e638-a52b-494e-8ef7-721685247c5a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:49.402892 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f770e638-a52b-494e-8ef7-721685247c5a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:49.403462 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f770e638-a52b-494e-8ef7-721685247c5a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:49.404348 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f770e638-a52b-494e-8ef7-721685247c5a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:49.410365 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f770e638-a52b-494e-8ef7-721685247c5a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:49.483840 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f770e638-a52b-494e-8ef7-721685247c5a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.106224 Dec 15 12:50:49.487606 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 807/1598] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:49 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:50.499945 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5a4796cb-7937-45d6-8c9e-c39171452294 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:50.502027 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5a4796cb-7937-45d6-8c9e-c39171452294 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:50.520465 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5a4796cb-7937-45d6-8c9e-c39171452294 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:50.520922 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5a4796cb-7937-45d6-8c9e-c39171452294 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:50.524767 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5a4796cb-7937-45d6-8c9e-c39171452294 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:50.525214 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5a4796cb-7937-45d6-8c9e-c39171452294 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:50.563632 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5a4796cb-7937-45d6-8c9e-c39171452294 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069984 Dec 15 12:50:50.568180 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 792/1599] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:50 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:50:50.742969 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-910ca172-4f20-4355-b096-ca0452ec2689 tempest-TestVolumeBootPattern-275054490 tempest-TestVolumeBootPattern-275054490-project] Action: 'create', calling method: .version_select at 0x7f3c6895b790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-639945576"}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:50:50.759970 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-910ca172-4f20-4355-b096-ca0452ec2689 tempest-TestVolumeBootPattern-275054490 tempest-TestVolumeBootPattern-275054490-project] Getting quotas for project e51328f749694b78b8b80e88ff66f119. Resources: {'key_pairs'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 12:50:50.764710 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-910ca172-4f20-4355-b096-ca0452ec2689 tempest-TestVolumeBootPattern-275054490 tempest-TestVolumeBootPattern-275054490-project] Getting quotas for user 47f574ae9f90406fa91171f133364a99 and project e51328f749694b78b8b80e88ff66f119. Resources: {'key_pairs'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 12:50:51.075694 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-910ca172-4f20-4355-b096-ca0452ec2689 tempest-TestVolumeBootPattern-275054490 tempest-TestVolumeBootPattern-275054490-project] Getting quotas for project e51328f749694b78b8b80e88ff66f119. Resources: {'key_pairs'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 12:50:51.079234 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-910ca172-4f20-4355-b096-ca0452ec2689 tempest-TestVolumeBootPattern-275054490 tempest-TestVolumeBootPattern-275054490-project] Getting quotas for user 47f574ae9f90406fa91171f133364a99 and project e51328f749694b78b8b80e88ff66f119. Resources: {'key_pairs'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 12:50:51.092272 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-910ca172-4f20-4355-b096-ca0452ec2689 tempest-TestVolumeBootPattern-275054490 tempest-TestVolumeBootPattern-275054490-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.567276 Dec 15 12:50:51.092861 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 808/1600] 10.222.0.76 () {60 vars in 1157 bytes} [Wed Dec 15 12:50:50 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:50:51.575473 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8473ed49-75c6-4aa9-b756-567a292b86fd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:51.576384 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8473ed49-75c6-4aa9-b756-567a292b86fd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:51.583415 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8473ed49-75c6-4aa9-b756-567a292b86fd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:51.583960 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8473ed49-75c6-4aa9-b756-567a292b86fd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:51.586502 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8473ed49-75c6-4aa9-b756-567a292b86fd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:51.586960 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8473ed49-75c6-4aa9-b756-567a292b86fd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:51.620478 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8473ed49-75c6-4aa9-b756-567a292b86fd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048784 Dec 15 12:50:51.621257 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 793/1601] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:51 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:52.634143 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-cbe78643-ce1e-4a3c-b5d0-692da372d021 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:52.636097 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-cbe78643-ce1e-4a3c-b5d0-692da372d021 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:52.642730 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cbe78643-ce1e-4a3c-b5d0-692da372d021 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:52.643308 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cbe78643-ce1e-4a3c-b5d0-692da372d021 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:52.644274 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cbe78643-ce1e-4a3c-b5d0-692da372d021 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:52.644666 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cbe78643-ce1e-4a3c-b5d0-692da372d021 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:52.678511 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-cbe78643-ce1e-4a3c-b5d0-692da372d021 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049860 Dec 15 12:50:52.682972 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 809/1602] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:52 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:53.690078 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f8fe6d66-cdb3-414a-92fa-f4086109726c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:53.691101 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f8fe6d66-cdb3-414a-92fa-f4086109726c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:53.698412 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f8fe6d66-cdb3-414a-92fa-f4086109726c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:53.698947 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f8fe6d66-cdb3-414a-92fa-f4086109726c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:53.699891 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f8fe6d66-cdb3-414a-92fa-f4086109726c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:53.700403 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f8fe6d66-cdb3-414a-92fa-f4086109726c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:53.736476 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f8fe6d66-cdb3-414a-92fa-f4086109726c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050400 Dec 15 12:50:53.737060 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 794/1603] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:53 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:54.748044 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-42f14aee-5783-4d95-8541-cecea38608c4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:54.748966 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-42f14aee-5783-4d95-8541-cecea38608c4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:54.755735 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-42f14aee-5783-4d95-8541-cecea38608c4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:54.756307 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-42f14aee-5783-4d95-8541-cecea38608c4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:54.757453 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-42f14aee-5783-4d95-8541-cecea38608c4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:54.757919 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-42f14aee-5783-4d95-8541-cecea38608c4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:54.790414 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-42f14aee-5783-4d95-8541-cecea38608c4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045994 Dec 15 12:50:54.791094 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 810/1604] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:54 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:55.802536 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0464a020-a4da-49d3-9d81-1c527271f87c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:55.803630 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0464a020-a4da-49d3-9d81-1c527271f87c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:55.810252 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0464a020-a4da-49d3-9d81-1c527271f87c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:55.810698 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0464a020-a4da-49d3-9d81-1c527271f87c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:55.811488 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0464a020-a4da-49d3-9d81-1c527271f87c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:55.811921 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0464a020-a4da-49d3-9d81-1c527271f87c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:55.842865 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0464a020-a4da-49d3-9d81-1c527271f87c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044412 Dec 15 12:50:55.843444 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 795/1605] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:55 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:56.860160 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b7f30ed9-8522-480c-a8c9-83a170802ebf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:56.860977 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b7f30ed9-8522-480c-a8c9-83a170802ebf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:56.867266 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b7f30ed9-8522-480c-a8c9-83a170802ebf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:56.867720 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b7f30ed9-8522-480c-a8c9-83a170802ebf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:56.868503 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b7f30ed9-8522-480c-a8c9-83a170802ebf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:56.868932 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b7f30ed9-8522-480c-a8c9-83a170802ebf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:56.901904 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b7f30ed9-8522-480c-a8c9-83a170802ebf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045482 Dec 15 12:50:56.902479 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 811/1606] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:56 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:57.913613 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-60901165-30ea-41c1-a6df-1a3bfcfdd639 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:57.914515 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-60901165-30ea-41c1-a6df-1a3bfcfdd639 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:57.920742 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-60901165-30ea-41c1-a6df-1a3bfcfdd639 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:57.921189 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-60901165-30ea-41c1-a6df-1a3bfcfdd639 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:57.922016 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-60901165-30ea-41c1-a6df-1a3bfcfdd639 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:57.922449 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-60901165-30ea-41c1-a6df-1a3bfcfdd639 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:57.954049 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-60901165-30ea-41c1-a6df-1a3bfcfdd639 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044338 Dec 15 12:50:57.954617 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 796/1607] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:57 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:50:58.965432 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-72503b3d-614a-4dd2-9c4b-498aeba5989c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:50:58.966355 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-72503b3d-614a-4dd2-9c4b-498aeba5989c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:50:58.972609 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-72503b3d-614a-4dd2-9c4b-498aeba5989c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:58.973117 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-72503b3d-614a-4dd2-9c4b-498aeba5989c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:58.974119 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-72503b3d-614a-4dd2-9c4b-498aeba5989c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:50:58.974554 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-72503b3d-614a-4dd2-9c4b-498aeba5989c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:50:59.007357 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-72503b3d-614a-4dd2-9c4b-498aeba5989c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045697 Dec 15 12:50:59.007916 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 812/1608] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:50:58 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:00.019164 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-33883220-cbd6-44b7-b12a-e9fa5ca5dc68 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:00.020047 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-33883220-cbd6-44b7-b12a-e9fa5ca5dc68 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:00.028287 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-33883220-cbd6-44b7-b12a-e9fa5ca5dc68 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:00.028845 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-33883220-cbd6-44b7-b12a-e9fa5ca5dc68 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:00.029807 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-33883220-cbd6-44b7-b12a-e9fa5ca5dc68 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:00.030368 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-33883220-cbd6-44b7-b12a-e9fa5ca5dc68 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:00.060315 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-33883220-cbd6-44b7-b12a-e9fa5ca5dc68 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045111 Dec 15 12:51:00.060875 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 797/1609] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:00 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:51:01.072392 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8b8886a0-0c2b-4405-a3b1-a9190672ae77 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:01.073320 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8b8886a0-0c2b-4405-a3b1-a9190672ae77 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:01.079209 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8b8886a0-0c2b-4405-a3b1-a9190672ae77 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:01.079654 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8b8886a0-0c2b-4405-a3b1-a9190672ae77 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:01.080432 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8b8886a0-0c2b-4405-a3b1-a9190672ae77 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:01.080869 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8b8886a0-0c2b-4405-a3b1-a9190672ae77 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:01.110532 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8b8886a0-0c2b-4405-a3b1-a9190672ae77 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041818 Dec 15 12:51:01.111118 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 813/1610] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:01 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:02.123173 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ab2882f3-7e2f-4a65-a163-fa72e7e2f32e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:02.124412 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ab2882f3-7e2f-4a65-a163-fa72e7e2f32e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:02.133530 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ab2882f3-7e2f-4a65-a163-fa72e7e2f32e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:02.134027 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ab2882f3-7e2f-4a65-a163-fa72e7e2f32e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:02.134864 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ab2882f3-7e2f-4a65-a163-fa72e7e2f32e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:02.135304 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ab2882f3-7e2f-4a65-a163-fa72e7e2f32e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:02.166571 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ab2882f3-7e2f-4a65-a163-fa72e7e2f32e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047689 Dec 15 12:51:02.167154 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 798/1611] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:02 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:03.178131 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e989dc79-d55e-45ed-b6d8-d22b1c88b0a1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:03.179040 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e989dc79-d55e-45ed-b6d8-d22b1c88b0a1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:03.185335 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e989dc79-d55e-45ed-b6d8-d22b1c88b0a1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:03.185799 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e989dc79-d55e-45ed-b6d8-d22b1c88b0a1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:03.186677 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e989dc79-d55e-45ed-b6d8-d22b1c88b0a1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:03.187117 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e989dc79-d55e-45ed-b6d8-d22b1c88b0a1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:03.219623 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e989dc79-d55e-45ed-b6d8-d22b1c88b0a1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045215 Dec 15 12:51:03.220191 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 814/1612] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:03 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:04.231445 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a03a9177-30a1-471c-80a6-7f5776e764b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:04.232192 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a03a9177-30a1-471c-80a6-7f5776e764b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:04.238458 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a03a9177-30a1-471c-80a6-7f5776e764b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:04.238907 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a03a9177-30a1-471c-80a6-7f5776e764b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:04.240266 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a03a9177-30a1-471c-80a6-7f5776e764b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:04.240705 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a03a9177-30a1-471c-80a6-7f5776e764b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:04.272819 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a03a9177-30a1-471c-80a6-7f5776e764b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045325 Dec 15 12:51:04.273391 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 799/1613] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:04 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:05.284683 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bee05528-3606-4b9d-8dca-23b217889998 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:05.285609 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bee05528-3606-4b9d-8dca-23b217889998 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:05.293154 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bee05528-3606-4b9d-8dca-23b217889998 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:05.293671 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bee05528-3606-4b9d-8dca-23b217889998 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:05.294515 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bee05528-3606-4b9d-8dca-23b217889998 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:05.294962 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bee05528-3606-4b9d-8dca-23b217889998 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:05.327239 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bee05528-3606-4b9d-8dca-23b217889998 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046743 Dec 15 12:51:05.327798 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 815/1614] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:05 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:06.339741 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-dc63a48a-0f5c-4638-aa1e-0001301768d9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:06.340733 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-dc63a48a-0f5c-4638-aa1e-0001301768d9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:06.348149 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dc63a48a-0f5c-4638-aa1e-0001301768d9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:06.348628 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dc63a48a-0f5c-4638-aa1e-0001301768d9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:06.349716 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dc63a48a-0f5c-4638-aa1e-0001301768d9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:06.350157 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dc63a48a-0f5c-4638-aa1e-0001301768d9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:06.378613 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-dc63a48a-0f5c-4638-aa1e-0001301768d9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042823 Dec 15 12:51:06.379163 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 800/1615] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:06 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:07.391079 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-17b62142-55dc-42a2-85b2-8c46270bf7d9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:07.391981 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-17b62142-55dc-42a2-85b2-8c46270bf7d9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:07.398785 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-17b62142-55dc-42a2-85b2-8c46270bf7d9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:07.399233 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-17b62142-55dc-42a2-85b2-8c46270bf7d9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:07.400015 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-17b62142-55dc-42a2-85b2-8c46270bf7d9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:07.400451 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-17b62142-55dc-42a2-85b2-8c46270bf7d9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:07.430108 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-17b62142-55dc-42a2-85b2-8c46270bf7d9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042665 Dec 15 12:51:07.430703 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 816/1616] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:07 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:08.442032 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0538020a-16ce-429c-8f28-679a2601b760 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:08.443171 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0538020a-16ce-429c-8f28-679a2601b760 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:08.449497 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0538020a-16ce-429c-8f28-679a2601b760 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:08.449970 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0538020a-16ce-429c-8f28-679a2601b760 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:08.450766 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0538020a-16ce-429c-8f28-679a2601b760 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:08.451193 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0538020a-16ce-429c-8f28-679a2601b760 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:08.482358 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0538020a-16ce-429c-8f28-679a2601b760 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044068 Dec 15 12:51:08.482955 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 801/1617] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:08 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:08.718938 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 12:51:08.719209 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 12:51:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 12:51:09.494693 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2cd70640-82ae-4f64-84fb-2e6638b692f1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:09.495594 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2cd70640-82ae-4f64-84fb-2e6638b692f1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:09.501794 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2cd70640-82ae-4f64-84fb-2e6638b692f1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:09.502244 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2cd70640-82ae-4f64-84fb-2e6638b692f1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:09.503028 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2cd70640-82ae-4f64-84fb-2e6638b692f1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:09.503486 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2cd70640-82ae-4f64-84fb-2e6638b692f1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:09.533248 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2cd70640-82ae-4f64-84fb-2e6638b692f1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042284 Dec 15 12:51:09.533830 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 817/1618] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:09 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:10.545137 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-255bd34a-60fc-46b3-8d26-8f20c5508341 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:10.546158 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-255bd34a-60fc-46b3-8d26-8f20c5508341 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:10.559369 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-255bd34a-60fc-46b3-8d26-8f20c5508341 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:10.559716 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-255bd34a-60fc-46b3-8d26-8f20c5508341 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:10.560509 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-255bd34a-60fc-46b3-8d26-8f20c5508341 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:10.560943 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-255bd34a-60fc-46b3-8d26-8f20c5508341 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:10.591604 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-255bd34a-60fc-46b3-8d26-8f20c5508341 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050096 Dec 15 12:51:10.592243 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 802/1619] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:10 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:11.603966 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f4e1da99-d4b2-4233-b5fb-931de1823a8b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:11.604882 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f4e1da99-d4b2-4233-b5fb-931de1823a8b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:11.611112 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4e1da99-d4b2-4233-b5fb-931de1823a8b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:11.611558 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4e1da99-d4b2-4233-b5fb-931de1823a8b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:11.612337 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4e1da99-d4b2-4233-b5fb-931de1823a8b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:11.612771 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4e1da99-d4b2-4233-b5fb-931de1823a8b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:11.641727 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f4e1da99-d4b2-4233-b5fb-931de1823a8b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041505 Dec 15 12:51:11.642284 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 818/1620] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:11 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:12.654027 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fbdadea1-7868-4783-a704-38241c020f4a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:12.654922 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fbdadea1-7868-4783-a704-38241c020f4a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:12.661912 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fbdadea1-7868-4783-a704-38241c020f4a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:12.662416 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fbdadea1-7868-4783-a704-38241c020f4a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:12.663200 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fbdadea1-7868-4783-a704-38241c020f4a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:12.663626 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fbdadea1-7868-4783-a704-38241c020f4a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:12.693479 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fbdadea1-7868-4783-a704-38241c020f4a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043142 Dec 15 12:51:12.694120 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 803/1621] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:12 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:13.707439 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d182169a-cf85-49f6-a4bd-bb0195eb3d4b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:13.709074 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d182169a-cf85-49f6-a4bd-bb0195eb3d4b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:13.715480 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d182169a-cf85-49f6-a4bd-bb0195eb3d4b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:13.715923 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d182169a-cf85-49f6-a4bd-bb0195eb3d4b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:13.716709 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d182169a-cf85-49f6-a4bd-bb0195eb3d4b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:13.717144 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d182169a-cf85-49f6-a4bd-bb0195eb3d4b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:13.746736 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d182169a-cf85-49f6-a4bd-bb0195eb3d4b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042959 Dec 15 12:51:13.747323 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 819/1622] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:13 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:51:14.758859 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d6ef04de-e22e-49f9-9a00-cd8323c3ea69 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:14.759756 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d6ef04de-e22e-49f9-9a00-cd8323c3ea69 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:14.765983 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d6ef04de-e22e-49f9-9a00-cd8323c3ea69 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:14.766418 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d6ef04de-e22e-49f9-9a00-cd8323c3ea69 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:14.767191 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d6ef04de-e22e-49f9-9a00-cd8323c3ea69 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:14.767619 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d6ef04de-e22e-49f9-9a00-cd8323c3ea69 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:14.799406 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d6ef04de-e22e-49f9-9a00-cd8323c3ea69 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044816 Dec 15 12:51:14.799954 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 804/1623] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:14 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:15.812561 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-701bb697-3344-4be5-a168-5a43b4345dca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:15.813606 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-701bb697-3344-4be5-a168-5a43b4345dca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:15.820818 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-701bb697-3344-4be5-a168-5a43b4345dca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:15.821273 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-701bb697-3344-4be5-a168-5a43b4345dca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:15.822148 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-701bb697-3344-4be5-a168-5a43b4345dca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:15.822576 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-701bb697-3344-4be5-a168-5a43b4345dca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:15.852942 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-701bb697-3344-4be5-a168-5a43b4345dca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044674 Dec 15 12:51:15.853544 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 820/1624] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:15 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:51:16.863663 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-91890377-1716-402e-b4cd-1c833d48ba3b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:16.864666 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-91890377-1716-402e-b4cd-1c833d48ba3b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:16.870959 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-91890377-1716-402e-b4cd-1c833d48ba3b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:16.871390 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-91890377-1716-402e-b4cd-1c833d48ba3b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:16.872178 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-91890377-1716-402e-b4cd-1c833d48ba3b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:16.872642 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-91890377-1716-402e-b4cd-1c833d48ba3b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:16.904706 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-91890377-1716-402e-b4cd-1c833d48ba3b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044762 Dec 15 12:51:16.905260 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 805/1625] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:16 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:17.916688 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-73dba3b0-6d7f-4f27-9095-82cdc0be8566 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:17.917681 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-73dba3b0-6d7f-4f27-9095-82cdc0be8566 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:17.924061 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-73dba3b0-6d7f-4f27-9095-82cdc0be8566 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:17.924506 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-73dba3b0-6d7f-4f27-9095-82cdc0be8566 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:17.925291 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-73dba3b0-6d7f-4f27-9095-82cdc0be8566 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:17.925758 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-73dba3b0-6d7f-4f27-9095-82cdc0be8566 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:17.957461 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-73dba3b0-6d7f-4f27-9095-82cdc0be8566 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044533 Dec 15 12:51:17.958629 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 821/1626] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:17 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:18.421305 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 12:51:18.421558 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 12:51:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 12:51:18.969811 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8b772eee-07d4-44d5-a4c0-659bdf7969fd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:18.970716 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8b772eee-07d4-44d5-a4c0-659bdf7969fd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:18.977035 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8b772eee-07d4-44d5-a4c0-659bdf7969fd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:18.977480 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8b772eee-07d4-44d5-a4c0-659bdf7969fd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:18.978316 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8b772eee-07d4-44d5-a4c0-659bdf7969fd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:18.978758 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8b772eee-07d4-44d5-a4c0-659bdf7969fd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:19.015833 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8b772eee-07d4-44d5-a4c0-659bdf7969fd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049822 Dec 15 12:51:19.016423 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 806/1627] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:18 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:20.028213 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1843a69e-b70f-47dc-be87-3ff7a846bcc9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:20.029161 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1843a69e-b70f-47dc-be87-3ff7a846bcc9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:20.035727 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1843a69e-b70f-47dc-be87-3ff7a846bcc9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:20.036741 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1843a69e-b70f-47dc-be87-3ff7a846bcc9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:20.037684 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1843a69e-b70f-47dc-be87-3ff7a846bcc9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:20.038129 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1843a69e-b70f-47dc-be87-3ff7a846bcc9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:20.070414 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1843a69e-b70f-47dc-be87-3ff7a846bcc9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045993 Dec 15 12:51:20.070969 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 822/1628] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:20 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:51:21.081979 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2af2d063-6112-4b25-b729-a0eca3b5b012 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:21.083027 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2af2d063-6112-4b25-b729-a0eca3b5b012 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:21.089670 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2af2d063-6112-4b25-b729-a0eca3b5b012 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:21.090121 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2af2d063-6112-4b25-b729-a0eca3b5b012 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:21.090913 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2af2d063-6112-4b25-b729-a0eca3b5b012 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:21.091358 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2af2d063-6112-4b25-b729-a0eca3b5b012 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:21.122790 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2af2d063-6112-4b25-b729-a0eca3b5b012 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044576 Dec 15 12:51:21.123351 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 807/1629] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:21 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:22.135138 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-48d2de50-8831-4e74-a356-568435bfca22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:22.136032 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-48d2de50-8831-4e74-a356-568435bfca22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:22.142280 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-48d2de50-8831-4e74-a356-568435bfca22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:22.142726 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-48d2de50-8831-4e74-a356-568435bfca22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:22.143493 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-48d2de50-8831-4e74-a356-568435bfca22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:22.144005 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-48d2de50-8831-4e74-a356-568435bfca22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:22.174282 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-48d2de50-8831-4e74-a356-568435bfca22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043102 Dec 15 12:51:22.174826 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 823/1630] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:22 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:23.186460 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-29fddd66-5604-4095-a9f4-9dafa7a74661 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:23.187333 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-29fddd66-5604-4095-a9f4-9dafa7a74661 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:23.196527 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-29fddd66-5604-4095-a9f4-9dafa7a74661 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:23.196966 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-29fddd66-5604-4095-a9f4-9dafa7a74661 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:23.197785 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-29fddd66-5604-4095-a9f4-9dafa7a74661 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:23.198214 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-29fddd66-5604-4095-a9f4-9dafa7a74661 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:23.227733 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-29fddd66-5604-4095-a9f4-9dafa7a74661 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045657 Dec 15 12:51:23.228295 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 808/1631] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:23 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:24.239683 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7ff15a60-9852-40a0-9f43-f733f1431e62 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:24.240501 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7ff15a60-9852-40a0-9f43-f733f1431e62 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:24.246874 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7ff15a60-9852-40a0-9f43-f733f1431e62 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:24.247310 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7ff15a60-9852-40a0-9f43-f733f1431e62 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:24.248076 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7ff15a60-9852-40a0-9f43-f733f1431e62 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:24.248527 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7ff15a60-9852-40a0-9f43-f733f1431e62 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:24.279103 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7ff15a60-9852-40a0-9f43-f733f1431e62 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043556 Dec 15 12:51:24.279643 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 824/1632] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:24 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:25.291174 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e60d71c8-03ea-410b-aeed-969bd67ab148 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:25.292077 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e60d71c8-03ea-410b-aeed-969bd67ab148 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:25.298457 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e60d71c8-03ea-410b-aeed-969bd67ab148 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:25.298930 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e60d71c8-03ea-410b-aeed-969bd67ab148 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:25.299713 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e60d71c8-03ea-410b-aeed-969bd67ab148 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:25.300148 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e60d71c8-03ea-410b-aeed-969bd67ab148 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:25.337968 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e60d71c8-03ea-410b-aeed-969bd67ab148 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050486 Dec 15 12:51:25.338528 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 809/1633] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:25 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:26.349859 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-184bb4e9-88d7-49e7-9dbc-8694f9eec55c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:26.350788 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-184bb4e9-88d7-49e7-9dbc-8694f9eec55c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:26.357093 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-184bb4e9-88d7-49e7-9dbc-8694f9eec55c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:26.357575 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-184bb4e9-88d7-49e7-9dbc-8694f9eec55c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:26.358373 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-184bb4e9-88d7-49e7-9dbc-8694f9eec55c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:26.358810 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-184bb4e9-88d7-49e7-9dbc-8694f9eec55c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:26.391416 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-184bb4e9-88d7-49e7-9dbc-8694f9eec55c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045586 Dec 15 12:51:26.391990 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 825/1634] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:26 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:27.402939 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2a52825a-ddb2-409e-ad63-8daffbd35ed8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:27.403839 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2a52825a-ddb2-409e-ad63-8daffbd35ed8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:27.409733 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2a52825a-ddb2-409e-ad63-8daffbd35ed8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:27.410173 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2a52825a-ddb2-409e-ad63-8daffbd35ed8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:27.411521 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2a52825a-ddb2-409e-ad63-8daffbd35ed8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:27.412218 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2a52825a-ddb2-409e-ad63-8daffbd35ed8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:27.443543 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2a52825a-ddb2-409e-ad63-8daffbd35ed8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044294 Dec 15 12:51:27.444095 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 810/1635] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:27 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:28.455080 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a8a71cd9-3699-49b5-9c39-156a4b55b391 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:28.456002 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a8a71cd9-3699-49b5-9c39-156a4b55b391 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:28.462574 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a8a71cd9-3699-49b5-9c39-156a4b55b391 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:28.463016 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a8a71cd9-3699-49b5-9c39-156a4b55b391 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:28.463806 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a8a71cd9-3699-49b5-9c39-156a4b55b391 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:28.464235 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a8a71cd9-3699-49b5-9c39-156a4b55b391 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:28.493189 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a8a71cd9-3699-49b5-9c39-156a4b55b391 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042045 Dec 15 12:51:28.493773 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 826/1636] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:28 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:29.504326 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-36945e73-a9e5-4cee-8af9-3a86ab54a80c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:29.505513 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-36945e73-a9e5-4cee-8af9-3a86ab54a80c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:29.512072 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-36945e73-a9e5-4cee-8af9-3a86ab54a80c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:29.512523 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-36945e73-a9e5-4cee-8af9-3a86ab54a80c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:29.513310 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-36945e73-a9e5-4cee-8af9-3a86ab54a80c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:29.513806 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-36945e73-a9e5-4cee-8af9-3a86ab54a80c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:29.543345 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-36945e73-a9e5-4cee-8af9-3a86ab54a80c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042784 Dec 15 12:51:29.550251 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 811/1637] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:29 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:30.555885 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3bb9b7b3-30c1-4c80-9e01-76636f688caf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:30.556703 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3bb9b7b3-30c1-4c80-9e01-76636f688caf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:30.562568 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3bb9b7b3-30c1-4c80-9e01-76636f688caf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:30.563016 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3bb9b7b3-30c1-4c80-9e01-76636f688caf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:30.563797 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3bb9b7b3-30c1-4c80-9e01-76636f688caf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:30.564228 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3bb9b7b3-30c1-4c80-9e01-76636f688caf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:30.601866 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3bb9b7b3-30c1-4c80-9e01-76636f688caf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050554 Dec 15 12:51:30.602429 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 827/1638] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:30 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:31.612842 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-66fef3c3-0e1b-4c43-9eb9-ab0118642fa8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:31.613960 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-66fef3c3-0e1b-4c43-9eb9-ab0118642fa8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:31.620227 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66fef3c3-0e1b-4c43-9eb9-ab0118642fa8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:31.620667 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66fef3c3-0e1b-4c43-9eb9-ab0118642fa8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:31.621440 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66fef3c3-0e1b-4c43-9eb9-ab0118642fa8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:31.621911 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66fef3c3-0e1b-4c43-9eb9-ab0118642fa8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:31.663512 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-66fef3c3-0e1b-4c43-9eb9-ab0118642fa8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054342 Dec 15 12:51:31.664085 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 812/1639] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:31 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:32.676655 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8bacd7e5-2e5e-4fcd-ac86-5c312649c951 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:32.678035 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8bacd7e5-2e5e-4fcd-ac86-5c312649c951 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:32.685336 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8bacd7e5-2e5e-4fcd-ac86-5c312649c951 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:32.685977 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8bacd7e5-2e5e-4fcd-ac86-5c312649c951 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:32.687157 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8bacd7e5-2e5e-4fcd-ac86-5c312649c951 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:32.687785 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8bacd7e5-2e5e-4fcd-ac86-5c312649c951 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:32.726454 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8bacd7e5-2e5e-4fcd-ac86-5c312649c951 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054938 Dec 15 12:51:32.727097 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 828/1640] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:32 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:33.738153 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0e20a8e2-5b92-4818-bb50-d512c68908bd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:33.739729 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0e20a8e2-5b92-4818-bb50-d512c68908bd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:33.745966 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e20a8e2-5b92-4818-bb50-d512c68908bd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:33.746414 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e20a8e2-5b92-4818-bb50-d512c68908bd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:33.747204 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e20a8e2-5b92-4818-bb50-d512c68908bd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:33.747640 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e20a8e2-5b92-4818-bb50-d512c68908bd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:33.779106 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0e20a8e2-5b92-4818-bb50-d512c68908bd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044689 Dec 15 12:51:33.779663 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 813/1641] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:33 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:34.791081 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-79bd9eb1-67f7-4030-98be-0fd1d8cfd5b6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:34.791981 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-79bd9eb1-67f7-4030-98be-0fd1d8cfd5b6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:34.798465 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-79bd9eb1-67f7-4030-98be-0fd1d8cfd5b6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:34.798913 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-79bd9eb1-67f7-4030-98be-0fd1d8cfd5b6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:34.799700 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-79bd9eb1-67f7-4030-98be-0fd1d8cfd5b6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:34.800136 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-79bd9eb1-67f7-4030-98be-0fd1d8cfd5b6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:34.831258 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-79bd9eb1-67f7-4030-98be-0fd1d8cfd5b6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043884 Dec 15 12:51:34.831810 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 829/1642] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:34 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:35.843203 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-cc2e167c-c756-402d-8507-ca96d559781a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:35.844116 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-cc2e167c-c756-402d-8507-ca96d559781a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:35.851214 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc2e167c-c756-402d-8507-ca96d559781a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:35.851657 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc2e167c-c756-402d-8507-ca96d559781a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:35.852455 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc2e167c-c756-402d-8507-ca96d559781a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:35.852890 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc2e167c-c756-402d-8507-ca96d559781a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:35.883115 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cc2e167c-c756-402d-8507-ca96d559781a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043864 Dec 15 12:51:35.883693 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 814/1643] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:35 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:36.895204 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-25f9c592-5c25-474e-ad31-803a371b8662 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:36.896110 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-25f9c592-5c25-474e-ad31-803a371b8662 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:36.902445 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-25f9c592-5c25-474e-ad31-803a371b8662 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:36.902895 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-25f9c592-5c25-474e-ad31-803a371b8662 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:36.903682 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-25f9c592-5c25-474e-ad31-803a371b8662 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:36.904119 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-25f9c592-5c25-474e-ad31-803a371b8662 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:36.934512 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-25f9c592-5c25-474e-ad31-803a371b8662 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043167 Dec 15 12:51:36.935110 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 830/1644] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:36 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:37.946638 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-99de620a-ad99-487a-aa71-bdf80573305e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:37.947531 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-99de620a-ad99-487a-aa71-bdf80573305e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:37.953799 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-99de620a-ad99-487a-aa71-bdf80573305e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:37.954235 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-99de620a-ad99-487a-aa71-bdf80573305e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:37.954999 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-99de620a-ad99-487a-aa71-bdf80573305e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:37.955424 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-99de620a-ad99-487a-aa71-bdf80573305e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:37.986270 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-99de620a-ad99-487a-aa71-bdf80573305e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043444 Dec 15 12:51:37.986820 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 815/1645] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:37 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:38.998146 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-35faf219-3f15-43d9-9558-baa70cf99a1b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:38.999091 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-35faf219-3f15-43d9-9558-baa70cf99a1b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:39.006537 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-35faf219-3f15-43d9-9558-baa70cf99a1b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:39.007240 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-35faf219-3f15-43d9-9558-baa70cf99a1b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:39.008064 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-35faf219-3f15-43d9-9558-baa70cf99a1b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:39.008506 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-35faf219-3f15-43d9-9558-baa70cf99a1b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:39.040931 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-35faf219-3f15-43d9-9558-baa70cf99a1b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046481 Dec 15 12:51:39.041524 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 831/1646] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:38 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:40.052811 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-aab01d79-12fe-4bcf-bfa4-0a0c62d8e274 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:40.053789 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-aab01d79-12fe-4bcf-bfa4-0a0c62d8e274 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:40.060614 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aab01d79-12fe-4bcf-bfa4-0a0c62d8e274 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:40.061054 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aab01d79-12fe-4bcf-bfa4-0a0c62d8e274 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:40.061865 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aab01d79-12fe-4bcf-bfa4-0a0c62d8e274 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:40.062292 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aab01d79-12fe-4bcf-bfa4-0a0c62d8e274 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:40.092441 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-aab01d79-12fe-4bcf-bfa4-0a0c62d8e274 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043781 Dec 15 12:51:40.093004 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 816/1647] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:40 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:41.103931 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d810cd7b-048f-409f-a308-0b94a73fd2bb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:41.105140 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d810cd7b-048f-409f-a308-0b94a73fd2bb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:41.111417 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d810cd7b-048f-409f-a308-0b94a73fd2bb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:41.111855 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d810cd7b-048f-409f-a308-0b94a73fd2bb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:41.112623 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d810cd7b-048f-409f-a308-0b94a73fd2bb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:41.113045 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d810cd7b-048f-409f-a308-0b94a73fd2bb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:41.145920 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d810cd7b-048f-409f-a308-0b94a73fd2bb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045557 Dec 15 12:51:41.146579 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 832/1648] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:41 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:42.157569 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-53bf9137-ad63-4e4b-8128-8c76252d7cbd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:42.158481 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-53bf9137-ad63-4e4b-8128-8c76252d7cbd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:42.165304 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-53bf9137-ad63-4e4b-8128-8c76252d7cbd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:42.165780 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-53bf9137-ad63-4e4b-8128-8c76252d7cbd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:42.166562 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-53bf9137-ad63-4e4b-8128-8c76252d7cbd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:42.166997 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-53bf9137-ad63-4e4b-8128-8c76252d7cbd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:42.199069 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-53bf9137-ad63-4e4b-8128-8c76252d7cbd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045228 Dec 15 12:51:42.199651 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 817/1649] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:42 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:51:43.210850 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a16c444a-a33c-4942-8f7c-accac00ce0eb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:43.211747 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a16c444a-a33c-4942-8f7c-accac00ce0eb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:43.217895 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a16c444a-a33c-4942-8f7c-accac00ce0eb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:43.218333 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a16c444a-a33c-4942-8f7c-accac00ce0eb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:43.219100 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a16c444a-a33c-4942-8f7c-accac00ce0eb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:43.219529 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a16c444a-a33c-4942-8f7c-accac00ce0eb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:43.250879 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a16c444a-a33c-4942-8f7c-accac00ce0eb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043938 Dec 15 12:51:43.251413 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 833/1650] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:43 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:44.263417 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d9c242a6-e4be-49c9-a072-147f66ece092 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:44.264362 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d9c242a6-e4be-49c9-a072-147f66ece092 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:44.271306 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d9c242a6-e4be-49c9-a072-147f66ece092 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:44.271772 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d9c242a6-e4be-49c9-a072-147f66ece092 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:44.279846 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d9c242a6-e4be-49c9-a072-147f66ece092 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:44.280288 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d9c242a6-e4be-49c9-a072-147f66ece092 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:44.311810 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d9c242a6-e4be-49c9-a072-147f66ece092 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052141 Dec 15 12:51:44.312359 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 818/1651] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:44 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:45.323508 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-dc00effe-6509-4e06-b3ab-b4e745421d70 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:45.324448 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-dc00effe-6509-4e06-b3ab-b4e745421d70 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:45.330693 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dc00effe-6509-4e06-b3ab-b4e745421d70 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:45.331139 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dc00effe-6509-4e06-b3ab-b4e745421d70 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:45.331949 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dc00effe-6509-4e06-b3ab-b4e745421d70 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:45.332385 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dc00effe-6509-4e06-b3ab-b4e745421d70 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:45.360968 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-dc00effe-6509-4e06-b3ab-b4e745421d70 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041251 Dec 15 12:51:45.361522 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 834/1652] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:45 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:46.372197 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a5f927a8-82ff-4ae5-8ce0-6d2e9369b499 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:46.373106 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a5f927a8-82ff-4ae5-8ce0-6d2e9369b499 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:46.379931 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a5f927a8-82ff-4ae5-8ce0-6d2e9369b499 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:46.380382 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a5f927a8-82ff-4ae5-8ce0-6d2e9369b499 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:46.381164 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a5f927a8-82ff-4ae5-8ce0-6d2e9369b499 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:46.381624 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a5f927a8-82ff-4ae5-8ce0-6d2e9369b499 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:46.412217 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a5f927a8-82ff-4ae5-8ce0-6d2e9369b499 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043716 Dec 15 12:51:46.412807 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 819/1653] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:46 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:47.423873 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-eaed5191-57de-4763-a43e-91aa9ab00931 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:47.424782 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-eaed5191-57de-4763-a43e-91aa9ab00931 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:47.431111 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eaed5191-57de-4763-a43e-91aa9ab00931 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:47.431556 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eaed5191-57de-4763-a43e-91aa9ab00931 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:47.432338 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eaed5191-57de-4763-a43e-91aa9ab00931 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:47.432775 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eaed5191-57de-4763-a43e-91aa9ab00931 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:47.464184 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-eaed5191-57de-4763-a43e-91aa9ab00931 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043985 Dec 15 12:51:47.464743 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 835/1654] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:47 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:48.476057 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-87195ea0-f1c0-469e-850a-11a3ca28935e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:48.476960 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-87195ea0-f1c0-469e-850a-11a3ca28935e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:48.483332 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-87195ea0-f1c0-469e-850a-11a3ca28935e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:48.483780 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-87195ea0-f1c0-469e-850a-11a3ca28935e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:48.484570 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-87195ea0-f1c0-469e-850a-11a3ca28935e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:48.485004 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-87195ea0-f1c0-469e-850a-11a3ca28935e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:48.524031 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-87195ea0-f1c0-469e-850a-11a3ca28935e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052484 Dec 15 12:51:48.524595 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 820/1655] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:48 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:49.535943 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a39a5c0b-7bc4-4fa1-b609-e37ba1f683b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:49.536929 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a39a5c0b-7bc4-4fa1-b609-e37ba1f683b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:49.543275 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a39a5c0b-7bc4-4fa1-b609-e37ba1f683b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:49.543717 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a39a5c0b-7bc4-4fa1-b609-e37ba1f683b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:49.544498 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a39a5c0b-7bc4-4fa1-b609-e37ba1f683b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:49.544929 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a39a5c0b-7bc4-4fa1-b609-e37ba1f683b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:49.574602 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a39a5c0b-7bc4-4fa1-b609-e37ba1f683b0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042770 Dec 15 12:51:49.575154 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 836/1656] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:49 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:50.587011 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-89dbba17-a0d7-4e22-ada6-ab61a9cb885d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:50.587839 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-89dbba17-a0d7-4e22-ada6-ab61a9cb885d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:50.594316 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-89dbba17-a0d7-4e22-ada6-ab61a9cb885d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:50.594842 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-89dbba17-a0d7-4e22-ada6-ab61a9cb885d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:50.595871 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-89dbba17-a0d7-4e22-ada6-ab61a9cb885d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:50.596303 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-89dbba17-a0d7-4e22-ada6-ab61a9cb885d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:50.626998 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-89dbba17-a0d7-4e22-ada6-ab61a9cb885d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044541 Dec 15 12:51:50.627589 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 821/1657] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:50 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:51.639147 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7dec555a-eb68-4fc8-aefd-a01c77bcfdaa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:51.640050 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7dec555a-eb68-4fc8-aefd-a01c77bcfdaa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:51.647086 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7dec555a-eb68-4fc8-aefd-a01c77bcfdaa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:51.647538 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7dec555a-eb68-4fc8-aefd-a01c77bcfdaa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:51.648321 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7dec555a-eb68-4fc8-aefd-a01c77bcfdaa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:51.648759 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7dec555a-eb68-4fc8-aefd-a01c77bcfdaa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:51.682940 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7dec555a-eb68-4fc8-aefd-a01c77bcfdaa tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047497 Dec 15 12:51:51.683497 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 837/1658] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:51 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:52.695235 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-94d462f6-16db-40c2-9dc8-8f0f3e5bb612 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:52.696146 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-94d462f6-16db-40c2-9dc8-8f0f3e5bb612 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:52.703110 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-94d462f6-16db-40c2-9dc8-8f0f3e5bb612 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:52.703556 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-94d462f6-16db-40c2-9dc8-8f0f3e5bb612 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:52.704393 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-94d462f6-16db-40c2-9dc8-8f0f3e5bb612 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:52.704843 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-94d462f6-16db-40c2-9dc8-8f0f3e5bb612 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:52.735159 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-94d462f6-16db-40c2-9dc8-8f0f3e5bb612 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044355 Dec 15 12:51:52.735711 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 822/1659] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:52 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:53.747144 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-db52da04-2690-4e5c-873f-d79ae2b60a7c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:53.748066 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-db52da04-2690-4e5c-873f-d79ae2b60a7c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:53.755015 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-db52da04-2690-4e5c-873f-d79ae2b60a7c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:53.755794 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-db52da04-2690-4e5c-873f-d79ae2b60a7c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:53.757024 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-db52da04-2690-4e5c-873f-d79ae2b60a7c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:53.757453 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-db52da04-2690-4e5c-873f-d79ae2b60a7c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:53.787947 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-db52da04-2690-4e5c-873f-d79ae2b60a7c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044706 Dec 15 12:51:53.788492 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 838/1660] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:53 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:54.799606 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a1887928-b8a1-4b23-a6c3-dc473375b2ab tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:54.800510 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a1887928-b8a1-4b23-a6c3-dc473375b2ab tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:54.807916 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1887928-b8a1-4b23-a6c3-dc473375b2ab tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:54.808364 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1887928-b8a1-4b23-a6c3-dc473375b2ab tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:54.809173 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1887928-b8a1-4b23-a6c3-dc473375b2ab tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:54.809641 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1887928-b8a1-4b23-a6c3-dc473375b2ab tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:54.841390 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a1887928-b8a1-4b23-a6c3-dc473375b2ab tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045513 Dec 15 12:51:54.842014 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 823/1661] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:54 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:55.853529 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2fb5f0c7-6daa-4964-afec-7f60bdbb0330 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:55.854446 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2fb5f0c7-6daa-4964-afec-7f60bdbb0330 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:55.860457 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2fb5f0c7-6daa-4964-afec-7f60bdbb0330 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:55.860895 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2fb5f0c7-6daa-4964-afec-7f60bdbb0330 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:55.861702 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2fb5f0c7-6daa-4964-afec-7f60bdbb0330 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:55.862131 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2fb5f0c7-6daa-4964-afec-7f60bdbb0330 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:55.892496 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2fb5f0c7-6daa-4964-afec-7f60bdbb0330 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043179 Dec 15 12:51:55.893054 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 839/1662] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:55 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:56.904977 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-263842b9-6c65-415d-b9e4-e633b32d11b2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:56.905922 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-263842b9-6c65-415d-b9e4-e633b32d11b2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:56.912754 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-263842b9-6c65-415d-b9e4-e633b32d11b2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:56.913203 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-263842b9-6c65-415d-b9e4-e633b32d11b2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:56.914007 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-263842b9-6c65-415d-b9e4-e633b32d11b2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:56.914443 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-263842b9-6c65-415d-b9e4-e633b32d11b2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:56.944363 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-263842b9-6c65-415d-b9e4-e633b32d11b2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043143 Dec 15 12:51:56.944926 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 824/1663] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:56 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:57.955784 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f5c7d8d0-68f8-4c46-a570-31eba74a2fa3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:57.956677 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f5c7d8d0-68f8-4c46-a570-31eba74a2fa3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:57.964037 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f5c7d8d0-68f8-4c46-a570-31eba74a2fa3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:57.964488 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f5c7d8d0-68f8-4c46-a570-31eba74a2fa3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:57.965343 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f5c7d8d0-68f8-4c46-a570-31eba74a2fa3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:57.965816 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f5c7d8d0-68f8-4c46-a570-31eba74a2fa3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:57.994983 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f5c7d8d0-68f8-4c46-a570-31eba74a2fa3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042914 Dec 15 12:51:57.995533 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 840/1664] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:57 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:51:59.007164 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3018d1d8-e6dc-44d9-a8ef-68399549da9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:51:59.008078 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3018d1d8-e6dc-44d9-a8ef-68399549da9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:51:59.014138 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3018d1d8-e6dc-44d9-a8ef-68399549da9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:59.014582 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3018d1d8-e6dc-44d9-a8ef-68399549da9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:59.015366 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3018d1d8-e6dc-44d9-a8ef-68399549da9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:51:59.015796 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3018d1d8-e6dc-44d9-a8ef-68399549da9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:51:59.046782 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3018d1d8-e6dc-44d9-a8ef-68399549da9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043831 Dec 15 12:51:59.047347 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 825/1665] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:51:59 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:00.060157 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ce4b5331-05e0-42aa-baf3-44b265b97ee1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:00.060959 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ce4b5331-05e0-42aa-baf3-44b265b97ee1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:00.067417 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce4b5331-05e0-42aa-baf3-44b265b97ee1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:00.067857 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce4b5331-05e0-42aa-baf3-44b265b97ee1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:00.068628 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce4b5331-05e0-42aa-baf3-44b265b97ee1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:00.069056 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce4b5331-05e0-42aa-baf3-44b265b97ee1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:00.098365 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ce4b5331-05e0-42aa-baf3-44b265b97ee1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041404 Dec 15 12:52:00.099231 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 841/1666] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:00 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:01.109360 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-910beed9-9436-4674-825f-57ff3fbb4f6d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:01.110294 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-910beed9-9436-4674-825f-57ff3fbb4f6d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:01.116628 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-910beed9-9436-4674-825f-57ff3fbb4f6d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:01.117070 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-910beed9-9436-4674-825f-57ff3fbb4f6d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:01.117884 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-910beed9-9436-4674-825f-57ff3fbb4f6d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:01.118316 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-910beed9-9436-4674-825f-57ff3fbb4f6d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:01.156194 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-910beed9-9436-4674-825f-57ff3fbb4f6d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050504 Dec 15 12:52:01.156770 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 826/1667] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:01 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:02.167776 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-dcfd5b6c-b87b-4a34-9ddd-759f01b76d1d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:02.168741 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-dcfd5b6c-b87b-4a34-9ddd-759f01b76d1d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:02.174953 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dcfd5b6c-b87b-4a34-9ddd-759f01b76d1d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:02.175922 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dcfd5b6c-b87b-4a34-9ddd-759f01b76d1d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:02.176822 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dcfd5b6c-b87b-4a34-9ddd-759f01b76d1d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:02.177268 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dcfd5b6c-b87b-4a34-9ddd-759f01b76d1d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:02.208057 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-dcfd5b6c-b87b-4a34-9ddd-759f01b76d1d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043070 Dec 15 12:52:02.208612 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 842/1668] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:02 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:03.219615 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-18217819-f23f-4b7b-a4a8-d27323d60d98 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:03.220562 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-18217819-f23f-4b7b-a4a8-d27323d60d98 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:03.227768 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-18217819-f23f-4b7b-a4a8-d27323d60d98 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:03.228223 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-18217819-f23f-4b7b-a4a8-d27323d60d98 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:03.229021 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-18217819-f23f-4b7b-a4a8-d27323d60d98 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:03.229460 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-18217819-f23f-4b7b-a4a8-d27323d60d98 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:03.259286 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-18217819-f23f-4b7b-a4a8-d27323d60d98 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043528 Dec 15 12:52:03.259850 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 827/1669] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:03 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:04.271614 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e75491a4-f6ba-4549-8cd0-4798172d57a6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:04.272586 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e75491a4-f6ba-4549-8cd0-4798172d57a6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:04.278818 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e75491a4-f6ba-4549-8cd0-4798172d57a6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:04.279261 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e75491a4-f6ba-4549-8cd0-4798172d57a6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:04.280036 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e75491a4-f6ba-4549-8cd0-4798172d57a6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:04.280472 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e75491a4-f6ba-4549-8cd0-4798172d57a6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:04.309812 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e75491a4-f6ba-4549-8cd0-4798172d57a6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042645 Dec 15 12:52:04.310402 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 843/1670] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:04 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:05.322370 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-18848d93-2a1e-446a-b894-0365b499646d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:05.323278 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-18848d93-2a1e-446a-b894-0365b499646d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:05.329594 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-18848d93-2a1e-446a-b894-0365b499646d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:05.330053 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-18848d93-2a1e-446a-b894-0365b499646d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:05.330831 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-18848d93-2a1e-446a-b894-0365b499646d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:05.331288 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-18848d93-2a1e-446a-b894-0365b499646d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:05.362802 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-18848d93-2a1e-446a-b894-0365b499646d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044175 Dec 15 12:52:05.363442 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 828/1671] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:05 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:06.374362 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2e5036c8-1f03-47e7-aa98-d0b8a0aa1614 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:06.375270 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2e5036c8-1f03-47e7-aa98-d0b8a0aa1614 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:06.382976 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2e5036c8-1f03-47e7-aa98-d0b8a0aa1614 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:06.383429 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2e5036c8-1f03-47e7-aa98-d0b8a0aa1614 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:06.384219 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2e5036c8-1f03-47e7-aa98-d0b8a0aa1614 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:06.384658 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2e5036c8-1f03-47e7-aa98-d0b8a0aa1614 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:06.426363 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2e5036c8-1f03-47e7-aa98-d0b8a0aa1614 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054595 Dec 15 12:52:06.427320 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 844/1672] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:06 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:52:07.438706 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b31be39b-6066-4137-bef2-3ee6fb6c17f2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:07.439741 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b31be39b-6066-4137-bef2-3ee6fb6c17f2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:07.447004 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b31be39b-6066-4137-bef2-3ee6fb6c17f2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:07.447451 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b31be39b-6066-4137-bef2-3ee6fb6c17f2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:07.448245 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b31be39b-6066-4137-bef2-3ee6fb6c17f2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:07.448677 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b31be39b-6066-4137-bef2-3ee6fb6c17f2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:07.477076 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b31be39b-6066-4137-bef2-3ee6fb6c17f2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042323 Dec 15 12:52:07.477654 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 829/1673] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:07 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:08.488724 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4b4e3b93-f801-4053-a023-22128cd7aecf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:08.489753 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4b4e3b93-f801-4053-a023-22128cd7aecf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:08.495971 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4b4e3b93-f801-4053-a023-22128cd7aecf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:08.496423 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4b4e3b93-f801-4053-a023-22128cd7aecf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:08.497212 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4b4e3b93-f801-4053-a023-22128cd7aecf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:08.497680 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4b4e3b93-f801-4053-a023-22128cd7aecf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:08.527356 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4b4e3b93-f801-4053-a023-22128cd7aecf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042462 Dec 15 12:52:08.527916 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 845/1674] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:08 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:09.540012 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-aa5b1c03-beb8-44fa-9f7f-6dc5c2dea815 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:09.540902 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-aa5b1c03-beb8-44fa-9f7f-6dc5c2dea815 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:09.547161 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aa5b1c03-beb8-44fa-9f7f-6dc5c2dea815 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:09.547597 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aa5b1c03-beb8-44fa-9f7f-6dc5c2dea815 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:09.548365 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aa5b1c03-beb8-44fa-9f7f-6dc5c2dea815 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:09.548796 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aa5b1c03-beb8-44fa-9f7f-6dc5c2dea815 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:09.578869 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-aa5b1c03-beb8-44fa-9f7f-6dc5c2dea815 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042931 Dec 15 12:52:09.579445 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 830/1675] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:09 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:10.591436 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4cde1692-ccc1-4ea4-9213-d1021a88b52f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:10.592347 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4cde1692-ccc1-4ea4-9213-d1021a88b52f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:10.598962 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4cde1692-ccc1-4ea4-9213-d1021a88b52f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:10.599415 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4cde1692-ccc1-4ea4-9213-d1021a88b52f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:10.600406 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4cde1692-ccc1-4ea4-9213-d1021a88b52f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:10.600850 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4cde1692-ccc1-4ea4-9213-d1021a88b52f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:10.632458 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4cde1692-ccc1-4ea4-9213-d1021a88b52f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044607 Dec 15 12:52:10.633015 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 846/1676] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:10 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:11.643958 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d8757223-640c-424b-a90c-c47504b40f0b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:11.645739 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d8757223-640c-424b-a90c-c47504b40f0b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:11.651989 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d8757223-640c-424b-a90c-c47504b40f0b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:11.652570 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d8757223-640c-424b-a90c-c47504b40f0b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:11.653552 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d8757223-640c-424b-a90c-c47504b40f0b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:11.653910 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d8757223-640c-424b-a90c-c47504b40f0b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:11.685153 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d8757223-640c-424b-a90c-c47504b40f0b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044952 Dec 15 12:52:11.685747 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 831/1677] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:11 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:12.697914 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ce8f76ce-5721-486e-b818-7866ab9d8230 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:12.699058 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ce8f76ce-5721-486e-b818-7866ab9d8230 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:12.705908 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce8f76ce-5721-486e-b818-7866ab9d8230 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:12.706457 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce8f76ce-5721-486e-b818-7866ab9d8230 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:12.707363 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce8f76ce-5721-486e-b818-7866ab9d8230 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:12.707799 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce8f76ce-5721-486e-b818-7866ab9d8230 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:12.736807 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ce8f76ce-5721-486e-b818-7866ab9d8230 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042699 Dec 15 12:52:12.737367 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 847/1678] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:12 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:13.749069 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-39ec3643-df4b-4ddc-a90f-b7477a005d29 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:13.749998 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-39ec3643-df4b-4ddc-a90f-b7477a005d29 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:13.757065 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-39ec3643-df4b-4ddc-a90f-b7477a005d29 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:13.757569 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-39ec3643-df4b-4ddc-a90f-b7477a005d29 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:13.758385 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-39ec3643-df4b-4ddc-a90f-b7477a005d29 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:13.758822 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-39ec3643-df4b-4ddc-a90f-b7477a005d29 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:13.791488 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-39ec3643-df4b-4ddc-a90f-b7477a005d29 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046157 Dec 15 12:52:13.792088 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 832/1679] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:13 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:14.803895 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bbc28bdc-e96e-4e5a-b5d5-66c6016cac65 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:14.804868 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bbc28bdc-e96e-4e5a-b5d5-66c6016cac65 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:14.812063 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bbc28bdc-e96e-4e5a-b5d5-66c6016cac65 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:14.812483 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bbc28bdc-e96e-4e5a-b5d5-66c6016cac65 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:14.813270 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bbc28bdc-e96e-4e5a-b5d5-66c6016cac65 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:14.813738 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bbc28bdc-e96e-4e5a-b5d5-66c6016cac65 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:14.850056 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bbc28bdc-e96e-4e5a-b5d5-66c6016cac65 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050586 Dec 15 12:52:14.850610 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 848/1680] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:14 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:15.861069 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-66cfe2ea-aae9-40ff-a952-53c195dee82d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:15.862023 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-66cfe2ea-aae9-40ff-a952-53c195dee82d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:15.869249 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66cfe2ea-aae9-40ff-a952-53c195dee82d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:15.869735 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66cfe2ea-aae9-40ff-a952-53c195dee82d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:15.870522 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66cfe2ea-aae9-40ff-a952-53c195dee82d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:15.870958 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66cfe2ea-aae9-40ff-a952-53c195dee82d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:15.903808 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-66cfe2ea-aae9-40ff-a952-53c195dee82d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046427 Dec 15 12:52:15.904378 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 833/1681] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:15 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:16.915596 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4ea7d838-ea7a-4b9c-89c8-f7d0bf5071c9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:16.916560 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4ea7d838-ea7a-4b9c-89c8-f7d0bf5071c9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:16.923226 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4ea7d838-ea7a-4b9c-89c8-f7d0bf5071c9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:16.923672 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4ea7d838-ea7a-4b9c-89c8-f7d0bf5071c9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:16.924545 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4ea7d838-ea7a-4b9c-89c8-f7d0bf5071c9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:16.924917 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4ea7d838-ea7a-4b9c-89c8-f7d0bf5071c9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:16.954905 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4ea7d838-ea7a-4b9c-89c8-f7d0bf5071c9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043266 Dec 15 12:52:16.955453 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 849/1682] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:16 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:17.967121 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-75f8ca66-eeb7-4fac-8641-6ca274a1c6c5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:17.968033 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-75f8ca66-eeb7-4fac-8641-6ca274a1c6c5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:17.975457 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-75f8ca66-eeb7-4fac-8641-6ca274a1c6c5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:17.975913 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-75f8ca66-eeb7-4fac-8641-6ca274a1c6c5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:17.976714 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-75f8ca66-eeb7-4fac-8641-6ca274a1c6c5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:17.977159 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-75f8ca66-eeb7-4fac-8641-6ca274a1c6c5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:18.006123 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-75f8ca66-eeb7-4fac-8641-6ca274a1c6c5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042841 Dec 15 12:52:18.006677 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 834/1683] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:17 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:19.018199 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7837db07-e26f-4971-9f4a-b0a58dfb8faf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:19.019222 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7837db07-e26f-4971-9f4a-b0a58dfb8faf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:19.025465 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7837db07-e26f-4971-9f4a-b0a58dfb8faf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:19.025948 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7837db07-e26f-4971-9f4a-b0a58dfb8faf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:19.026769 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7837db07-e26f-4971-9f4a-b0a58dfb8faf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:19.027210 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7837db07-e26f-4971-9f4a-b0a58dfb8faf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:19.059110 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7837db07-e26f-4971-9f4a-b0a58dfb8faf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044653 Dec 15 12:52:19.059687 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 850/1684] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:19 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:20.071976 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-433e925f-af1c-43b1-8bda-8c0c7379cae0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:20.072894 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-433e925f-af1c-43b1-8bda-8c0c7379cae0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:20.079151 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-433e925f-af1c-43b1-8bda-8c0c7379cae0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:20.079586 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-433e925f-af1c-43b1-8bda-8c0c7379cae0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:20.080363 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-433e925f-af1c-43b1-8bda-8c0c7379cae0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:20.080820 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-433e925f-af1c-43b1-8bda-8c0c7379cae0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:20.118869 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-433e925f-af1c-43b1-8bda-8c0c7379cae0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050465 Dec 15 12:52:20.119733 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 835/1685] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:20 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:21.130978 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-db9ba2ba-a553-4425-b907-1d7466f7cd28 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:21.132131 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-db9ba2ba-a553-4425-b907-1d7466f7cd28 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:21.138344 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-db9ba2ba-a553-4425-b907-1d7466f7cd28 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:21.138801 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-db9ba2ba-a553-4425-b907-1d7466f7cd28 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:21.139579 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-db9ba2ba-a553-4425-b907-1d7466f7cd28 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:21.140014 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-db9ba2ba-a553-4425-b907-1d7466f7cd28 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:21.171316 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-db9ba2ba-a553-4425-b907-1d7466f7cd28 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044188 Dec 15 12:52:21.171868 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 851/1686] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:21 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:22.184328 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1054cb81-4109-4528-9053-788d3914f1a3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:22.185222 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1054cb81-4109-4528-9053-788d3914f1a3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:22.191596 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1054cb81-4109-4528-9053-788d3914f1a3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:22.192156 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1054cb81-4109-4528-9053-788d3914f1a3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:22.193272 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1054cb81-4109-4528-9053-788d3914f1a3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:22.194044 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1054cb81-4109-4528-9053-788d3914f1a3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:22.227219 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1054cb81-4109-4528-9053-788d3914f1a3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047095 Dec 15 12:52:22.227778 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 836/1687] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:22 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:23.239434 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7b88406a-ea09-4d6d-b99c-50b1a41eb548 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:23.240342 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7b88406a-ea09-4d6d-b99c-50b1a41eb548 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:23.246977 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b88406a-ea09-4d6d-b99c-50b1a41eb548 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:23.247416 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b88406a-ea09-4d6d-b99c-50b1a41eb548 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:23.248200 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b88406a-ea09-4d6d-b99c-50b1a41eb548 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:23.248629 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b88406a-ea09-4d6d-b99c-50b1a41eb548 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:23.278447 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7b88406a-ea09-4d6d-b99c-50b1a41eb548 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043494 Dec 15 12:52:23.278990 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 852/1688] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:23 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:24.290220 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b96392a6-36c7-40e3-9173-33dcc5dd5e8e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:24.291163 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b96392a6-36c7-40e3-9173-33dcc5dd5e8e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:24.297801 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b96392a6-36c7-40e3-9173-33dcc5dd5e8e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:24.298251 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b96392a6-36c7-40e3-9173-33dcc5dd5e8e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:24.299468 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b96392a6-36c7-40e3-9173-33dcc5dd5e8e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:24.300083 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b96392a6-36c7-40e3-9173-33dcc5dd5e8e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:24.329751 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b96392a6-36c7-40e3-9173-33dcc5dd5e8e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043262 Dec 15 12:52:24.330330 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 837/1689] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:24 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:52:25.342285 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c1567520-d292-410d-bcd2-269d06881af7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:25.343187 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c1567520-d292-410d-bcd2-269d06881af7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:25.350019 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c1567520-d292-410d-bcd2-269d06881af7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:25.350457 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c1567520-d292-410d-bcd2-269d06881af7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:25.351228 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c1567520-d292-410d-bcd2-269d06881af7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:25.351652 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c1567520-d292-410d-bcd2-269d06881af7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:25.384700 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c1567520-d292-410d-bcd2-269d06881af7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045788 Dec 15 12:52:25.385621 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 853/1690] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:25 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:26.396952 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6b26c471-5ab0-4a30-977a-8a09283d7296 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:26.397894 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6b26c471-5ab0-4a30-977a-8a09283d7296 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:26.404169 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6b26c471-5ab0-4a30-977a-8a09283d7296 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:26.404615 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6b26c471-5ab0-4a30-977a-8a09283d7296 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:26.405386 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6b26c471-5ab0-4a30-977a-8a09283d7296 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:26.405841 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6b26c471-5ab0-4a30-977a-8a09283d7296 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:26.435820 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6b26c471-5ab0-4a30-977a-8a09283d7296 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043180 Dec 15 12:52:26.436391 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 838/1691] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:26 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:27.447985 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c41a4766-fa7e-4133-92a3-35a37f2e5f4c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:27.448884 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c41a4766-fa7e-4133-92a3-35a37f2e5f4c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:27.455114 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c41a4766-fa7e-4133-92a3-35a37f2e5f4c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:27.455564 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c41a4766-fa7e-4133-92a3-35a37f2e5f4c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:27.456691 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c41a4766-fa7e-4133-92a3-35a37f2e5f4c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:27.457210 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c41a4766-fa7e-4133-92a3-35a37f2e5f4c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:27.485972 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c41a4766-fa7e-4133-92a3-35a37f2e5f4c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041794 Dec 15 12:52:27.486527 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 854/1692] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:27 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:28.497818 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1f62796f-582b-424d-a878-ec7f918cb57b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:28.498726 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1f62796f-582b-424d-a878-ec7f918cb57b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:28.504903 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1f62796f-582b-424d-a878-ec7f918cb57b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:28.505351 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1f62796f-582b-424d-a878-ec7f918cb57b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:28.506162 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1f62796f-582b-424d-a878-ec7f918cb57b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:28.506601 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1f62796f-582b-424d-a878-ec7f918cb57b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:28.544628 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1f62796f-582b-424d-a878-ec7f918cb57b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050531 Dec 15 12:52:28.545179 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 839/1693] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:28 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:29.556923 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-cecc47bc-0720-4311-bc03-34906fe14955 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:29.557767 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-cecc47bc-0720-4311-bc03-34906fe14955 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:29.563947 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cecc47bc-0720-4311-bc03-34906fe14955 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:29.564386 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cecc47bc-0720-4311-bc03-34906fe14955 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:29.565157 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cecc47bc-0720-4311-bc03-34906fe14955 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:29.565672 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cecc47bc-0720-4311-bc03-34906fe14955 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:29.595594 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-cecc47bc-0720-4311-bc03-34906fe14955 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042480 Dec 15 12:52:29.596160 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 855/1694] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:29 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:30.608035 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-23c85608-65ee-44e6-89f6-71e6fecf0e5c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:30.608947 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-23c85608-65ee-44e6-89f6-71e6fecf0e5c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:30.616296 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-23c85608-65ee-44e6-89f6-71e6fecf0e5c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:30.616865 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-23c85608-65ee-44e6-89f6-71e6fecf0e5c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:30.617612 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-23c85608-65ee-44e6-89f6-71e6fecf0e5c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:30.618056 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-23c85608-65ee-44e6-89f6-71e6fecf0e5c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:30.648711 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-23c85608-65ee-44e6-89f6-71e6fecf0e5c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044576 Dec 15 12:52:30.649275 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 840/1695] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:30 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:31.661558 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9523d6d1-acaf-4aa9-bf4d-0eb448bb9809 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:31.662479 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9523d6d1-acaf-4aa9-bf4d-0eb448bb9809 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:31.668583 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9523d6d1-acaf-4aa9-bf4d-0eb448bb9809 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:31.669025 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9523d6d1-acaf-4aa9-bf4d-0eb448bb9809 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:31.669848 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9523d6d1-acaf-4aa9-bf4d-0eb448bb9809 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:31.670285 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9523d6d1-acaf-4aa9-bf4d-0eb448bb9809 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:31.700396 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9523d6d1-acaf-4aa9-bf4d-0eb448bb9809 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043774 Dec 15 12:52:31.700966 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 856/1696] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:31 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:32.717970 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-65ec8ab4-0e2f-48ac-90da-da21bb2e16d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:32.718879 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-65ec8ab4-0e2f-48ac-90da-da21bb2e16d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:32.725829 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-65ec8ab4-0e2f-48ac-90da-da21bb2e16d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:32.726280 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-65ec8ab4-0e2f-48ac-90da-da21bb2e16d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:32.727097 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-65ec8ab4-0e2f-48ac-90da-da21bb2e16d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:32.727536 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-65ec8ab4-0e2f-48ac-90da-da21bb2e16d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:32.765186 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-65ec8ab4-0e2f-48ac-90da-da21bb2e16d7 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050950 Dec 15 12:52:32.765805 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 841/1697] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:32 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:33.776962 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-16944375-992c-42f7-91fd-444d6611c4f9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:33.777880 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-16944375-992c-42f7-91fd-444d6611c4f9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:33.784054 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-16944375-992c-42f7-91fd-444d6611c4f9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:33.784600 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-16944375-992c-42f7-91fd-444d6611c4f9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:33.785363 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-16944375-992c-42f7-91fd-444d6611c4f9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:33.785826 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-16944375-992c-42f7-91fd-444d6611c4f9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:33.816890 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-16944375-992c-42f7-91fd-444d6611c4f9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043742 Dec 15 12:52:33.817442 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 857/1698] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:33 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:34.828254 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-08111597-33dc-4569-983f-f088cd84d9bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:34.829160 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-08111597-33dc-4569-983f-f088cd84d9bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:34.836871 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-08111597-33dc-4569-983f-f088cd84d9bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:34.837319 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-08111597-33dc-4569-983f-f088cd84d9bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:34.838153 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-08111597-33dc-4569-983f-f088cd84d9bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:34.838586 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-08111597-33dc-4569-983f-f088cd84d9bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:34.868842 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-08111597-33dc-4569-983f-f088cd84d9bf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044377 Dec 15 12:52:34.869394 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 842/1699] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:34 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:35.880116 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-cfb99141-7c72-44c6-ab0d-bc4bb4d18f42 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:35.881217 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-cfb99141-7c72-44c6-ab0d-bc4bb4d18f42 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:35.888779 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cfb99141-7c72-44c6-ab0d-bc4bb4d18f42 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:35.889309 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cfb99141-7c72-44c6-ab0d-bc4bb4d18f42 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:35.890181 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cfb99141-7c72-44c6-ab0d-bc4bb4d18f42 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:35.890618 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cfb99141-7c72-44c6-ab0d-bc4bb4d18f42 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:35.922420 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-cfb99141-7c72-44c6-ab0d-bc4bb4d18f42 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046217 Dec 15 12:52:35.923100 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 858/1700] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:35 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:36.933907 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-dbe75b7c-379a-4343-a78a-cd2a7fb04004 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:36.934811 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-dbe75b7c-379a-4343-a78a-cd2a7fb04004 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:36.941195 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dbe75b7c-379a-4343-a78a-cd2a7fb04004 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:36.941795 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dbe75b7c-379a-4343-a78a-cd2a7fb04004 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:36.943161 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dbe75b7c-379a-4343-a78a-cd2a7fb04004 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:36.943927 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dbe75b7c-379a-4343-a78a-cd2a7fb04004 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:36.976669 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-dbe75b7c-379a-4343-a78a-cd2a7fb04004 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046497 Dec 15 12:52:36.977272 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 843/1701] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:36 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:37.988318 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-64694e03-7acf-4618-9f93-a91482f32869 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:37.990049 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-64694e03-7acf-4618-9f93-a91482f32869 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:37.996253 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-64694e03-7acf-4618-9f93-a91482f32869 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:37.996701 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-64694e03-7acf-4618-9f93-a91482f32869 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:37.997479 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-64694e03-7acf-4618-9f93-a91482f32869 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:37.997938 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-64694e03-7acf-4618-9f93-a91482f32869 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:38.028639 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-64694e03-7acf-4618-9f93-a91482f32869 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044113 Dec 15 12:52:38.029199 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 859/1702] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:37 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:39.041122 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-357c6efa-66a6-4df4-a2c1-31fa2dd00fc0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:39.042114 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-357c6efa-66a6-4df4-a2c1-31fa2dd00fc0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:39.048532 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-357c6efa-66a6-4df4-a2c1-31fa2dd00fc0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:39.048976 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-357c6efa-66a6-4df4-a2c1-31fa2dd00fc0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:39.049805 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-357c6efa-66a6-4df4-a2c1-31fa2dd00fc0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:39.050366 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-357c6efa-66a6-4df4-a2c1-31fa2dd00fc0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:39.089918 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-357c6efa-66a6-4df4-a2c1-31fa2dd00fc0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052816 Dec 15 12:52:39.090482 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 844/1703] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:39 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:40.101925 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bee4111b-fc62-4523-af7a-05df924b0f81 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:40.102742 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bee4111b-fc62-4523-af7a-05df924b0f81 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:40.109027 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bee4111b-fc62-4523-af7a-05df924b0f81 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:40.109466 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bee4111b-fc62-4523-af7a-05df924b0f81 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:40.110272 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bee4111b-fc62-4523-af7a-05df924b0f81 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:40.110742 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bee4111b-fc62-4523-af7a-05df924b0f81 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:40.140087 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bee4111b-fc62-4523-af7a-05df924b0f81 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042126 Dec 15 12:52:40.140628 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 860/1704] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:40 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:41.151688 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5dd04e52-e670-4ab2-99f5-168b1188361f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:41.152590 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5dd04e52-e670-4ab2-99f5-168b1188361f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:41.158887 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5dd04e52-e670-4ab2-99f5-168b1188361f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:41.159334 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5dd04e52-e670-4ab2-99f5-168b1188361f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:41.160115 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5dd04e52-e670-4ab2-99f5-168b1188361f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:41.160588 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5dd04e52-e670-4ab2-99f5-168b1188361f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:41.191146 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5dd04e52-e670-4ab2-99f5-168b1188361f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043125 Dec 15 12:52:41.192551 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 845/1705] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:41 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:42.203755 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-14b38d0e-2781-4275-9213-f84186267372 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:42.204648 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-14b38d0e-2781-4275-9213-f84186267372 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:42.211522 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-14b38d0e-2781-4275-9213-f84186267372 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:42.211972 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-14b38d0e-2781-4275-9213-f84186267372 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:42.212781 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-14b38d0e-2781-4275-9213-f84186267372 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:42.213213 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-14b38d0e-2781-4275-9213-f84186267372 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:42.250705 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-14b38d0e-2781-4275-9213-f84186267372 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050809 Dec 15 12:52:42.251271 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 861/1706] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:42 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:52:43.262762 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8c119990-fd9c-46cd-9caa-1d3ef0aac902 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:43.263856 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8c119990-fd9c-46cd-9caa-1d3ef0aac902 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:43.271444 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c119990-fd9c-46cd-9caa-1d3ef0aac902 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:43.271948 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c119990-fd9c-46cd-9caa-1d3ef0aac902 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:43.272738 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c119990-fd9c-46cd-9caa-1d3ef0aac902 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:43.273218 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c119990-fd9c-46cd-9caa-1d3ef0aac902 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:43.305105 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8c119990-fd9c-46cd-9caa-1d3ef0aac902 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046164 Dec 15 12:52:43.305703 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 846/1707] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:43 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:44.323689 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-80f8e577-37fa-4c36-b1c3-69d47ee187b4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:44.324678 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-80f8e577-37fa-4c36-b1c3-69d47ee187b4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:44.331021 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-80f8e577-37fa-4c36-b1c3-69d47ee187b4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:44.331469 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-80f8e577-37fa-4c36-b1c3-69d47ee187b4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:44.332812 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-80f8e577-37fa-4c36-b1c3-69d47ee187b4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:44.333190 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-80f8e577-37fa-4c36-b1c3-69d47ee187b4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:44.362435 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-80f8e577-37fa-4c36-b1c3-69d47ee187b4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050027 Dec 15 12:52:44.362984 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 862/1708] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:44 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:45.374008 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d3ce9f67-c5be-4275-b068-4bf654b84a91 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:45.374919 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d3ce9f67-c5be-4275-b068-4bf654b84a91 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:45.381377 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d3ce9f67-c5be-4275-b068-4bf654b84a91 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:45.381857 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d3ce9f67-c5be-4275-b068-4bf654b84a91 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:45.382926 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d3ce9f67-c5be-4275-b068-4bf654b84a91 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:45.383355 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d3ce9f67-c5be-4275-b068-4bf654b84a91 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:45.411989 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d3ce9f67-c5be-4275-b068-4bf654b84a91 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041847 Dec 15 12:52:45.412545 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 847/1709] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:45 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:46.424002 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b2ace06e-133f-4765-9ad7-c9687a781085 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:46.424902 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b2ace06e-133f-4765-9ad7-c9687a781085 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:46.432113 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b2ace06e-133f-4765-9ad7-c9687a781085 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:46.432555 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b2ace06e-133f-4765-9ad7-c9687a781085 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:46.433333 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b2ace06e-133f-4765-9ad7-c9687a781085 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:46.433796 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b2ace06e-133f-4765-9ad7-c9687a781085 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:46.463304 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b2ace06e-133f-4765-9ad7-c9687a781085 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042975 Dec 15 12:52:46.463781 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 863/1710] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:46 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:47.475077 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4a75ae7d-3ba9-4c1f-943c-1275dc262a11 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:47.476023 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4a75ae7d-3ba9-4c1f-943c-1275dc262a11 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:47.482747 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a75ae7d-3ba9-4c1f-943c-1275dc262a11 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:47.483195 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a75ae7d-3ba9-4c1f-943c-1275dc262a11 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:47.483979 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a75ae7d-3ba9-4c1f-943c-1275dc262a11 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:47.484428 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a75ae7d-3ba9-4c1f-943c-1275dc262a11 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:47.523343 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4a75ae7d-3ba9-4c1f-943c-1275dc262a11 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052011 Dec 15 12:52:47.523808 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 848/1711] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:47 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:48.534810 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ebf01b39-643e-4d4b-a4e1-8f6c41b1b43a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:48.535887 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ebf01b39-643e-4d4b-a4e1-8f6c41b1b43a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:48.542128 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ebf01b39-643e-4d4b-a4e1-8f6c41b1b43a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:48.542574 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ebf01b39-643e-4d4b-a4e1-8f6c41b1b43a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:48.543352 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ebf01b39-643e-4d4b-a4e1-8f6c41b1b43a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:48.549718 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ebf01b39-643e-4d4b-a4e1-8f6c41b1b43a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:48.580685 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ebf01b39-643e-4d4b-a4e1-8f6c41b1b43a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049976 Dec 15 12:52:48.581223 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 864/1712] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:48 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:52:49.593272 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7734a1ea-19e8-4509-895d-eee68c617219 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:49.594139 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7734a1ea-19e8-4509-895d-eee68c617219 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:49.601123 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7734a1ea-19e8-4509-895d-eee68c617219 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:49.601640 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7734a1ea-19e8-4509-895d-eee68c617219 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:49.602503 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7734a1ea-19e8-4509-895d-eee68c617219 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:49.602994 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7734a1ea-19e8-4509-895d-eee68c617219 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:49.634776 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7734a1ea-19e8-4509-895d-eee68c617219 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045903 Dec 15 12:52:49.635396 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 849/1713] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:49 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:50.646480 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d0d9f7d8-61af-4d76-8f89-12585c24cc34 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:50.647384 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d0d9f7d8-61af-4d76-8f89-12585c24cc34 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:50.653753 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d0d9f7d8-61af-4d76-8f89-12585c24cc34 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:50.654201 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d0d9f7d8-61af-4d76-8f89-12585c24cc34 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:50.654991 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d0d9f7d8-61af-4d76-8f89-12585c24cc34 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:50.655429 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d0d9f7d8-61af-4d76-8f89-12585c24cc34 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:50.688191 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d0d9f7d8-61af-4d76-8f89-12585c24cc34 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045835 Dec 15 12:52:50.688778 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 865/1714] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:50 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:51.699712 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a629296b-f295-4d2f-b8a1-f9fc9a17aaca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:51.700621 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a629296b-f295-4d2f-b8a1-f9fc9a17aaca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:51.706952 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a629296b-f295-4d2f-b8a1-f9fc9a17aaca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:51.707411 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a629296b-f295-4d2f-b8a1-f9fc9a17aaca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:51.708196 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a629296b-f295-4d2f-b8a1-f9fc9a17aaca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:51.708628 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a629296b-f295-4d2f-b8a1-f9fc9a17aaca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:51.739334 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a629296b-f295-4d2f-b8a1-f9fc9a17aaca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042869 Dec 15 12:52:51.739992 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 850/1715] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:51 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:52.750621 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9496946f-ae8d-45fb-b66e-8676e5c4656a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:52.751522 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9496946f-ae8d-45fb-b66e-8676e5c4656a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:52.758410 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9496946f-ae8d-45fb-b66e-8676e5c4656a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:52.758857 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9496946f-ae8d-45fb-b66e-8676e5c4656a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:52.759643 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9496946f-ae8d-45fb-b66e-8676e5c4656a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:52.760073 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9496946f-ae8d-45fb-b66e-8676e5c4656a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:52.790125 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9496946f-ae8d-45fb-b66e-8676e5c4656a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043208 Dec 15 12:52:52.790674 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 866/1716] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:52 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:53.801775 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6e0dc4bb-099a-4ca6-8e04-24fbd424f8db tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:53.802690 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6e0dc4bb-099a-4ca6-8e04-24fbd424f8db tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:53.809084 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6e0dc4bb-099a-4ca6-8e04-24fbd424f8db tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:53.809559 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6e0dc4bb-099a-4ca6-8e04-24fbd424f8db tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:53.810348 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6e0dc4bb-099a-4ca6-8e04-24fbd424f8db tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:53.810785 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6e0dc4bb-099a-4ca6-8e04-24fbd424f8db tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:53.841261 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6e0dc4bb-099a-4ca6-8e04-24fbd424f8db tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043849 Dec 15 12:52:53.841845 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 851/1717] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:53 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:54.852932 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fde87062-9e82-4445-bb6b-4a03deed5634 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:54.853860 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fde87062-9e82-4445-bb6b-4a03deed5634 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:54.860185 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fde87062-9e82-4445-bb6b-4a03deed5634 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:54.860662 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fde87062-9e82-4445-bb6b-4a03deed5634 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:54.861472 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fde87062-9e82-4445-bb6b-4a03deed5634 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:54.861931 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fde87062-9e82-4445-bb6b-4a03deed5634 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:54.892560 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fde87062-9e82-4445-bb6b-4a03deed5634 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043442 Dec 15 12:52:54.893113 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 867/1718] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:54 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:55.904875 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-cfcdfece-529c-40e2-beb9-99776b423be8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:55.905873 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-cfcdfece-529c-40e2-beb9-99776b423be8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:55.912949 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cfcdfece-529c-40e2-beb9-99776b423be8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:55.913388 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cfcdfece-529c-40e2-beb9-99776b423be8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:55.914199 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cfcdfece-529c-40e2-beb9-99776b423be8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:55.914627 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cfcdfece-529c-40e2-beb9-99776b423be8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:55.944728 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cfcdfece-529c-40e2-beb9-99776b423be8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043636 Dec 15 12:52:55.945282 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 852/1719] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:55 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:56.956274 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-767bfc1e-1b89-4836-8372-e1314824166c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:56.957724 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-767bfc1e-1b89-4836-8372-e1314824166c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:56.963906 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-767bfc1e-1b89-4836-8372-e1314824166c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:56.964348 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-767bfc1e-1b89-4836-8372-e1314824166c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:56.965113 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-767bfc1e-1b89-4836-8372-e1314824166c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:56.965561 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-767bfc1e-1b89-4836-8372-e1314824166c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:56.995193 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-767bfc1e-1b89-4836-8372-e1314824166c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042598 Dec 15 12:52:56.995783 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 868/1720] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:56 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:58.007789 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2fedd7be-36f5-4e77-9642-0d410dbf2f8d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:58.008720 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2fedd7be-36f5-4e77-9642-0d410dbf2f8d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:58.014591 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2fedd7be-36f5-4e77-9642-0d410dbf2f8d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:58.015033 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2fedd7be-36f5-4e77-9642-0d410dbf2f8d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:58.015883 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2fedd7be-36f5-4e77-9642-0d410dbf2f8d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:58.016313 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2fedd7be-36f5-4e77-9642-0d410dbf2f8d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:58.048049 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2fedd7be-36f5-4e77-9642-0d410dbf2f8d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044665 Dec 15 12:52:58.048618 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 853/1721] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:58 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:52:58.327269 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 12:52:58.327845 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 12:52:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 12:52:59.060156 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-27006a52-bb04-4166-b3d2-5e8d6a8b5c40 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:52:59.061056 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-27006a52-bb04-4166-b3d2-5e8d6a8b5c40 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:52:59.067912 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-27006a52-bb04-4166-b3d2-5e8d6a8b5c40 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:59.068354 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-27006a52-bb04-4166-b3d2-5e8d6a8b5c40 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:59.069130 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-27006a52-bb04-4166-b3d2-5e8d6a8b5c40 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:52:59.069601 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-27006a52-bb04-4166-b3d2-5e8d6a8b5c40 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:52:59.099343 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-27006a52-bb04-4166-b3d2-5e8d6a8b5c40 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042910 Dec 15 12:52:59.099906 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 869/1722] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:52:59 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:00.111244 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4063c9d1-6d26-41b6-9ed9-f63fcdf7c5d8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:00.112152 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4063c9d1-6d26-41b6-9ed9-f63fcdf7c5d8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:00.119271 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4063c9d1-6d26-41b6-9ed9-f63fcdf7c5d8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:00.119814 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4063c9d1-6d26-41b6-9ed9-f63fcdf7c5d8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:00.120600 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4063c9d1-6d26-41b6-9ed9-f63fcdf7c5d8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:00.121036 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4063c9d1-6d26-41b6-9ed9-f63fcdf7c5d8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:00.156146 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4063c9d1-6d26-41b6-9ed9-f63fcdf7c5d8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048639 Dec 15 12:53:00.156700 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 854/1723] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:00 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:01.167935 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bebafe9d-5c26-4763-bde1-724d5e51b7e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:01.168938 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bebafe9d-5c26-4763-bde1-724d5e51b7e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:01.175118 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bebafe9d-5c26-4763-bde1-724d5e51b7e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:01.175570 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bebafe9d-5c26-4763-bde1-724d5e51b7e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:01.176918 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bebafe9d-5c26-4763-bde1-724d5e51b7e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:01.177451 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bebafe9d-5c26-4763-bde1-724d5e51b7e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:01.206670 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bebafe9d-5c26-4763-bde1-724d5e51b7e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042828 Dec 15 12:53:01.207457 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 870/1724] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:01 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:02.218603 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7ed12e07-d914-46c9-bdfc-eeb3701662ba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:02.219512 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7ed12e07-d914-46c9-bdfc-eeb3701662ba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:02.226635 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7ed12e07-d914-46c9-bdfc-eeb3701662ba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:02.227082 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7ed12e07-d914-46c9-bdfc-eeb3701662ba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:02.227863 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7ed12e07-d914-46c9-bdfc-eeb3701662ba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:02.228299 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7ed12e07-d914-46c9-bdfc-eeb3701662ba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:02.258030 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7ed12e07-d914-46c9-bdfc-eeb3701662ba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043178 Dec 15 12:53:02.258570 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 855/1725] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:02 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:53:03.270429 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-167771b2-71ba-45a8-a573-84c43d51d0db tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:03.271429 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-167771b2-71ba-45a8-a573-84c43d51d0db tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:03.277652 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-167771b2-71ba-45a8-a573-84c43d51d0db tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:03.278099 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-167771b2-71ba-45a8-a573-84c43d51d0db tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:03.278901 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-167771b2-71ba-45a8-a573-84c43d51d0db tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:03.279337 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-167771b2-71ba-45a8-a573-84c43d51d0db tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:03.313955 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-167771b2-71ba-45a8-a573-84c43d51d0db tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047935 Dec 15 12:53:03.314522 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 871/1726] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:03 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:53:04.326108 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9a63f3b9-a9f0-4d89-96b8-eabd60bb70b4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:04.327017 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9a63f3b9-a9f0-4d89-96b8-eabd60bb70b4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:04.333258 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9a63f3b9-a9f0-4d89-96b8-eabd60bb70b4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:04.333792 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9a63f3b9-a9f0-4d89-96b8-eabd60bb70b4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:04.334576 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9a63f3b9-a9f0-4d89-96b8-eabd60bb70b4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:04.335012 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9a63f3b9-a9f0-4d89-96b8-eabd60bb70b4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:04.365910 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9a63f3b9-a9f0-4d89-96b8-eabd60bb70b4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043442 Dec 15 12:53:04.366456 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 856/1727] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:04 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:05.377632 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4377f1d3-2bcc-47f9-b1f1-def8f39665d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:05.378526 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4377f1d3-2bcc-47f9-b1f1-def8f39665d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:05.385482 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4377f1d3-2bcc-47f9-b1f1-def8f39665d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:05.385958 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4377f1d3-2bcc-47f9-b1f1-def8f39665d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:05.386739 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4377f1d3-2bcc-47f9-b1f1-def8f39665d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:05.387281 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4377f1d3-2bcc-47f9-b1f1-def8f39665d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:05.418528 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4377f1d3-2bcc-47f9-b1f1-def8f39665d3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044651 Dec 15 12:53:05.419078 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 872/1728] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:05 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:06.431622 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d0e67a7a-5940-4686-bb6e-8d89a05a9ba8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:06.432826 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d0e67a7a-5940-4686-bb6e-8d89a05a9ba8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:06.440870 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d0e67a7a-5940-4686-bb6e-8d89a05a9ba8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:06.441307 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d0e67a7a-5940-4686-bb6e-8d89a05a9ba8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:06.442131 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d0e67a7a-5940-4686-bb6e-8d89a05a9ba8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:06.442630 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d0e67a7a-5940-4686-bb6e-8d89a05a9ba8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:06.471854 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d0e67a7a-5940-4686-bb6e-8d89a05a9ba8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045190 Dec 15 12:53:06.472406 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 857/1729] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:06 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:07.483966 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fc892ba3-3dc9-4378-b2ea-266e2a1feb56 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:07.484854 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fc892ba3-3dc9-4378-b2ea-266e2a1feb56 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:07.491591 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fc892ba3-3dc9-4378-b2ea-266e2a1feb56 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:07.492030 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fc892ba3-3dc9-4378-b2ea-266e2a1feb56 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:07.492798 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fc892ba3-3dc9-4378-b2ea-266e2a1feb56 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:07.493225 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fc892ba3-3dc9-4378-b2ea-266e2a1feb56 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:07.521936 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fc892ba3-3dc9-4378-b2ea-266e2a1feb56 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041543 Dec 15 12:53:07.522532 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 873/1730] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:07 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:08.533669 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-dde093e6-ccc9-472d-86ff-d306f31c06a5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:08.534579 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-dde093e6-ccc9-472d-86ff-d306f31c06a5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:08.540933 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dde093e6-ccc9-472d-86ff-d306f31c06a5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:08.541377 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dde093e6-ccc9-472d-86ff-d306f31c06a5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:08.542256 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dde093e6-ccc9-472d-86ff-d306f31c06a5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:08.542691 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dde093e6-ccc9-472d-86ff-d306f31c06a5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:08.573602 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-dde093e6-ccc9-472d-86ff-d306f31c06a5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043677 Dec 15 12:53:08.574171 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 858/1731] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:08 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:09.584929 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-cccc4447-2775-49c3-b11f-8471e9e54a5f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:09.585869 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-cccc4447-2775-49c3-b11f-8471e9e54a5f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:09.592164 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cccc4447-2775-49c3-b11f-8471e9e54a5f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:09.592618 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cccc4447-2775-49c3-b11f-8471e9e54a5f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:09.593400 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cccc4447-2775-49c3-b11f-8471e9e54a5f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:09.593872 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cccc4447-2775-49c3-b11f-8471e9e54a5f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:09.631143 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-cccc4447-2775-49c3-b11f-8471e9e54a5f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050022 Dec 15 12:53:09.631708 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 874/1732] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:09 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:10.643163 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-794fe553-d358-4175-b406-831dd34700af tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:10.644080 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-794fe553-d358-4175-b406-831dd34700af tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:10.651604 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-794fe553-d358-4175-b406-831dd34700af tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:10.652049 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-794fe553-d358-4175-b406-831dd34700af tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:10.652888 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-794fe553-d358-4175-b406-831dd34700af tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:10.653332 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-794fe553-d358-4175-b406-831dd34700af tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:10.683993 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-794fe553-d358-4175-b406-831dd34700af tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044664 Dec 15 12:53:10.684546 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 859/1733] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:10 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:11.696369 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-be3acf29-8173-497b-bf08-c5752f60d979 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:11.697373 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-be3acf29-8173-497b-bf08-c5752f60d979 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:11.704138 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-be3acf29-8173-497b-bf08-c5752f60d979 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:11.704588 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-be3acf29-8173-497b-bf08-c5752f60d979 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:11.705445 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-be3acf29-8173-497b-bf08-c5752f60d979 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:11.705987 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-be3acf29-8173-497b-bf08-c5752f60d979 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:11.734476 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-be3acf29-8173-497b-bf08-c5752f60d979 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042792 Dec 15 12:53:11.735025 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 875/1734] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:11 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:12.746260 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b87ae544-34c8-4cbd-bc45-4c5fbf2e992a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:12.747264 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b87ae544-34c8-4cbd-bc45-4c5fbf2e992a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:12.753494 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b87ae544-34c8-4cbd-bc45-4c5fbf2e992a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:12.753966 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b87ae544-34c8-4cbd-bc45-4c5fbf2e992a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:12.754735 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b87ae544-34c8-4cbd-bc45-4c5fbf2e992a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:12.755685 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b87ae544-34c8-4cbd-bc45-4c5fbf2e992a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:12.785520 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b87ae544-34c8-4cbd-bc45-4c5fbf2e992a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042970 Dec 15 12:53:12.786118 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 860/1735] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:12 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:13.800132 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a3a404ef-8bcf-4b8f-9821-b41a2b2ca1b9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:13.801066 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a3a404ef-8bcf-4b8f-9821-b41a2b2ca1b9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:13.807202 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a3a404ef-8bcf-4b8f-9821-b41a2b2ca1b9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:13.807642 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a3a404ef-8bcf-4b8f-9821-b41a2b2ca1b9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:13.808462 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a3a404ef-8bcf-4b8f-9821-b41a2b2ca1b9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:13.808896 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a3a404ef-8bcf-4b8f-9821-b41a2b2ca1b9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:13.848181 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a3a404ef-8bcf-4b8f-9821-b41a2b2ca1b9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052247 Dec 15 12:53:13.849742 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 876/1736] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:13 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:14.860922 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a07aa3d2-f661-479b-98cd-e450250fa720 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:14.861863 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a07aa3d2-f661-479b-98cd-e450250fa720 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:14.869043 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a07aa3d2-f661-479b-98cd-e450250fa720 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:14.869486 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a07aa3d2-f661-479b-98cd-e450250fa720 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:14.870304 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a07aa3d2-f661-479b-98cd-e450250fa720 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:14.870730 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a07aa3d2-f661-479b-98cd-e450250fa720 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:14.900951 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a07aa3d2-f661-479b-98cd-e450250fa720 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043719 Dec 15 12:53:14.901495 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 861/1737] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:14 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:15.912207 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4673104b-416c-49c0-9cbd-e5340669aaee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:15.913185 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4673104b-416c-49c0-9cbd-e5340669aaee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:15.919945 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4673104b-416c-49c0-9cbd-e5340669aaee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:15.920391 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4673104b-416c-49c0-9cbd-e5340669aaee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:15.921181 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4673104b-416c-49c0-9cbd-e5340669aaee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:15.921645 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4673104b-416c-49c0-9cbd-e5340669aaee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:15.952092 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4673104b-416c-49c0-9cbd-e5340669aaee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043736 Dec 15 12:53:15.952650 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 877/1738] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:15 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:16.964439 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b2072d25-eeea-42f5-ae25-97639f78cdcb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:16.965349 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b2072d25-eeea-42f5-ae25-97639f78cdcb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:16.971618 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b2072d25-eeea-42f5-ae25-97639f78cdcb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:16.972060 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b2072d25-eeea-42f5-ae25-97639f78cdcb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:16.972842 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b2072d25-eeea-42f5-ae25-97639f78cdcb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:16.973277 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b2072d25-eeea-42f5-ae25-97639f78cdcb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:17.003003 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b2072d25-eeea-42f5-ae25-97639f78cdcb tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042328 Dec 15 12:53:17.003553 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 862/1739] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:16 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:17.113037 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 12:53:17.113634 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 12:53:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 12:53:18.016487 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0cb93738-f283-4b74-bfc9-56c06f7697a0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:18.017331 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0cb93738-f283-4b74-bfc9-56c06f7697a0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:18.024165 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0cb93738-f283-4b74-bfc9-56c06f7697a0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:18.024615 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0cb93738-f283-4b74-bfc9-56c06f7697a0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:18.025397 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0cb93738-f283-4b74-bfc9-56c06f7697a0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:18.025862 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0cb93738-f283-4b74-bfc9-56c06f7697a0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:18.063391 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0cb93738-f283-4b74-bfc9-56c06f7697a0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050743 Dec 15 12:53:18.063976 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 878/1740] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:18 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:19.074974 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-dd20a3a9-5c3b-4b1e-b126-7823831874bd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:19.075873 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-dd20a3a9-5c3b-4b1e-b126-7823831874bd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:19.082116 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dd20a3a9-5c3b-4b1e-b126-7823831874bd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:19.082626 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dd20a3a9-5c3b-4b1e-b126-7823831874bd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:19.083524 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dd20a3a9-5c3b-4b1e-b126-7823831874bd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:19.083966 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dd20a3a9-5c3b-4b1e-b126-7823831874bd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:19.114290 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-dd20a3a9-5c3b-4b1e-b126-7823831874bd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043018 Dec 15 12:53:19.115356 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 863/1741] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:19 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:53:19.962480 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 12:53:19.962697 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 12:53:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 12:53:20.126408 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ec02224f-9ddc-4736-9099-13c184dc7d63 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:20.127313 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ec02224f-9ddc-4736-9099-13c184dc7d63 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:20.134956 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ec02224f-9ddc-4736-9099-13c184dc7d63 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:20.135406 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ec02224f-9ddc-4736-9099-13c184dc7d63 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:20.136208 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ec02224f-9ddc-4736-9099-13c184dc7d63 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:20.136653 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ec02224f-9ddc-4736-9099-13c184dc7d63 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:20.168154 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ec02224f-9ddc-4736-9099-13c184dc7d63 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045563 Dec 15 12:53:20.168704 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 879/1742] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:20 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:21.180248 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3fa4b923-5812-4e96-a674-cc3160d8bf84 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:21.181159 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3fa4b923-5812-4e96-a674-cc3160d8bf84 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:21.190318 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3fa4b923-5812-4e96-a674-cc3160d8bf84 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:21.191041 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3fa4b923-5812-4e96-a674-cc3160d8bf84 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:21.192309 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3fa4b923-5812-4e96-a674-cc3160d8bf84 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:21.193035 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3fa4b923-5812-4e96-a674-cc3160d8bf84 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:21.225619 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3fa4b923-5812-4e96-a674-cc3160d8bf84 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049530 Dec 15 12:53:21.226185 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 864/1743] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:21 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:22.236965 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-aff7b1ac-d04b-4ad0-83d8-a8830d345042 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:22.237900 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-aff7b1ac-d04b-4ad0-83d8-a8830d345042 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:22.244937 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aff7b1ac-d04b-4ad0-83d8-a8830d345042 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:22.245382 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aff7b1ac-d04b-4ad0-83d8-a8830d345042 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:22.246186 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aff7b1ac-d04b-4ad0-83d8-a8830d345042 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:22.246621 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aff7b1ac-d04b-4ad0-83d8-a8830d345042 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:22.277335 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-aff7b1ac-d04b-4ad0-83d8-a8830d345042 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044127 Dec 15 12:53:22.277934 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 880/1744] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:22 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:23.288322 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9733f34a-f9f4-4c8d-a5bb-357b8f2b1b2a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:23.289210 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9733f34a-f9f4-4c8d-a5bb-357b8f2b1b2a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:23.295422 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9733f34a-f9f4-4c8d-a5bb-357b8f2b1b2a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:23.295864 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9733f34a-f9f4-4c8d-a5bb-357b8f2b1b2a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:23.296639 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9733f34a-f9f4-4c8d-a5bb-357b8f2b1b2a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:23.297069 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9733f34a-f9f4-4c8d-a5bb-357b8f2b1b2a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:23.327926 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9733f34a-f9f4-4c8d-a5bb-357b8f2b1b2a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043332 Dec 15 12:53:23.328496 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 865/1745] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:23 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:24.340263 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2275e506-b5d8-435f-ae6b-92e1cc59621c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:24.341163 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2275e506-b5d8-435f-ae6b-92e1cc59621c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:24.347393 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2275e506-b5d8-435f-ae6b-92e1cc59621c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:24.347844 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2275e506-b5d8-435f-ae6b-92e1cc59621c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:24.348614 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2275e506-b5d8-435f-ae6b-92e1cc59621c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:24.349732 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2275e506-b5d8-435f-ae6b-92e1cc59621c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:24.379444 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2275e506-b5d8-435f-ae6b-92e1cc59621c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042910 Dec 15 12:53:24.379990 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 881/1746] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:24 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:25.391389 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e423b5c4-5082-4e91-9f59-eb0893246a5b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:25.392282 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e423b5c4-5082-4e91-9f59-eb0893246a5b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:25.399068 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e423b5c4-5082-4e91-9f59-eb0893246a5b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:25.399503 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e423b5c4-5082-4e91-9f59-eb0893246a5b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:25.400325 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e423b5c4-5082-4e91-9f59-eb0893246a5b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:25.400763 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e423b5c4-5082-4e91-9f59-eb0893246a5b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:25.432377 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e423b5c4-5082-4e91-9f59-eb0893246a5b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044746 Dec 15 12:53:25.432941 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 866/1747] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:25 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:26.444880 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-66a75c47-f315-45f2-880a-8a2b6bd30f57 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:26.445845 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-66a75c47-f315-45f2-880a-8a2b6bd30f57 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:26.452781 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-66a75c47-f315-45f2-880a-8a2b6bd30f57 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:26.453222 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-66a75c47-f315-45f2-880a-8a2b6bd30f57 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:26.454055 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-66a75c47-f315-45f2-880a-8a2b6bd30f57 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:26.454491 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-66a75c47-f315-45f2-880a-8a2b6bd30f57 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:26.497544 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-66a75c47-f315-45f2-880a-8a2b6bd30f57 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057090 Dec 15 12:53:26.498135 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 882/1748] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:26 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:27.509013 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-16b7464c-0b6d-4978-a9ca-41bfd3752c8f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:27.509934 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-16b7464c-0b6d-4978-a9ca-41bfd3752c8f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:27.515815 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-16b7464c-0b6d-4978-a9ca-41bfd3752c8f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:27.516249 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-16b7464c-0b6d-4978-a9ca-41bfd3752c8f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:27.517011 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-16b7464c-0b6d-4978-a9ca-41bfd3752c8f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:27.517437 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-16b7464c-0b6d-4978-a9ca-41bfd3752c8f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:27.547997 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-16b7464c-0b6d-4978-a9ca-41bfd3752c8f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043427 Dec 15 12:53:27.548591 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 867/1749] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:27 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:28.560447 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-57c08528-df2f-4870-bca3-692fcff8c700 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:28.561344 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-57c08528-df2f-4870-bca3-692fcff8c700 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:28.567600 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-57c08528-df2f-4870-bca3-692fcff8c700 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:28.568033 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-57c08528-df2f-4870-bca3-692fcff8c700 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:28.568804 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-57c08528-df2f-4870-bca3-692fcff8c700 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:28.569226 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-57c08528-df2f-4870-bca3-692fcff8c700 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:28.603000 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-57c08528-df2f-4870-bca3-692fcff8c700 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046281 Dec 15 12:53:28.603547 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 883/1750] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:28 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:29.615280 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-620d4b10-32e6-4294-8a7b-c55ecdc79a9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:29.616279 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-620d4b10-32e6-4294-8a7b-c55ecdc79a9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:29.623195 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-620d4b10-32e6-4294-8a7b-c55ecdc79a9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:29.623720 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-620d4b10-32e6-4294-8a7b-c55ecdc79a9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:29.624570 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-620d4b10-32e6-4294-8a7b-c55ecdc79a9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:29.625065 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-620d4b10-32e6-4294-8a7b-c55ecdc79a9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:29.658488 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-620d4b10-32e6-4294-8a7b-c55ecdc79a9e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047442 Dec 15 12:53:29.659150 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 868/1751] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:29 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:30.671300 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-be85c14d-8940-4b3c-bccd-af16c8e6235c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:30.672233 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-be85c14d-8940-4b3c-bccd-af16c8e6235c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:30.678441 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-be85c14d-8940-4b3c-bccd-af16c8e6235c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:30.679523 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-be85c14d-8940-4b3c-bccd-af16c8e6235c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:30.680304 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-be85c14d-8940-4b3c-bccd-af16c8e6235c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:30.680730 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-be85c14d-8940-4b3c-bccd-af16c8e6235c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:30.712275 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-be85c14d-8940-4b3c-bccd-af16c8e6235c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045169 Dec 15 12:53:30.712837 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 884/1752] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:30 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:31.723194 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0ea5867b-a1cb-4406-a434-590dc5c23c95 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:31.724099 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0ea5867b-a1cb-4406-a434-590dc5c23c95 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:31.731082 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0ea5867b-a1cb-4406-a434-590dc5c23c95 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:31.731519 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0ea5867b-a1cb-4406-a434-590dc5c23c95 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:31.732289 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0ea5867b-a1cb-4406-a434-590dc5c23c95 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:31.732717 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0ea5867b-a1cb-4406-a434-590dc5c23c95 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:31.761679 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0ea5867b-a1cb-4406-a434-590dc5c23c95 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042269 Dec 15 12:53:31.762257 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 869/1753] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:31 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:32.774809 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e5ddf2c6-5571-4797-b20a-3ff59f741443 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:32.775710 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e5ddf2c6-5571-4797-b20a-3ff59f741443 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:32.781924 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e5ddf2c6-5571-4797-b20a-3ff59f741443 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:32.782370 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e5ddf2c6-5571-4797-b20a-3ff59f741443 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:32.783142 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e5ddf2c6-5571-4797-b20a-3ff59f741443 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:32.783571 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e5ddf2c6-5571-4797-b20a-3ff59f741443 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:32.811798 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e5ddf2c6-5571-4797-b20a-3ff59f741443 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041345 Dec 15 12:53:32.812387 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 885/1754] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:32 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:33.822997 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-942dab24-a5e1-42a3-820f-b817f3c37f2b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:33.823899 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-942dab24-a5e1-42a3-820f-b817f3c37f2b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:33.830439 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-942dab24-a5e1-42a3-820f-b817f3c37f2b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:33.830720 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-942dab24-a5e1-42a3-820f-b817f3c37f2b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:33.831499 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-942dab24-a5e1-42a3-820f-b817f3c37f2b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:33.831930 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-942dab24-a5e1-42a3-820f-b817f3c37f2b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:33.863336 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-942dab24-a5e1-42a3-820f-b817f3c37f2b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044286 Dec 15 12:53:33.863937 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 870/1755] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:33 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:34.875015 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7bfcb866-576e-4903-ba60-64ecd6658a8d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:34.875926 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7bfcb866-576e-4903-ba60-64ecd6658a8d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:34.882751 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7bfcb866-576e-4903-ba60-64ecd6658a8d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:34.883195 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7bfcb866-576e-4903-ba60-64ecd6658a8d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:34.883970 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7bfcb866-576e-4903-ba60-64ecd6658a8d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:34.884401 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7bfcb866-576e-4903-ba60-64ecd6658a8d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:34.916060 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7bfcb866-576e-4903-ba60-64ecd6658a8d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044816 Dec 15 12:53:34.916614 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 886/1756] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:34 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:35.927872 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-395803a8-8889-43ca-89d9-b922e2fa0896 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:35.929321 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-395803a8-8889-43ca-89d9-b922e2fa0896 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:35.935942 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-395803a8-8889-43ca-89d9-b922e2fa0896 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:35.936416 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-395803a8-8889-43ca-89d9-b922e2fa0896 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:35.937215 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-395803a8-8889-43ca-89d9-b922e2fa0896 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:35.937679 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-395803a8-8889-43ca-89d9-b922e2fa0896 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:35.977903 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-395803a8-8889-43ca-89d9-b922e2fa0896 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053994 Dec 15 12:53:35.978499 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 871/1757] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:35 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:36.989561 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4e6892cf-eb4d-40ce-8a96-aa716a0b75b9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:36.990473 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4e6892cf-eb4d-40ce-8a96-aa716a0b75b9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:36.996937 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4e6892cf-eb4d-40ce-8a96-aa716a0b75b9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:36.997390 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4e6892cf-eb4d-40ce-8a96-aa716a0b75b9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:36.998238 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4e6892cf-eb4d-40ce-8a96-aa716a0b75b9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:36.998679 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4e6892cf-eb4d-40ce-8a96-aa716a0b75b9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:37.027973 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4e6892cf-eb4d-40ce-8a96-aa716a0b75b9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042332 Dec 15 12:53:37.028530 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 887/1758] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:36 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:38.040345 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d438dfba-31dd-4e1f-b3cc-4911ba38c256 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:38.041244 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d438dfba-31dd-4e1f-b3cc-4911ba38c256 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:38.048501 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d438dfba-31dd-4e1f-b3cc-4911ba38c256 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:38.048952 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d438dfba-31dd-4e1f-b3cc-4911ba38c256 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:38.049785 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d438dfba-31dd-4e1f-b3cc-4911ba38c256 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:38.050221 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d438dfba-31dd-4e1f-b3cc-4911ba38c256 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:38.089378 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d438dfba-31dd-4e1f-b3cc-4911ba38c256 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053251 Dec 15 12:53:38.089894 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 872/1759] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:38 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:39.101890 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0b50421e-78ac-498c-bce7-2dace1f6d725 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:39.102795 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0b50421e-78ac-498c-bce7-2dace1f6d725 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:39.108954 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0b50421e-78ac-498c-bce7-2dace1f6d725 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:39.109422 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0b50421e-78ac-498c-bce7-2dace1f6d725 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:39.110217 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0b50421e-78ac-498c-bce7-2dace1f6d725 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:39.110653 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0b50421e-78ac-498c-bce7-2dace1f6d725 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:39.142192 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0b50421e-78ac-498c-bce7-2dace1f6d725 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044197 Dec 15 12:53:39.142748 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 888/1760] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:39 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:40.153881 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a52b3751-2427-4ccf-ba3d-db904f769cda tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:40.154779 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a52b3751-2427-4ccf-ba3d-db904f769cda tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:40.161121 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a52b3751-2427-4ccf-ba3d-db904f769cda tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:40.161605 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a52b3751-2427-4ccf-ba3d-db904f769cda tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:40.162394 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a52b3751-2427-4ccf-ba3d-db904f769cda tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:40.162818 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a52b3751-2427-4ccf-ba3d-db904f769cda tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:40.193565 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a52b3751-2427-4ccf-ba3d-db904f769cda tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043285 Dec 15 12:53:40.194039 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 873/1761] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:40 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:41.206076 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a6e08e67-9fe5-4dc6-b62b-e59304d1e1d8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:41.206991 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a6e08e67-9fe5-4dc6-b62b-e59304d1e1d8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:41.213666 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a6e08e67-9fe5-4dc6-b62b-e59304d1e1d8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:41.214208 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a6e08e67-9fe5-4dc6-b62b-e59304d1e1d8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:41.214898 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a6e08e67-9fe5-4dc6-b62b-e59304d1e1d8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:41.215331 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a6e08e67-9fe5-4dc6-b62b-e59304d1e1d8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:41.244272 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a6e08e67-9fe5-4dc6-b62b-e59304d1e1d8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042059 Dec 15 12:53:41.244816 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 889/1762] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:41 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:53:42.255926 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2bdde8cb-619b-4c32-8ec8-e2f57e4b9971 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:42.256832 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2bdde8cb-619b-4c32-8ec8-e2f57e4b9971 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:42.264219 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2bdde8cb-619b-4c32-8ec8-e2f57e4b9971 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:42.264700 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2bdde8cb-619b-4c32-8ec8-e2f57e4b9971 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:42.265492 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2bdde8cb-619b-4c32-8ec8-e2f57e4b9971 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:42.266024 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2bdde8cb-619b-4c32-8ec8-e2f57e4b9971 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:42.295526 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2bdde8cb-619b-4c32-8ec8-e2f57e4b9971 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043244 Dec 15 12:53:42.296122 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 874/1763] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:42 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:43.308042 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0c55c403-5b44-49d1-9f23-df390fb6f788 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:43.308942 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0c55c403-5b44-49d1-9f23-df390fb6f788 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:43.315106 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0c55c403-5b44-49d1-9f23-df390fb6f788 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:43.315545 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0c55c403-5b44-49d1-9f23-df390fb6f788 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:43.316309 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0c55c403-5b44-49d1-9f23-df390fb6f788 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:43.316734 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0c55c403-5b44-49d1-9f23-df390fb6f788 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:43.346451 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0c55c403-5b44-49d1-9f23-df390fb6f788 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042917 Dec 15 12:53:43.347022 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 890/1764] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:43 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:44.358041 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9beb87b5-63f9-4018-8732-76e3858f5868 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:44.358949 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9beb87b5-63f9-4018-8732-76e3858f5868 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:44.365235 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9beb87b5-63f9-4018-8732-76e3858f5868 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:44.365718 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9beb87b5-63f9-4018-8732-76e3858f5868 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:44.366501 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9beb87b5-63f9-4018-8732-76e3858f5868 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:44.366938 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9beb87b5-63f9-4018-8732-76e3858f5868 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:44.398851 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9beb87b5-63f9-4018-8732-76e3858f5868 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044397 Dec 15 12:53:44.399424 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 875/1765] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:44 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:45.410410 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-96a94a18-7a3b-402d-8ae6-779a949c44d9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:45.411340 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-96a94a18-7a3b-402d-8ae6-779a949c44d9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:45.418211 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-96a94a18-7a3b-402d-8ae6-779a949c44d9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:45.418651 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-96a94a18-7a3b-402d-8ae6-779a949c44d9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:45.419419 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-96a94a18-7a3b-402d-8ae6-779a949c44d9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:45.419886 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-96a94a18-7a3b-402d-8ae6-779a949c44d9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:45.451083 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-96a94a18-7a3b-402d-8ae6-779a949c44d9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044348 Dec 15 12:53:45.451654 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 891/1766] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:45 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:46.462866 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-68366fff-185a-44d3-b19e-7c6833d911e1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:46.463786 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-68366fff-185a-44d3-b19e-7c6833d911e1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:46.470524 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-68366fff-185a-44d3-b19e-7c6833d911e1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:46.470969 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-68366fff-185a-44d3-b19e-7c6833d911e1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:46.471780 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-68366fff-185a-44d3-b19e-7c6833d911e1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:46.472213 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-68366fff-185a-44d3-b19e-7c6833d911e1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:46.502642 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-68366fff-185a-44d3-b19e-7c6833d911e1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043837 Dec 15 12:53:46.503206 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 876/1767] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:46 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:47.514878 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2aff4297-f19b-457a-b1d5-ecdea858a272 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:47.515800 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2aff4297-f19b-457a-b1d5-ecdea858a272 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:47.522035 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2aff4297-f19b-457a-b1d5-ecdea858a272 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:47.522482 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2aff4297-f19b-457a-b1d5-ecdea858a272 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:47.523503 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2aff4297-f19b-457a-b1d5-ecdea858a272 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:47.523722 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2aff4297-f19b-457a-b1d5-ecdea858a272 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:47.553814 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2aff4297-f19b-457a-b1d5-ecdea858a272 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042614 Dec 15 12:53:47.555102 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 892/1768] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:47 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:48.566081 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-db61fde2-29df-424c-9e38-46a873eac3f8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:48.566981 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-db61fde2-29df-424c-9e38-46a873eac3f8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:48.574475 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-db61fde2-29df-424c-9e38-46a873eac3f8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:48.574951 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-db61fde2-29df-424c-9e38-46a873eac3f8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:48.575728 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-db61fde2-29df-424c-9e38-46a873eac3f8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:48.576155 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-db61fde2-29df-424c-9e38-46a873eac3f8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:48.606223 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-db61fde2-29df-424c-9e38-46a873eac3f8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043921 Dec 15 12:53:48.606786 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 877/1769] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:48 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:49.618629 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-79feb41a-b475-4089-90f1-b89967d6848c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:49.619530 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-79feb41a-b475-4089-90f1-b89967d6848c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:49.626200 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-79feb41a-b475-4089-90f1-b89967d6848c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:49.626645 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-79feb41a-b475-4089-90f1-b89967d6848c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:49.627426 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-79feb41a-b475-4089-90f1-b89967d6848c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:49.627859 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-79feb41a-b475-4089-90f1-b89967d6848c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:49.658961 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-79feb41a-b475-4089-90f1-b89967d6848c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044526 Dec 15 12:53:49.659518 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 893/1770] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:49 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:50.671203 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-abbc6cf7-09c1-4a3d-8e29-328fdca05f76 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:50.672096 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-abbc6cf7-09c1-4a3d-8e29-328fdca05f76 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:50.678365 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-abbc6cf7-09c1-4a3d-8e29-328fdca05f76 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:50.678805 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-abbc6cf7-09c1-4a3d-8e29-328fdca05f76 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:50.679720 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-abbc6cf7-09c1-4a3d-8e29-328fdca05f76 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:50.680150 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-abbc6cf7-09c1-4a3d-8e29-328fdca05f76 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:50.712617 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-abbc6cf7-09c1-4a3d-8e29-328fdca05f76 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045195 Dec 15 12:53:50.713217 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 878/1771] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:50 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:51.724222 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4aa57669-5421-4627-aa9a-ab83c4583ed8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:51.725051 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4aa57669-5421-4627-aa9a-ab83c4583ed8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:51.738944 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4aa57669-5421-4627-aa9a-ab83c4583ed8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:51.739528 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4aa57669-5421-4627-aa9a-ab83c4583ed8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:51.740379 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4aa57669-5421-4627-aa9a-ab83c4583ed8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:51.740824 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4aa57669-5421-4627-aa9a-ab83c4583ed8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:51.770220 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4aa57669-5421-4627-aa9a-ab83c4583ed8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049747 Dec 15 12:53:51.770750 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 894/1772] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:51 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:52.781074 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-edbe8570-46df-4c11-bab2-21d81d2f190a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:52.782000 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-edbe8570-46df-4c11-bab2-21d81d2f190a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:52.788273 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-edbe8570-46df-4c11-bab2-21d81d2f190a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:52.788780 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-edbe8570-46df-4c11-bab2-21d81d2f190a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:52.789822 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-edbe8570-46df-4c11-bab2-21d81d2f190a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:52.790256 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-edbe8570-46df-4c11-bab2-21d81d2f190a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:52.819450 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-edbe8570-46df-4c11-bab2-21d81d2f190a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042121 Dec 15 12:53:52.827617 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 879/1773] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:52 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:53.839345 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f37b43b8-3997-49ef-836a-8e898d85c7c8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:53.840247 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f37b43b8-3997-49ef-836a-8e898d85c7c8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:53.846515 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f37b43b8-3997-49ef-836a-8e898d85c7c8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:53.846946 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f37b43b8-3997-49ef-836a-8e898d85c7c8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:53.847723 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f37b43b8-3997-49ef-836a-8e898d85c7c8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:53.848155 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f37b43b8-3997-49ef-836a-8e898d85c7c8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:53.878059 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f37b43b8-3997-49ef-836a-8e898d85c7c8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043149 Dec 15 12:53:53.878618 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 895/1774] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:53 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:54.890213 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4ed39f43-1baa-4ae8-9bb0-418472202c03 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:54.891044 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4ed39f43-1baa-4ae8-9bb0-418472202c03 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:54.897296 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4ed39f43-1baa-4ae8-9bb0-418472202c03 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:54.897778 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4ed39f43-1baa-4ae8-9bb0-418472202c03 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:54.898647 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4ed39f43-1baa-4ae8-9bb0-418472202c03 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:54.899080 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4ed39f43-1baa-4ae8-9bb0-418472202c03 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:54.937109 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4ed39f43-1baa-4ae8-9bb0-418472202c03 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050729 Dec 15 12:53:54.937714 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 880/1775] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:54 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:55.948416 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b76bab82-a629-489e-a435-6b4bb68a4608 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:55.949342 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b76bab82-a629-489e-a435-6b4bb68a4608 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:55.956295 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b76bab82-a629-489e-a435-6b4bb68a4608 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:55.956736 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b76bab82-a629-489e-a435-6b4bb68a4608 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:55.957532 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b76bab82-a629-489e-a435-6b4bb68a4608 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:55.957977 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b76bab82-a629-489e-a435-6b4bb68a4608 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:55.987376 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b76bab82-a629-489e-a435-6b4bb68a4608 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043284 Dec 15 12:53:55.987916 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 896/1776] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:55 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:56.999016 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3471f0a5-280e-47c7-a264-2ef9b0829a5d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:56.999902 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3471f0a5-280e-47c7-a264-2ef9b0829a5d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:57.006192 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3471f0a5-280e-47c7-a264-2ef9b0829a5d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:57.006678 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3471f0a5-280e-47c7-a264-2ef9b0829a5d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:57.007939 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3471f0a5-280e-47c7-a264-2ef9b0829a5d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:57.008377 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3471f0a5-280e-47c7-a264-2ef9b0829a5d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:57.041585 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3471f0a5-280e-47c7-a264-2ef9b0829a5d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046064 Dec 15 12:53:57.042175 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 881/1777] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:56 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:58.052198 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7c61251f-0121-42b5-8969-eb3133fe6db5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:58.053137 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7c61251f-0121-42b5-8969-eb3133fe6db5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:58.060072 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7c61251f-0121-42b5-8969-eb3133fe6db5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:58.060521 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7c61251f-0121-42b5-8969-eb3133fe6db5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:58.061301 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7c61251f-0121-42b5-8969-eb3133fe6db5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:58.061767 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7c61251f-0121-42b5-8969-eb3133fe6db5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:58.092293 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7c61251f-0121-42b5-8969-eb3133fe6db5 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043726 Dec 15 12:53:58.092757 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 897/1778] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:58 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:53:59.104212 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a31b7020-f60c-43e1-9e27-660f979092f0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:53:59.105238 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a31b7020-f60c-43e1-9e27-660f979092f0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:53:59.110974 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a31b7020-f60c-43e1-9e27-660f979092f0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:59.111426 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a31b7020-f60c-43e1-9e27-660f979092f0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:59.112903 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a31b7020-f60c-43e1-9e27-660f979092f0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:53:59.113564 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a31b7020-f60c-43e1-9e27-660f979092f0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:53:59.145475 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a31b7020-f60c-43e1-9e27-660f979092f0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045456 Dec 15 12:53:59.146051 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 882/1779] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:53:59 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:54:00.158030 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-87ff645e-0091-4497-b51c-ec1b423797c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:00.158943 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-87ff645e-0091-4497-b51c-ec1b423797c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:00.165535 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-87ff645e-0091-4497-b51c-ec1b423797c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:00.165988 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-87ff645e-0091-4497-b51c-ec1b423797c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:00.166774 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-87ff645e-0091-4497-b51c-ec1b423797c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:00.167203 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-87ff645e-0091-4497-b51c-ec1b423797c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:00.196801 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-87ff645e-0091-4497-b51c-ec1b423797c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042668 Dec 15 12:54:00.197360 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 898/1780] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:54:00 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:54:01.208975 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6e580fd1-84b2-4215-a9ba-86b327f14198 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:01.210423 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6e580fd1-84b2-4215-a9ba-86b327f14198 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:01.218969 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6e580fd1-84b2-4215-a9ba-86b327f14198 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:01.219414 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6e580fd1-84b2-4215-a9ba-86b327f14198 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:01.220210 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6e580fd1-84b2-4215-a9ba-86b327f14198 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:01.220640 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6e580fd1-84b2-4215-a9ba-86b327f14198 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:01.251613 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6e580fd1-84b2-4215-a9ba-86b327f14198 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047077 Dec 15 12:54:01.252169 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 883/1781] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:54:01 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:54:02.263969 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-458e37f4-1a08-4e87-a752-22f4949809af tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:02.264879 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-458e37f4-1a08-4e87-a752-22f4949809af tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:02.271208 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-458e37f4-1a08-4e87-a752-22f4949809af tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:02.271658 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-458e37f4-1a08-4e87-a752-22f4949809af tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:02.272441 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-458e37f4-1a08-4e87-a752-22f4949809af tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:02.272955 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-458e37f4-1a08-4e87-a752-22f4949809af tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:02.302055 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-458e37f4-1a08-4e87-a752-22f4949809af tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041842 Dec 15 12:54:02.302620 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 899/1782] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:54:02 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:54:03.314244 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-21c5c8bd-3a43-431d-b450-21d4ec4f68e6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:03.315183 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-21c5c8bd-3a43-431d-b450-21d4ec4f68e6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:03.322212 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-21c5c8bd-3a43-431d-b450-21d4ec4f68e6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:03.322663 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-21c5c8bd-3a43-431d-b450-21d4ec4f68e6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:03.323447 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-21c5c8bd-3a43-431d-b450-21d4ec4f68e6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:03.323890 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-21c5c8bd-3a43-431d-b450-21d4ec4f68e6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:03.356982 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-21c5c8bd-3a43-431d-b450-21d4ec4f68e6 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046401 Dec 15 12:54:03.357602 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 884/1783] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:54:03 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:54:04.368534 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-641fd41c-e08d-42b4-943c-590e8a0d00c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:04.369527 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-641fd41c-e08d-42b4-943c-590e8a0d00c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:04.375815 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-641fd41c-e08d-42b4-943c-590e8a0d00c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:04.376265 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-641fd41c-e08d-42b4-943c-590e8a0d00c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:04.377050 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-641fd41c-e08d-42b4-943c-590e8a0d00c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:04.377482 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-641fd41c-e08d-42b4-943c-590e8a0d00c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:04.408497 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-641fd41c-e08d-42b4-943c-590e8a0d00c3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043667 Dec 15 12:54:04.409055 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 900/1784] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:54:04 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:54:05.420396 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-491abb88-57a5-4a01-bd12-cb2f013be547 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:05.421331 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-491abb88-57a5-4a01-bd12-cb2f013be547 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:05.427563 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-491abb88-57a5-4a01-bd12-cb2f013be547 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:05.428013 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-491abb88-57a5-4a01-bd12-cb2f013be547 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:05.428795 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-491abb88-57a5-4a01-bd12-cb2f013be547 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:05.429285 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-491abb88-57a5-4a01-bd12-cb2f013be547 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:05.459248 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-491abb88-57a5-4a01-bd12-cb2f013be547 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042569 Dec 15 12:54:05.459800 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 885/1785] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:54:05 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:54:06.471277 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7ac74655-a030-4fc1-9f48-25ada9ebf756 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:06.472203 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7ac74655-a030-4fc1-9f48-25ada9ebf756 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:06.480704 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7ac74655-a030-4fc1-9f48-25ada9ebf756 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:06.481148 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7ac74655-a030-4fc1-9f48-25ada9ebf756 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:06.482007 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7ac74655-a030-4fc1-9f48-25ada9ebf756 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:06.482440 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7ac74655-a030-4fc1-9f48-25ada9ebf756 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:06.512744 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7ac74655-a030-4fc1-9f48-25ada9ebf756 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045157 Dec 15 12:54:06.513286 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 901/1786] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:54:06 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:54:07.525271 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b1b72ff5-ecad-4189-ae55-3e153058eeca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:07.526219 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b1b72ff5-ecad-4189-ae55-3e153058eeca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:07.532495 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1b72ff5-ecad-4189-ae55-3e153058eeca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:07.532936 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1b72ff5-ecad-4189-ae55-3e153058eeca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:07.533741 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1b72ff5-ecad-4189-ae55-3e153058eeca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:07.534167 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1b72ff5-ecad-4189-ae55-3e153058eeca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:07.563233 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b1b72ff5-ecad-4189-ae55-3e153058eeca tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042668 Dec 15 12:54:07.563694 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 886/1787] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:54:07 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:54:08.574402 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f1a0ecc0-4e10-40f7-a157-5da3a3f2b9c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:08.575352 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f1a0ecc0-4e10-40f7-a157-5da3a3f2b9c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:08.581581 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f1a0ecc0-4e10-40f7-a157-5da3a3f2b9c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:08.582057 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f1a0ecc0-4e10-40f7-a157-5da3a3f2b9c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:08.582840 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f1a0ecc0-4e10-40f7-a157-5da3a3f2b9c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:08.583282 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f1a0ecc0-4e10-40f7-a157-5da3a3f2b9c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:08.613217 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f1a0ecc0-4e10-40f7-a157-5da3a3f2b9c1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042540 Dec 15 12:54:08.613843 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 902/1788] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:54:08 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:54:09.625317 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-53b43720-0af9-4def-b81a-2c156d07d7b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:09.626256 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-53b43720-0af9-4def-b81a-2c156d07d7b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:09.632964 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-53b43720-0af9-4def-b81a-2c156d07d7b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:09.633415 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-53b43720-0af9-4def-b81a-2c156d07d7b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:09.634226 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-53b43720-0af9-4def-b81a-2c156d07d7b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:09.634672 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-53b43720-0af9-4def-b81a-2c156d07d7b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:09.668755 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-53b43720-0af9-4def-b81a-2c156d07d7b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047134 Dec 15 12:54:09.669324 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 887/1789] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:54:09 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:54:10.243746 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-155895ee-e12f-49d9-9adc-03007d685eb7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:10.244269 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-155895ee-e12f-49d9-9adc-03007d685eb7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:10.250463 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-155895ee-e12f-49d9-9adc-03007d685eb7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:10.250916 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-155895ee-e12f-49d9-9adc-03007d685eb7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:10.251705 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-155895ee-e12f-49d9-9adc-03007d685eb7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:10.252143 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-155895ee-e12f-49d9-9adc-03007d685eb7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:10.279882 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-155895ee-e12f-49d9-9adc-03007d685eb7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Going to try to terminate instance {{(pid=122614) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 12:54:10.370567 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-155895ee-e12f-49d9-9adc-03007d685eb7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "DELETE /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 204 len: 0 microversion: 2.1 time: 0.130074 Dec 15 12:54:10.371413 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 903/1790] 10.222.0.76 () {58 vars in 1238 bytes} [Wed Dec 15 12:54:10 2021] DELETE /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 12:54:10.379320 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6c0bd2ba-3d22-4e3b-a8df-f08ee1bea5a2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:10.380027 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6c0bd2ba-3d22-4e3b-a8df-f08ee1bea5a2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:10.387219 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6c0bd2ba-3d22-4e3b-a8df-f08ee1bea5a2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:10.387658 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6c0bd2ba-3d22-4e3b-a8df-f08ee1bea5a2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:10.388442 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6c0bd2ba-3d22-4e3b-a8df-f08ee1bea5a2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:10.388867 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6c0bd2ba-3d22-4e3b-a8df-f08ee1bea5a2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:10.635010 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6c0bd2ba-3d22-4e3b-a8df-f08ee1bea5a2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:10.644599 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6c0bd2ba-3d22-4e3b-a8df-f08ee1bea5a2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.268562 Dec 15 12:54:10.645302 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 888/1791] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:10 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:10.681595 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-650515f7-a527-41af-8650-3ca36b29083c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:10.682603 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-650515f7-a527-41af-8650-3ca36b29083c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:10.688432 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-650515f7-a527-41af-8650-3ca36b29083c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:10.688882 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-650515f7-a527-41af-8650-3ca36b29083c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:10.689711 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-650515f7-a527-41af-8650-3ca36b29083c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:10.690155 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-650515f7-a527-41af-8650-3ca36b29083c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:10.727837 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-650515f7-a527-41af-8650-3ca36b29083c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050806 Dec 15 12:54:10.728306 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 904/1792] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:54:10 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:54:11.662546 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5a2ac836-789f-4fa1-84f4-5866c89e9509 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:11.663164 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5a2ac836-789f-4fa1-84f4-5866c89e9509 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:11.670145 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5a2ac836-789f-4fa1-84f4-5866c89e9509 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:11.670590 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5a2ac836-789f-4fa1-84f4-5866c89e9509 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:11.671371 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5a2ac836-789f-4fa1-84f4-5866c89e9509 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:11.671804 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5a2ac836-789f-4fa1-84f4-5866c89e9509 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:11.741009 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-efc95832-d9a5-4235-8745-aa3b6733ea01 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:11.742057 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-efc95832-d9a5-4235-8745-aa3b6733ea01 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:11.748528 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-efc95832-d9a5-4235-8745-aa3b6733ea01 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:11.748973 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-efc95832-d9a5-4235-8745-aa3b6733ea01 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:11.749819 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-efc95832-d9a5-4235-8745-aa3b6733ea01 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:11.750257 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-efc95832-d9a5-4235-8745-aa3b6733ea01 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:11.783322 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-efc95832-d9a5-4235-8745-aa3b6733ea01 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047784 Dec 15 12:54:11.783894 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 905/1793] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:54:11 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:54:11.811169 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5a2ac836-789f-4fa1-84f4-5866c89e9509 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:11.818907 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5a2ac836-789f-4fa1-84f4-5866c89e9509 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.160078 Dec 15 12:54:11.819467 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 889/1794] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:11 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:12.795497 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-343b019a-6d3a-4a23-a97a-099d2fc3999a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:12.796390 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-343b019a-6d3a-4a23-a97a-099d2fc3999a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:12.802515 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-343b019a-6d3a-4a23-a97a-099d2fc3999a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:12.802957 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-343b019a-6d3a-4a23-a97a-099d2fc3999a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:12.803731 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-343b019a-6d3a-4a23-a97a-099d2fc3999a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:12.804999 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-343b019a-6d3a-4a23-a97a-099d2fc3999a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:12.833854 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-343b019a-6d3a-4a23-a97a-099d2fc3999a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041893 Dec 15 12:54:12.834351 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 906/1795] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:54:12 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:54:12.836979 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7ff2b589-c5d5-4643-acf6-2ad9bc9ce8ec tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:12.837636 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7ff2b589-c5d5-4643-acf6-2ad9bc9ce8ec tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:12.843964 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7ff2b589-c5d5-4643-acf6-2ad9bc9ce8ec tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:12.844412 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7ff2b589-c5d5-4643-acf6-2ad9bc9ce8ec tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:12.845205 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7ff2b589-c5d5-4643-acf6-2ad9bc9ce8ec tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:12.845678 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7ff2b589-c5d5-4643-acf6-2ad9bc9ce8ec tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:12.980293 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7ff2b589-c5d5-4643-acf6-2ad9bc9ce8ec tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:12.988506 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7ff2b589-c5d5-4643-acf6-2ad9bc9ce8ec tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.156073 Dec 15 12:54:12.989106 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 890/1796] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:12 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:54:13.846179 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2fd34e0f-b3ed-4c8c-8b36-c01262bbb531 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:13.847083 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2fd34e0f-b3ed-4c8c-8b36-c01262bbb531 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:13.854050 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2fd34e0f-b3ed-4c8c-8b36-c01262bbb531 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:13.854608 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2fd34e0f-b3ed-4c8c-8b36-c01262bbb531 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:13.855290 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2fd34e0f-b3ed-4c8c-8b36-c01262bbb531 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:13.855730 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2fd34e0f-b3ed-4c8c-8b36-c01262bbb531 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:13.886060 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2fd34e0f-b3ed-4c8c-8b36-c01262bbb531 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043545 Dec 15 12:54:13.886543 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 907/1797] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:54:13 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:54:14.005792 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5ea5fd64-dddf-4169-8d08-75d2f7c88ef4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:14.006411 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5ea5fd64-dddf-4169-8d08-75d2f7c88ef4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:14.013531 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ea5fd64-dddf-4169-8d08-75d2f7c88ef4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:14.013986 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ea5fd64-dddf-4169-8d08-75d2f7c88ef4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:14.014771 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ea5fd64-dddf-4169-8d08-75d2f7c88ef4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:14.015205 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ea5fd64-dddf-4169-8d08-75d2f7c88ef4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:14.151282 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5ea5fd64-dddf-4169-8d08-75d2f7c88ef4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:14.159415 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5ea5fd64-dddf-4169-8d08-75d2f7c88ef4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.157275 Dec 15 12:54:14.159983 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 891/1798] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:14 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:14.898358 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ae4c7ddd-4ef6-4758-b3a9-7b932488f73c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:14.899452 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ae4c7ddd-4ef6-4758-b3a9-7b932488f73c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:14.905642 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ae4c7ddd-4ef6-4758-b3a9-7b932488f73c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:14.906093 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ae4c7ddd-4ef6-4758-b3a9-7b932488f73c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:14.906883 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ae4c7ddd-4ef6-4758-b3a9-7b932488f73c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:14.907323 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ae4c7ddd-4ef6-4758-b3a9-7b932488f73c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:14.937837 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ae4c7ddd-4ef6-4758-b3a9-7b932488f73c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043868 Dec 15 12:54:14.938400 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 908/1799] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:54:14 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:54:15.176171 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ad2cd004-0cd0-41f2-9e4d-c2b49d2ab1ea tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:15.176803 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ad2cd004-0cd0-41f2-9e4d-c2b49d2ab1ea tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:15.184229 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad2cd004-0cd0-41f2-9e4d-c2b49d2ab1ea tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:15.184684 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad2cd004-0cd0-41f2-9e4d-c2b49d2ab1ea tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:15.185528 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad2cd004-0cd0-41f2-9e4d-c2b49d2ab1ea tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:15.185974 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad2cd004-0cd0-41f2-9e4d-c2b49d2ab1ea tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:15.326385 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ad2cd004-0cd0-41f2-9e4d-c2b49d2ab1ea tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:15.336195 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ad2cd004-0cd0-41f2-9e4d-c2b49d2ab1ea tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.162823 Dec 15 12:54:15.336831 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 892/1800] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:15 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:15.950134 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6a6299f3-932c-414e-ba0f-63dcb639173c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:15.951043 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6a6299f3-932c-414e-ba0f-63dcb639173c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:15.957642 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6a6299f3-932c-414e-ba0f-63dcb639173c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:15.958090 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6a6299f3-932c-414e-ba0f-63dcb639173c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:15.958893 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6a6299f3-932c-414e-ba0f-63dcb639173c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:15.959333 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6a6299f3-932c-414e-ba0f-63dcb639173c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:15.989389 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6a6299f3-932c-414e-ba0f-63dcb639173c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043023 Dec 15 12:54:15.989976 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 909/1801] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:54:15 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:54:16.354023 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-141cf8aa-8385-49ac-b138-a5e552d83708 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:16.354642 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-141cf8aa-8385-49ac-b138-a5e552d83708 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:16.360947 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-141cf8aa-8385-49ac-b138-a5e552d83708 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:16.361393 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-141cf8aa-8385-49ac-b138-a5e552d83708 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:16.362205 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-141cf8aa-8385-49ac-b138-a5e552d83708 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:16.362642 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-141cf8aa-8385-49ac-b138-a5e552d83708 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:16.500323 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-141cf8aa-8385-49ac-b138-a5e552d83708 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:16.508574 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-141cf8aa-8385-49ac-b138-a5e552d83708 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.158731 Dec 15 12:54:16.509140 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 893/1802] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:16 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:17.001799 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-77844254-d418-436f-9e15-718b15dc226e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:17.002729 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-77844254-d418-436f-9e15-718b15dc226e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:17.010025 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-77844254-d418-436f-9e15-718b15dc226e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:17.010465 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-77844254-d418-436f-9e15-718b15dc226e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:17.011246 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-77844254-d418-436f-9e15-718b15dc226e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:17.011673 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-77844254-d418-436f-9e15-718b15dc226e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:17.040802 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-77844254-d418-436f-9e15-718b15dc226e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042961 Dec 15 12:54:17.041359 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 910/1803] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:54:16 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:54:17.525730 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-02af54f4-a48b-4ccf-85a2-cac9880ecff9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:17.526382 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-02af54f4-a48b-4ccf-85a2-cac9880ecff9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:17.532793 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-02af54f4-a48b-4ccf-85a2-cac9880ecff9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:17.533242 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-02af54f4-a48b-4ccf-85a2-cac9880ecff9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:17.534065 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-02af54f4-a48b-4ccf-85a2-cac9880ecff9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:17.534534 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-02af54f4-a48b-4ccf-85a2-cac9880ecff9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:17.670434 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-02af54f4-a48b-4ccf-85a2-cac9880ecff9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:17.679965 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-02af54f4-a48b-4ccf-85a2-cac9880ecff9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.157430 Dec 15 12:54:17.680557 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 894/1804] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:17 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:18.052269 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3d8b4309-230d-4cb8-9d50-373750881d53 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:18.053037 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3d8b4309-230d-4cb8-9d50-373750881d53 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:18.060294 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3d8b4309-230d-4cb8-9d50-373750881d53 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:18.060696 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3d8b4309-230d-4cb8-9d50-373750881d53 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:18.061484 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3d8b4309-230d-4cb8-9d50-373750881d53 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:18.061949 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3d8b4309-230d-4cb8-9d50-373750881d53 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:18.096744 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3d8b4309-230d-4cb8-9d50-373750881d53 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048023 Dec 15 12:54:18.097526 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 911/1805] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:54:18 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:54:18.697399 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-20334632-33dd-418b-9f9f-4de43931ed91 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:18.698049 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-20334632-33dd-418b-9f9f-4de43931ed91 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:18.704869 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-20334632-33dd-418b-9f9f-4de43931ed91 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:18.705384 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-20334632-33dd-418b-9f9f-4de43931ed91 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:18.706228 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-20334632-33dd-418b-9f9f-4de43931ed91 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:18.706656 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-20334632-33dd-418b-9f9f-4de43931ed91 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:18.840740 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-20334632-33dd-418b-9f9f-4de43931ed91 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:18.848483 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-20334632-33dd-418b-9f9f-4de43931ed91 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.155267 Dec 15 12:54:18.849050 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 895/1806] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:18 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:19.108752 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-456f308c-245a-4740-818b-0a8827085b37 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:19.109705 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-456f308c-245a-4740-818b-0a8827085b37 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:19.115824 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-456f308c-245a-4740-818b-0a8827085b37 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:19.116337 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-456f308c-245a-4740-818b-0a8827085b37 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:19.117202 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-456f308c-245a-4740-818b-0a8827085b37 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:19.117673 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-456f308c-245a-4740-818b-0a8827085b37 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:19.148183 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-456f308c-245a-4740-818b-0a8827085b37 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042615 Dec 15 12:54:19.148694 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 912/1807] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:54:19 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:54:19.865875 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-253f0a79-7421-4a78-9874-274de33aa8ef tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:19.867078 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-253f0a79-7421-4a78-9874-274de33aa8ef tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:19.874229 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-253f0a79-7421-4a78-9874-274de33aa8ef tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:19.874579 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-253f0a79-7421-4a78-9874-274de33aa8ef tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:19.875551 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-253f0a79-7421-4a78-9874-274de33aa8ef tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:19.876042 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-253f0a79-7421-4a78-9874-274de33aa8ef tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:20.029658 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-253f0a79-7421-4a78-9874-274de33aa8ef tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:20.037642 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-253f0a79-7421-4a78-9874-274de33aa8ef tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.175770 Dec 15 12:54:20.038777 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 896/1808] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:19 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:20.160056 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3f587181-4087-44e6-b909-f2046da756da tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:20.160965 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3f587181-4087-44e6-b909-f2046da756da tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:20.167850 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3f587181-4087-44e6-b909-f2046da756da tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:20.168331 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3f587181-4087-44e6-b909-f2046da756da tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:20.169117 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3f587181-4087-44e6-b909-f2046da756da tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:20.169576 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3f587181-4087-44e6-b909-f2046da756da tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:20.199735 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3f587181-4087-44e6-b909-f2046da756da tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043601 Dec 15 12:54:20.200291 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 913/1809] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:54:20 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 12:54:21.055158 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-01816211-8496-45b7-9c0d-f58d692d1283 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:21.055771 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-01816211-8496-45b7-9c0d-f58d692d1283 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:21.068120 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-01816211-8496-45b7-9c0d-f58d692d1283 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:21.068120 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-01816211-8496-45b7-9c0d-f58d692d1283 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:21.068812 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-01816211-8496-45b7-9c0d-f58d692d1283 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:21.068894 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-01816211-8496-45b7-9c0d-f58d692d1283 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:21.205299 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-01816211-8496-45b7-9c0d-f58d692d1283 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:21.211275 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3dd33512-f2dc-457e-baaa-187354e284dc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:21.212177 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3dd33512-f2dc-457e-baaa-187354e284dc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:21.214062 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-01816211-8496-45b7-9c0d-f58d692d1283 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.162984 Dec 15 12:54:21.214642 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 897/1810] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:21 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:21.218977 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3dd33512-f2dc-457e-baaa-187354e284dc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:21.219420 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3dd33512-f2dc-457e-baaa-187354e284dc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:21.220208 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3dd33512-f2dc-457e-baaa-187354e284dc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:21.220646 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3dd33512-f2dc-457e-baaa-187354e284dc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:21.251271 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3dd33512-f2dc-457e-baaa-187354e284dc tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043677 Dec 15 12:54:21.251734 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 914/1811] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:54:21 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:54:22.231896 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2da2a664-8e0c-4c8f-8c2c-f5c32f439b01 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:22.232491 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2da2a664-8e0c-4c8f-8c2c-f5c32f439b01 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:22.238735 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2da2a664-8e0c-4c8f-8c2c-f5c32f439b01 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:22.239174 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2da2a664-8e0c-4c8f-8c2c-f5c32f439b01 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:22.239944 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2da2a664-8e0c-4c8f-8c2c-f5c32f439b01 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:22.240373 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2da2a664-8e0c-4c8f-8c2c-f5c32f439b01 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:22.263068 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2efefee9-795f-40c3-af2f-720d0599e2a9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:22.264222 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2efefee9-795f-40c3-af2f-720d0599e2a9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:22.271683 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2efefee9-795f-40c3-af2f-720d0599e2a9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:22.272128 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2efefee9-795f-40c3-af2f-720d0599e2a9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:22.273144 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2efefee9-795f-40c3-af2f-720d0599e2a9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:22.273655 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2efefee9-795f-40c3-af2f-720d0599e2a9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:22.306288 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2efefee9-795f-40c3-af2f-720d0599e2a9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047017 Dec 15 12:54:22.306856 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 915/1812] 10.222.0.76 () {60 vars in 1342 bytes} [Wed Dec 15 12:54:22 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 12:54:22.379685 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2da2a664-8e0c-4c8f-8c2c-f5c32f439b01 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:22.387750 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2da2a664-8e0c-4c8f-8c2c-f5c32f439b01 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.159467 Dec 15 12:54:22.388326 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 898/1813] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:22 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:23.317813 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6759af29-a31f-41ac-baff-525411475526 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 12:54:23.318724 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6759af29-a31f-41ac-baff-525411475526 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:23.325040 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6759af29-a31f-41ac-baff-525411475526 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:23.325488 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6759af29-a31f-41ac-baff-525411475526 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:23.326296 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6759af29-a31f-41ac-baff-525411475526 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:23.326727 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6759af29-a31f-41ac-baff-525411475526 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:23.349746 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.wsgi [None req-6759af29-a31f-41ac-baff-525411475526 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] HTTP exception thrown: Instance ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 is not ready Dec 15 12:54:23.350254 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6759af29-a31f-41ac-baff-525411475526 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Returning 409 to user: Instance ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 is not ready {{(pid=122614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 12:54:23.351652 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6759af29-a31f-41ac-baff-525411475526 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action" status: 409 len: 110 microversion: 2.20 time: 0.037667 Dec 15 12:54:23.352184 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 916/1814] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 12:54:23 2021] POST /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2/action => generated 110 bytes in 39 msecs (HTTP/1.1 409) 9 headers in 380 bytes (1 switches on core 0) Dec 15 12:54:23.404578 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a0a058d4-38b5-442e-b93a-b7efa433ca68 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:23.405198 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a0a058d4-38b5-442e-b93a-b7efa433ca68 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:23.414880 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a0a058d4-38b5-442e-b93a-b7efa433ca68 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:23.415330 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a0a058d4-38b5-442e-b93a-b7efa433ca68 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:23.416139 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a0a058d4-38b5-442e-b93a-b7efa433ca68 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:23.416568 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a0a058d4-38b5-442e-b93a-b7efa433ca68 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:23.553198 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a0a058d4-38b5-442e-b93a-b7efa433ca68 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:23.562028 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a0a058d4-38b5-442e-b93a-b7efa433ca68 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.161233 Dec 15 12:54:23.562581 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 899/1815] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:23 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:24.579406 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bf61f371-0e0c-4ae5-9ef5-f2578b6acd4a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:24.580020 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bf61f371-0e0c-4ae5-9ef5-f2578b6acd4a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:24.586425 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bf61f371-0e0c-4ae5-9ef5-f2578b6acd4a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:24.586874 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bf61f371-0e0c-4ae5-9ef5-f2578b6acd4a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:24.587648 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bf61f371-0e0c-4ae5-9ef5-f2578b6acd4a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:24.588087 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bf61f371-0e0c-4ae5-9ef5-f2578b6acd4a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:24.782960 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-bf61f371-0e0c-4ae5-9ef5-f2578b6acd4a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:24.792211 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bf61f371-0e0c-4ae5-9ef5-f2578b6acd4a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.216425 Dec 15 12:54:24.792786 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 917/1816] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:24 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:25.809599 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-26469697-efb1-4be3-8dfa-354a62d15669 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:25.810179 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-26469697-efb1-4be3-8dfa-354a62d15669 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:25.817001 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-26469697-efb1-4be3-8dfa-354a62d15669 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:25.817440 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-26469697-efb1-4be3-8dfa-354a62d15669 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:25.818246 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-26469697-efb1-4be3-8dfa-354a62d15669 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:25.818668 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-26469697-efb1-4be3-8dfa-354a62d15669 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:25.960769 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-26469697-efb1-4be3-8dfa-354a62d15669 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:25.969792 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-26469697-efb1-4be3-8dfa-354a62d15669 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.163972 Dec 15 12:54:25.970400 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 900/1817] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:25 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:26.986834 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0619d630-6eb1-4681-a8cf-c06e4f99675c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:26.987433 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0619d630-6eb1-4681-a8cf-c06e4f99675c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:26.994569 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0619d630-6eb1-4681-a8cf-c06e4f99675c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:26.995010 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0619d630-6eb1-4681-a8cf-c06e4f99675c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:26.995783 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0619d630-6eb1-4681-a8cf-c06e4f99675c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:26.996215 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0619d630-6eb1-4681-a8cf-c06e4f99675c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:27.137568 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0619d630-6eb1-4681-a8cf-c06e4f99675c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:27.145604 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0619d630-6eb1-4681-a8cf-c06e4f99675c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.162319 Dec 15 12:54:27.146177 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 918/1818] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:26 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:28.164646 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-465c0624-127b-4433-8b1c-c4c1e8b446e3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:28.165302 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-465c0624-127b-4433-8b1c-c4c1e8b446e3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:28.171629 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-465c0624-127b-4433-8b1c-c4c1e8b446e3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:28.172077 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-465c0624-127b-4433-8b1c-c4c1e8b446e3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:28.172914 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-465c0624-127b-4433-8b1c-c4c1e8b446e3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:28.173346 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-465c0624-127b-4433-8b1c-c4c1e8b446e3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:28.305216 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-465c0624-127b-4433-8b1c-c4c1e8b446e3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:28.312985 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-465c0624-127b-4433-8b1c-c4c1e8b446e3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.152842 Dec 15 12:54:28.313567 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 901/1819] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:28 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:28.738281 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 12:54:28.738540 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 12:54:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 12:54:29.330610 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0679866b-80a7-45dd-9c30-9743028a5252 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:29.331182 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0679866b-80a7-45dd-9c30-9743028a5252 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:29.337598 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0679866b-80a7-45dd-9c30-9743028a5252 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:29.338054 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0679866b-80a7-45dd-9c30-9743028a5252 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:29.338834 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0679866b-80a7-45dd-9c30-9743028a5252 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:29.339273 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0679866b-80a7-45dd-9c30-9743028a5252 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:29.495396 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0679866b-80a7-45dd-9c30-9743028a5252 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:29.503237 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0679866b-80a7-45dd-9c30-9743028a5252 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.176475 Dec 15 12:54:29.503805 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 919/1820] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:29 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:30.521634 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-623c8b58-c09f-4185-84f6-a22a5bcddf6b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:30.522683 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-623c8b58-c09f-4185-84f6-a22a5bcddf6b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:30.529102 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-623c8b58-c09f-4185-84f6-a22a5bcddf6b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:30.529709 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-623c8b58-c09f-4185-84f6-a22a5bcddf6b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:30.530513 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-623c8b58-c09f-4185-84f6-a22a5bcddf6b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:30.531357 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-623c8b58-c09f-4185-84f6-a22a5bcddf6b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:30.666241 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-623c8b58-c09f-4185-84f6-a22a5bcddf6b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:30.674504 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-623c8b58-c09f-4185-84f6-a22a5bcddf6b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.156521 Dec 15 12:54:30.675154 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 902/1821] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:30 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:31.694002 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-699b44bd-c7eb-4600-a90c-8a8280da7b3d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:31.695251 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-699b44bd-c7eb-4600-a90c-8a8280da7b3d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:31.701454 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-699b44bd-c7eb-4600-a90c-8a8280da7b3d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:31.701942 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-699b44bd-c7eb-4600-a90c-8a8280da7b3d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:31.702747 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-699b44bd-c7eb-4600-a90c-8a8280da7b3d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:31.703236 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-699b44bd-c7eb-4600-a90c-8a8280da7b3d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:31.847218 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-699b44bd-c7eb-4600-a90c-8a8280da7b3d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:31.855139 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-699b44bd-c7eb-4600-a90c-8a8280da7b3d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.165198 Dec 15 12:54:31.855712 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 920/1822] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:31 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:32.871973 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e079625f-a4ae-473f-854c-73a1841187ef tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:32.872666 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e079625f-a4ae-473f-854c-73a1841187ef tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:32.879125 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e079625f-a4ae-473f-854c-73a1841187ef tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:32.879573 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e079625f-a4ae-473f-854c-73a1841187ef tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:32.880487 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e079625f-a4ae-473f-854c-73a1841187ef tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:32.880817 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e079625f-a4ae-473f-854c-73a1841187ef tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:33.030502 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e079625f-a4ae-473f-854c-73a1841187ef tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:33.038404 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e079625f-a4ae-473f-854c-73a1841187ef tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.170037 Dec 15 12:54:33.039011 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 903/1823] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:32 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:34.056017 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bc8ef8be-4eef-4332-921e-94d3d0f8077d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:34.056642 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bc8ef8be-4eef-4332-921e-94d3d0f8077d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:34.062962 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bc8ef8be-4eef-4332-921e-94d3d0f8077d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:34.063412 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bc8ef8be-4eef-4332-921e-94d3d0f8077d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:34.064196 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bc8ef8be-4eef-4332-921e-94d3d0f8077d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:34.064631 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bc8ef8be-4eef-4332-921e-94d3d0f8077d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:34.219246 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-bc8ef8be-4eef-4332-921e-94d3d0f8077d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:34.227197 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bc8ef8be-4eef-4332-921e-94d3d0f8077d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.175009 Dec 15 12:54:34.227753 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 921/1824] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:34 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:35.244363 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-548aeaf9-d561-4e3a-b2c7-d2475e8f5ff9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:35.244928 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-548aeaf9-d561-4e3a-b2c7-d2475e8f5ff9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:35.251787 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-548aeaf9-d561-4e3a-b2c7-d2475e8f5ff9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:35.252235 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-548aeaf9-d561-4e3a-b2c7-d2475e8f5ff9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:35.253033 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-548aeaf9-d561-4e3a-b2c7-d2475e8f5ff9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:35.253468 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-548aeaf9-d561-4e3a-b2c7-d2475e8f5ff9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:35.388352 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-548aeaf9-d561-4e3a-b2c7-d2475e8f5ff9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:35.396060 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-548aeaf9-d561-4e3a-b2c7-d2475e8f5ff9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.155712 Dec 15 12:54:35.396619 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 904/1825] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:35 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:36.413892 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f167d144-63b4-4982-852b-4a907a13d80e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:36.414494 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f167d144-63b4-4982-852b-4a907a13d80e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:36.420724 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f167d144-63b4-4982-852b-4a907a13d80e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:36.421172 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f167d144-63b4-4982-852b-4a907a13d80e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:36.422074 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f167d144-63b4-4982-852b-4a907a13d80e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:36.422422 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f167d144-63b4-4982-852b-4a907a13d80e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:36.552927 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f167d144-63b4-4982-852b-4a907a13d80e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:36.562121 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f167d144-63b4-4982-852b-4a907a13d80e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.152506 Dec 15 12:54:36.562845 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 922/1826] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:36 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:37.579433 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-17abbabe-4c68-4cfb-948c-8e36a20d5524 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:37.580299 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-17abbabe-4c68-4cfb-948c-8e36a20d5524 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:37.595074 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-17abbabe-4c68-4cfb-948c-8e36a20d5524 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:37.595541 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-17abbabe-4c68-4cfb-948c-8e36a20d5524 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:37.596394 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-17abbabe-4c68-4cfb-948c-8e36a20d5524 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:37.596823 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-17abbabe-4c68-4cfb-948c-8e36a20d5524 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:37.742358 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-17abbabe-4c68-4cfb-948c-8e36a20d5524 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:37.751796 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-17abbabe-4c68-4cfb-948c-8e36a20d5524 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.175722 Dec 15 12:54:37.752401 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 905/1827] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:37 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:38.439604 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 12:54:38.440199 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 12:54:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 12:54:38.770863 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e2a06dc1-e933-44fe-8483-365eee919c3f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:38.771385 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e2a06dc1-e933-44fe-8483-365eee919c3f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:38.777984 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e2a06dc1-e933-44fe-8483-365eee919c3f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:38.778431 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e2a06dc1-e933-44fe-8483-365eee919c3f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:38.779200 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e2a06dc1-e933-44fe-8483-365eee919c3f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:38.779631 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e2a06dc1-e933-44fe-8483-365eee919c3f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:38.920603 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e2a06dc1-e933-44fe-8483-365eee919c3f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:38.929086 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e2a06dc1-e933-44fe-8483-365eee919c3f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.161299 Dec 15 12:54:38.929753 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 923/1828] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:38 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:39.947065 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0b519843-9695-4983-bdfb-8b42f1d2e337 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:39.947781 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0b519843-9695-4983-bdfb-8b42f1d2e337 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:39.954226 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0b519843-9695-4983-bdfb-8b42f1d2e337 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:39.954908 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0b519843-9695-4983-bdfb-8b42f1d2e337 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:39.955704 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0b519843-9695-4983-bdfb-8b42f1d2e337 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:39.956138 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0b519843-9695-4983-bdfb-8b42f1d2e337 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:40.103077 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0b519843-9695-4983-bdfb-8b42f1d2e337 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:40.111111 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0b519843-9695-4983-bdfb-8b42f1d2e337 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.168623 Dec 15 12:54:40.111685 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 906/1829] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:39 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:41.128948 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8d449550-e8a5-4258-85ac-62ade36de8ff tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:41.129584 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8d449550-e8a5-4258-85ac-62ade36de8ff tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:41.136737 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8d449550-e8a5-4258-85ac-62ade36de8ff tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:41.137196 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8d449550-e8a5-4258-85ac-62ade36de8ff tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:41.138036 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8d449550-e8a5-4258-85ac-62ade36de8ff tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:41.138477 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8d449550-e8a5-4258-85ac-62ade36de8ff tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:41.275030 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-8d449550-e8a5-4258-85ac-62ade36de8ff tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:41.282860 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8d449550-e8a5-4258-85ac-62ade36de8ff tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.157557 Dec 15 12:54:41.288488 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 924/1830] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:41 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:42.300366 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b9026400-70cd-4c0a-b9f8-a07ef9020927 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:42.301284 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b9026400-70cd-4c0a-b9f8-a07ef9020927 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:42.308106 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b9026400-70cd-4c0a-b9f8-a07ef9020927 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:42.308546 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b9026400-70cd-4c0a-b9f8-a07ef9020927 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:42.309330 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b9026400-70cd-4c0a-b9f8-a07ef9020927 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:42.309784 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b9026400-70cd-4c0a-b9f8-a07ef9020927 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:42.441697 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b9026400-70cd-4c0a-b9f8-a07ef9020927 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:42.450701 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b9026400-70cd-4c0a-b9f8-a07ef9020927 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.154018 Dec 15 12:54:42.451203 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 907/1831] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:42 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:54:43.468024 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-49c63fb7-feb0-4c0c-8085-df3724c737be tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:43.468724 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-49c63fb7-feb0-4c0c-8085-df3724c737be tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:43.475508 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-49c63fb7-feb0-4c0c-8085-df3724c737be tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:43.476102 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-49c63fb7-feb0-4c0c-8085-df3724c737be tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:43.476889 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-49c63fb7-feb0-4c0c-8085-df3724c737be tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:43.477329 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-49c63fb7-feb0-4c0c-8085-df3724c737be tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:43.621865 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-49c63fb7-feb0-4c0c-8085-df3724c737be tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:43.629709 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-49c63fb7-feb0-4c0c-8085-df3724c737be tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.165406 Dec 15 12:54:43.630262 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 925/1832] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:43 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:44.646878 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-be81b96d-949e-4b36-9d74-767c92235111 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:44.648052 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-be81b96d-949e-4b36-9d74-767c92235111 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:44.654563 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-be81b96d-949e-4b36-9d74-767c92235111 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:44.655011 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-be81b96d-949e-4b36-9d74-767c92235111 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:44.655802 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-be81b96d-949e-4b36-9d74-767c92235111 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:44.656234 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-be81b96d-949e-4b36-9d74-767c92235111 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:44.791022 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-be81b96d-949e-4b36-9d74-767c92235111 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:44.799095 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-be81b96d-949e-4b36-9d74-767c92235111 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.156453 Dec 15 12:54:44.799688 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 908/1833] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:44 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:45.819573 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b0d98b28-05c7-437e-b841-2e8dc02c3cf7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:45.820557 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b0d98b28-05c7-437e-b841-2e8dc02c3cf7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:45.827757 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b0d98b28-05c7-437e-b841-2e8dc02c3cf7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:45.828203 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b0d98b28-05c7-437e-b841-2e8dc02c3cf7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:45.828989 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b0d98b28-05c7-437e-b841-2e8dc02c3cf7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:45.829421 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b0d98b28-05c7-437e-b841-2e8dc02c3cf7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:45.977136 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b0d98b28-05c7-437e-b841-2e8dc02c3cf7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:45.985102 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b0d98b28-05c7-437e-b841-2e8dc02c3cf7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.172428 Dec 15 12:54:45.985700 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 926/1834] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:45 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:47.002742 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-506bc21a-ea87-4d7a-8f56-78c5ac60c696 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:47.003359 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-506bc21a-ea87-4d7a-8f56-78c5ac60c696 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:47.009950 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-506bc21a-ea87-4d7a-8f56-78c5ac60c696 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:47.010400 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-506bc21a-ea87-4d7a-8f56-78c5ac60c696 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:47.011181 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-506bc21a-ea87-4d7a-8f56-78c5ac60c696 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:47.011619 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-506bc21a-ea87-4d7a-8f56-78c5ac60c696 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:47.145066 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-506bc21a-ea87-4d7a-8f56-78c5ac60c696 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:47.153588 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-506bc21a-ea87-4d7a-8f56-78c5ac60c696 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.154387 Dec 15 12:54:47.154177 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 909/1835] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:46 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:48.171513 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-57d2b95d-8ba2-4554-bd40-e1612167ce5c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:48.172115 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-57d2b95d-8ba2-4554-bd40-e1612167ce5c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:48.179208 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-57d2b95d-8ba2-4554-bd40-e1612167ce5c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:48.179751 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-57d2b95d-8ba2-4554-bd40-e1612167ce5c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:48.180450 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-57d2b95d-8ba2-4554-bd40-e1612167ce5c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:48.180889 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-57d2b95d-8ba2-4554-bd40-e1612167ce5c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:48.331517 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-57d2b95d-8ba2-4554-bd40-e1612167ce5c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:48.339679 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-57d2b95d-8ba2-4554-bd40-e1612167ce5c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.171748 Dec 15 12:54:48.340230 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 927/1836] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:48 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:49.357644 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-68fe4bfa-f7ed-4651-bdb3-415d5bd4f0e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:49.358250 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-68fe4bfa-f7ed-4651-bdb3-415d5bd4f0e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:49.364416 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-68fe4bfa-f7ed-4651-bdb3-415d5bd4f0e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:49.364855 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-68fe4bfa-f7ed-4651-bdb3-415d5bd4f0e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:49.365647 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-68fe4bfa-f7ed-4651-bdb3-415d5bd4f0e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:49.366080 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-68fe4bfa-f7ed-4651-bdb3-415d5bd4f0e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:49.494623 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-68fe4bfa-f7ed-4651-bdb3-415d5bd4f0e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:49.508814 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-68fe4bfa-f7ed-4651-bdb3-415d5bd4f0e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.154553 Dec 15 12:54:49.509351 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 910/1837] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:49 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:50.526376 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bcac383c-54a0-41e1-8bcb-9fe06ff077fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:50.526979 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bcac383c-54a0-41e1-8bcb-9fe06ff077fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:50.533173 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bcac383c-54a0-41e1-8bcb-9fe06ff077fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:50.533663 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bcac383c-54a0-41e1-8bcb-9fe06ff077fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:50.534441 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bcac383c-54a0-41e1-8bcb-9fe06ff077fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:50.534878 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bcac383c-54a0-41e1-8bcb-9fe06ff077fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:50.677818 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-bcac383c-54a0-41e1-8bcb-9fe06ff077fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:50.685941 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bcac383c-54a0-41e1-8bcb-9fe06ff077fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.163184 Dec 15 12:54:50.686511 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 928/1838] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:50 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:51.703349 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7c323d76-ffcd-4b70-b8e7-1a6074572e7b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:51.704016 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7c323d76-ffcd-4b70-b8e7-1a6074572e7b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:51.711170 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7c323d76-ffcd-4b70-b8e7-1a6074572e7b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:51.711471 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7c323d76-ffcd-4b70-b8e7-1a6074572e7b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:51.712268 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7c323d76-ffcd-4b70-b8e7-1a6074572e7b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:51.712706 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7c323d76-ffcd-4b70-b8e7-1a6074572e7b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:51.853145 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7c323d76-ffcd-4b70-b8e7-1a6074572e7b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:51.861029 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7c323d76-ffcd-4b70-b8e7-1a6074572e7b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.161338 Dec 15 12:54:51.861559 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 911/1839] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:51 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:52.878294 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-eae7f123-5d4e-4321-98a4-534a723c9bba tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:52.878900 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-eae7f123-5d4e-4321-98a4-534a723c9bba tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:52.886095 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eae7f123-5d4e-4321-98a4-534a723c9bba tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:52.886543 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eae7f123-5d4e-4321-98a4-534a723c9bba tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:52.887334 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eae7f123-5d4e-4321-98a4-534a723c9bba tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:52.887761 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eae7f123-5d4e-4321-98a4-534a723c9bba tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:53.019601 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-eae7f123-5d4e-4321-98a4-534a723c9bba tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:53.028480 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-eae7f123-5d4e-4321-98a4-534a723c9bba tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.153790 Dec 15 12:54:53.029042 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 929/1840] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:52 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:54.046627 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b071dfa0-3d3b-44fe-8dc9-7bc94856a3fc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:54.047221 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b071dfa0-3d3b-44fe-8dc9-7bc94856a3fc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:54.054330 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b071dfa0-3d3b-44fe-8dc9-7bc94856a3fc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:54.054784 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b071dfa0-3d3b-44fe-8dc9-7bc94856a3fc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:54.055565 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b071dfa0-3d3b-44fe-8dc9-7bc94856a3fc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:54.055997 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b071dfa0-3d3b-44fe-8dc9-7bc94856a3fc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:54.195822 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b071dfa0-3d3b-44fe-8dc9-7bc94856a3fc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:54.203626 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b071dfa0-3d3b-44fe-8dc9-7bc94856a3fc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.160914 Dec 15 12:54:54.204184 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 912/1841] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:54 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:55.221066 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-657e777d-0059-48fc-b30a-6f9d8ff053f7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:55.221719 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-657e777d-0059-48fc-b30a-6f9d8ff053f7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:55.228130 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-657e777d-0059-48fc-b30a-6f9d8ff053f7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:55.228610 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-657e777d-0059-48fc-b30a-6f9d8ff053f7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:55.229785 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-657e777d-0059-48fc-b30a-6f9d8ff053f7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:55.230462 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-657e777d-0059-48fc-b30a-6f9d8ff053f7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:55.373856 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-657e777d-0059-48fc-b30a-6f9d8ff053f7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:55.382093 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-657e777d-0059-48fc-b30a-6f9d8ff053f7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.164690 Dec 15 12:54:55.383067 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 930/1842] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:55 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:56.399854 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f374eb2f-e11d-41f5-9e42-0ff19e24ff52 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:56.400501 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f374eb2f-e11d-41f5-9e42-0ff19e24ff52 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:56.406850 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f374eb2f-e11d-41f5-9e42-0ff19e24ff52 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:56.407295 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f374eb2f-e11d-41f5-9e42-0ff19e24ff52 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:56.408078 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f374eb2f-e11d-41f5-9e42-0ff19e24ff52 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:56.408515 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f374eb2f-e11d-41f5-9e42-0ff19e24ff52 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:56.546545 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-f374eb2f-e11d-41f5-9e42-0ff19e24ff52 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:56.554504 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f374eb2f-e11d-41f5-9e42-0ff19e24ff52 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.158966 Dec 15 12:54:56.555063 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 913/1843] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:56 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:57.571172 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a2827f95-6094-4b0c-8725-2ace2ca532ab tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:57.571792 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a2827f95-6094-4b0c-8725-2ace2ca532ab tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:57.578605 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a2827f95-6094-4b0c-8725-2ace2ca532ab tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:57.579061 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a2827f95-6094-4b0c-8725-2ace2ca532ab tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:57.579861 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a2827f95-6094-4b0c-8725-2ace2ca532ab tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:57.580331 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a2827f95-6094-4b0c-8725-2ace2ca532ab tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:57.715556 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a2827f95-6094-4b0c-8725-2ace2ca532ab tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:57.723221 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a2827f95-6094-4b0c-8725-2ace2ca532ab tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.155931 Dec 15 12:54:57.723885 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 931/1844] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:57 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:58.742552 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0451e78c-aaf4-41ff-b7d2-2f1c81f11dfa tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:58.743158 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0451e78c-aaf4-41ff-b7d2-2f1c81f11dfa tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:58.749099 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0451e78c-aaf4-41ff-b7d2-2f1c81f11dfa tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:58.749568 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0451e78c-aaf4-41ff-b7d2-2f1c81f11dfa tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:58.750342 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0451e78c-aaf4-41ff-b7d2-2f1c81f11dfa tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:58.750771 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0451e78c-aaf4-41ff-b7d2-2f1c81f11dfa tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:58.891073 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0451e78c-aaf4-41ff-b7d2-2f1c81f11dfa tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:54:58.898931 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0451e78c-aaf4-41ff-b7d2-2f1c81f11dfa tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.161085 Dec 15 12:54:58.899501 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 914/1845] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:58 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:54:59.916153 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9dee931a-15ba-4252-b78d-d3b4183ff759 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:54:59.916770 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9dee931a-15ba-4252-b78d-d3b4183ff759 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:54:59.922810 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9dee931a-15ba-4252-b78d-d3b4183ff759 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:59.923262 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9dee931a-15ba-4252-b78d-d3b4183ff759 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:54:59.924052 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9dee931a-15ba-4252-b78d-d3b4183ff759 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:54:59.924483 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9dee931a-15ba-4252-b78d-d3b4183ff759 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:00.059766 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9dee931a-15ba-4252-b78d-d3b4183ff759 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:00.067972 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9dee931a-15ba-4252-b78d-d3b4183ff759 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.155481 Dec 15 12:55:00.069901 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 932/1846] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:54:59 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:01.086251 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ec782023-b856-416c-af72-fa5870b579aa tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:01.086878 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ec782023-b856-416c-af72-fa5870b579aa tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:01.093797 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ec782023-b856-416c-af72-fa5870b579aa tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:01.094487 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ec782023-b856-416c-af72-fa5870b579aa tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:01.095281 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ec782023-b856-416c-af72-fa5870b579aa tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:01.095726 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ec782023-b856-416c-af72-fa5870b579aa tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:01.252846 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ec782023-b856-416c-af72-fa5870b579aa tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:01.261823 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ec782023-b856-416c-af72-fa5870b579aa tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.179334 Dec 15 12:55:01.262653 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 915/1847] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:01 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:02.278988 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f0a0f529-e575-4284-8d75-ca020351f020 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:02.279600 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f0a0f529-e575-4284-8d75-ca020351f020 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:02.285717 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f0a0f529-e575-4284-8d75-ca020351f020 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:02.286177 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f0a0f529-e575-4284-8d75-ca020351f020 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:02.286930 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f0a0f529-e575-4284-8d75-ca020351f020 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:02.287444 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f0a0f529-e575-4284-8d75-ca020351f020 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:02.423924 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f0a0f529-e575-4284-8d75-ca020351f020 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:02.432300 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f0a0f529-e575-4284-8d75-ca020351f020 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.156846 Dec 15 12:55:02.432863 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 933/1848] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:02 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:03.449566 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-119f5f69-f296-4438-a42e-e9a4b40300f6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:03.450139 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-119f5f69-f296-4438-a42e-e9a4b40300f6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:03.456878 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-119f5f69-f296-4438-a42e-e9a4b40300f6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:03.457339 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-119f5f69-f296-4438-a42e-e9a4b40300f6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:03.458250 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-119f5f69-f296-4438-a42e-e9a4b40300f6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:03.458701 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-119f5f69-f296-4438-a42e-e9a4b40300f6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:03.590694 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-119f5f69-f296-4438-a42e-e9a4b40300f6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:03.598911 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-119f5f69-f296-4438-a42e-e9a4b40300f6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.153275 Dec 15 12:55:03.599492 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 916/1849] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:03 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:04.616061 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-cd17f118-a39c-48be-bcb0-079f72bace32 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:04.616800 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-cd17f118-a39c-48be-bcb0-079f72bace32 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:04.623034 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cd17f118-a39c-48be-bcb0-079f72bace32 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:04.623474 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cd17f118-a39c-48be-bcb0-079f72bace32 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:04.624244 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cd17f118-a39c-48be-bcb0-079f72bace32 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:04.624675 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cd17f118-a39c-48be-bcb0-079f72bace32 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:04.764406 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-cd17f118-a39c-48be-bcb0-079f72bace32 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:04.772151 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-cd17f118-a39c-48be-bcb0-079f72bace32 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.159773 Dec 15 12:55:04.772714 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 934/1850] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:04 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:05.789915 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-77a819a8-ddee-4da2-88f9-a81149677734 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:05.790532 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-77a819a8-ddee-4da2-88f9-a81149677734 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:05.797384 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-77a819a8-ddee-4da2-88f9-a81149677734 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:05.797872 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-77a819a8-ddee-4da2-88f9-a81149677734 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:05.798718 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-77a819a8-ddee-4da2-88f9-a81149677734 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:05.799162 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-77a819a8-ddee-4da2-88f9-a81149677734 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:05.934886 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-77a819a8-ddee-4da2-88f9-a81149677734 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:05.942663 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-77a819a8-ddee-4da2-88f9-a81149677734 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.157015 Dec 15 12:55:05.943236 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 917/1851] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:05 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:06.959793 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a2eded2b-6d75-4d4f-93d1-6c9f3928c07e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:06.960419 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a2eded2b-6d75-4d4f-93d1-6c9f3928c07e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:06.967014 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a2eded2b-6d75-4d4f-93d1-6c9f3928c07e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:06.967467 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a2eded2b-6d75-4d4f-93d1-6c9f3928c07e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:06.968429 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a2eded2b-6d75-4d4f-93d1-6c9f3928c07e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:06.968872 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a2eded2b-6d75-4d4f-93d1-6c9f3928c07e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:07.109169 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a2eded2b-6d75-4d4f-93d1-6c9f3928c07e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:07.116847 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a2eded2b-6d75-4d4f-93d1-6c9f3928c07e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.160893 Dec 15 12:55:07.117464 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 935/1852] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:06 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:08.135226 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0eb80f31-b162-4bce-8fc4-b1269164d0d3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:08.142785 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0eb80f31-b162-4bce-8fc4-b1269164d0d3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:08.149491 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0eb80f31-b162-4bce-8fc4-b1269164d0d3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:08.150656 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0eb80f31-b162-4bce-8fc4-b1269164d0d3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:08.151453 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0eb80f31-b162-4bce-8fc4-b1269164d0d3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:08.151892 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0eb80f31-b162-4bce-8fc4-b1269164d0d3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:08.284191 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0eb80f31-b162-4bce-8fc4-b1269164d0d3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:08.292340 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0eb80f31-b162-4bce-8fc4-b1269164d0d3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.161438 Dec 15 12:55:08.293200 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 918/1853] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:08 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:09.309238 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b12ffbac-b64e-4801-96ec-c142bcef8105 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:09.309880 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b12ffbac-b64e-4801-96ec-c142bcef8105 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:09.316137 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b12ffbac-b64e-4801-96ec-c142bcef8105 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:09.316593 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b12ffbac-b64e-4801-96ec-c142bcef8105 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:09.317376 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b12ffbac-b64e-4801-96ec-c142bcef8105 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:09.317861 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b12ffbac-b64e-4801-96ec-c142bcef8105 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:09.449821 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b12ffbac-b64e-4801-96ec-c142bcef8105 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:09.457855 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b12ffbac-b64e-4801-96ec-c142bcef8105 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.152367 Dec 15 12:55:09.458410 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 936/1854] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:09 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:10.475496 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-16e75d57-e46f-4180-a52d-875b6acaeed6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:10.476090 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-16e75d57-e46f-4180-a52d-875b6acaeed6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:10.482327 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-16e75d57-e46f-4180-a52d-875b6acaeed6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:10.482774 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-16e75d57-e46f-4180-a52d-875b6acaeed6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:10.483553 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-16e75d57-e46f-4180-a52d-875b6acaeed6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:10.484000 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-16e75d57-e46f-4180-a52d-875b6acaeed6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:10.615395 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-16e75d57-e46f-4180-a52d-875b6acaeed6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:10.624849 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-16e75d57-e46f-4180-a52d-875b6acaeed6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.152899 Dec 15 12:55:10.625569 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 919/1855] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:10 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:11.644924 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-67ffcd24-79a7-45d1-8533-ef44b70fc83a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:11.645585 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-67ffcd24-79a7-45d1-8533-ef44b70fc83a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:11.652700 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-67ffcd24-79a7-45d1-8533-ef44b70fc83a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:11.653200 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-67ffcd24-79a7-45d1-8533-ef44b70fc83a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:11.653947 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-67ffcd24-79a7-45d1-8533-ef44b70fc83a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:11.654376 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-67ffcd24-79a7-45d1-8533-ef44b70fc83a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:11.796399 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-67ffcd24-79a7-45d1-8533-ef44b70fc83a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:11.805117 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-67ffcd24-79a7-45d1-8533-ef44b70fc83a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.164937 Dec 15 12:55:11.805719 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 937/1856] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:11 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:55:12.822799 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-eaa7d95c-4f94-41fe-9d59-52fde39c5256 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:12.823426 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-eaa7d95c-4f94-41fe-9d59-52fde39c5256 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:12.830196 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eaa7d95c-4f94-41fe-9d59-52fde39c5256 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:12.830643 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eaa7d95c-4f94-41fe-9d59-52fde39c5256 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:12.831446 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eaa7d95c-4f94-41fe-9d59-52fde39c5256 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:12.831884 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eaa7d95c-4f94-41fe-9d59-52fde39c5256 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:12.966053 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-eaa7d95c-4f94-41fe-9d59-52fde39c5256 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:12.973854 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-eaa7d95c-4f94-41fe-9d59-52fde39c5256 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.154872 Dec 15 12:55:12.974412 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 920/1857] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:12 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:13.991857 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-df654a9b-8360-4123-8c8f-a31e587053bb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:13.992479 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-df654a9b-8360-4123-8c8f-a31e587053bb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:13.999540 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df654a9b-8360-4123-8c8f-a31e587053bb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:13.999996 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df654a9b-8360-4123-8c8f-a31e587053bb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:14.000847 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df654a9b-8360-4123-8c8f-a31e587053bb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:14.001229 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df654a9b-8360-4123-8c8f-a31e587053bb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:14.133957 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-df654a9b-8360-4123-8c8f-a31e587053bb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:14.142123 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-df654a9b-8360-4123-8c8f-a31e587053bb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.153978 Dec 15 12:55:14.142696 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 938/1858] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:13 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:15.159132 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b8c8bcd2-bd5a-459c-ba4e-0d0ec987bc33 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:15.159746 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b8c8bcd2-bd5a-459c-ba4e-0d0ec987bc33 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:15.166062 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b8c8bcd2-bd5a-459c-ba4e-0d0ec987bc33 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:15.166511 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b8c8bcd2-bd5a-459c-ba4e-0d0ec987bc33 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:15.167289 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b8c8bcd2-bd5a-459c-ba4e-0d0ec987bc33 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:15.167728 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b8c8bcd2-bd5a-459c-ba4e-0d0ec987bc33 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:15.299442 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b8c8bcd2-bd5a-459c-ba4e-0d0ec987bc33 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:15.308252 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b8c8bcd2-bd5a-459c-ba4e-0d0ec987bc33 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.152745 Dec 15 12:55:15.308842 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 921/1859] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:15 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:16.325207 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7331c3e2-92b4-41b7-a561-4bf1964934be tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:16.326022 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7331c3e2-92b4-41b7-a561-4bf1964934be tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:16.332363 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7331c3e2-92b4-41b7-a561-4bf1964934be tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:16.332701 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7331c3e2-92b4-41b7-a561-4bf1964934be tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:16.333495 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7331c3e2-92b4-41b7-a561-4bf1964934be tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:16.333961 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7331c3e2-92b4-41b7-a561-4bf1964934be tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:16.474644 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7331c3e2-92b4-41b7-a561-4bf1964934be tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:16.483889 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7331c3e2-92b4-41b7-a561-4bf1964934be tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.162356 Dec 15 12:55:16.484476 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 939/1860] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:16 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:17.501089 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-71b3b560-4063-4e9d-b8d5-b953049fa2d3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:17.501691 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-71b3b560-4063-4e9d-b8d5-b953049fa2d3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:17.508033 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-71b3b560-4063-4e9d-b8d5-b953049fa2d3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:17.508484 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-71b3b560-4063-4e9d-b8d5-b953049fa2d3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:17.509559 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-71b3b560-4063-4e9d-b8d5-b953049fa2d3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:17.510033 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-71b3b560-4063-4e9d-b8d5-b953049fa2d3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:17.643261 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-71b3b560-4063-4e9d-b8d5-b953049fa2d3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:17.651857 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-71b3b560-4063-4e9d-b8d5-b953049fa2d3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.154490 Dec 15 12:55:17.652437 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 922/1861] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:17 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:18.669695 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4c1239ec-a7da-48de-865f-68b4d9d9880e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:18.670329 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4c1239ec-a7da-48de-865f-68b4d9d9880e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:18.676676 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4c1239ec-a7da-48de-865f-68b4d9d9880e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:18.677121 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4c1239ec-a7da-48de-865f-68b4d9d9880e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:18.677941 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4c1239ec-a7da-48de-865f-68b4d9d9880e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:18.678376 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4c1239ec-a7da-48de-865f-68b4d9d9880e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:18.816021 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4c1239ec-a7da-48de-865f-68b4d9d9880e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:18.824516 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4c1239ec-a7da-48de-865f-68b4d9d9880e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.159146 Dec 15 12:55:18.825111 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 940/1862] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:18 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:55:19.842176 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-080b7ba8-1f77-4078-ada4-5cb2c7930f05 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:19.842860 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-080b7ba8-1f77-4078-ada4-5cb2c7930f05 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:19.848966 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-080b7ba8-1f77-4078-ada4-5cb2c7930f05 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:19.849404 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-080b7ba8-1f77-4078-ada4-5cb2c7930f05 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:19.850199 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-080b7ba8-1f77-4078-ada4-5cb2c7930f05 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:19.850627 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-080b7ba8-1f77-4078-ada4-5cb2c7930f05 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:19.995356 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-080b7ba8-1f77-4078-ada4-5cb2c7930f05 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:20.003218 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-080b7ba8-1f77-4078-ada4-5cb2c7930f05 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.165346 Dec 15 12:55:20.003785 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 923/1863] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:19 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:21.020531 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-da019a5e-792a-4099-98b8-a2422d038ef1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:21.021169 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-da019a5e-792a-4099-98b8-a2422d038ef1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:21.028509 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-da019a5e-792a-4099-98b8-a2422d038ef1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:21.028960 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-da019a5e-792a-4099-98b8-a2422d038ef1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:21.029785 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-da019a5e-792a-4099-98b8-a2422d038ef1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:21.030226 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-da019a5e-792a-4099-98b8-a2422d038ef1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:21.164481 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-da019a5e-792a-4099-98b8-a2422d038ef1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:21.173175 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-da019a5e-792a-4099-98b8-a2422d038ef1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.156487 Dec 15 12:55:21.173963 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 941/1864] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:21 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:22.190544 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-91be1862-b6d1-4184-b7c5-14c672956976 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:22.191160 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-91be1862-b6d1-4184-b7c5-14c672956976 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:22.197401 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-91be1862-b6d1-4184-b7c5-14c672956976 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:22.197887 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-91be1862-b6d1-4184-b7c5-14c672956976 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:22.198669 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-91be1862-b6d1-4184-b7c5-14c672956976 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:22.199103 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-91be1862-b6d1-4184-b7c5-14c672956976 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:22.345268 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-91be1862-b6d1-4184-b7c5-14c672956976 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:22.353084 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-91be1862-b6d1-4184-b7c5-14c672956976 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.166103 Dec 15 12:55:22.354143 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 924/1865] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:22 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:23.371099 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3b434bdd-5d8a-47cb-b6ce-c27ca821c5a0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:23.371725 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3b434bdd-5d8a-47cb-b6ce-c27ca821c5a0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:23.378968 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3b434bdd-5d8a-47cb-b6ce-c27ca821c5a0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:23.379412 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3b434bdd-5d8a-47cb-b6ce-c27ca821c5a0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:23.380365 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3b434bdd-5d8a-47cb-b6ce-c27ca821c5a0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:23.380622 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3b434bdd-5d8a-47cb-b6ce-c27ca821c5a0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:23.514779 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3b434bdd-5d8a-47cb-b6ce-c27ca821c5a0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:23.522619 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3b434bdd-5d8a-47cb-b6ce-c27ca821c5a0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.155848 Dec 15 12:55:23.523183 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 942/1866] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:23 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:24.542603 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-820a23c9-10d0-44ad-8054-8b2e691ef528 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:24.543214 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-820a23c9-10d0-44ad-8054-8b2e691ef528 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:24.550361 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-820a23c9-10d0-44ad-8054-8b2e691ef528 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:24.550799 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-820a23c9-10d0-44ad-8054-8b2e691ef528 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:24.551581 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-820a23c9-10d0-44ad-8054-8b2e691ef528 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:24.552009 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-820a23c9-10d0-44ad-8054-8b2e691ef528 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:24.683832 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-820a23c9-10d0-44ad-8054-8b2e691ef528 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:24.691744 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-820a23c9-10d0-44ad-8054-8b2e691ef528 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.153552 Dec 15 12:55:24.692370 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 925/1867] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:24 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:25.708544 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-52982c9b-b657-4f07-9335-da97b690cba6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:25.709155 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-52982c9b-b657-4f07-9335-da97b690cba6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:25.716004 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-52982c9b-b657-4f07-9335-da97b690cba6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:25.716456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-52982c9b-b657-4f07-9335-da97b690cba6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:25.717238 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-52982c9b-b657-4f07-9335-da97b690cba6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:25.717707 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-52982c9b-b657-4f07-9335-da97b690cba6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:25.881533 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-52982c9b-b657-4f07-9335-da97b690cba6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:25.891155 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-52982c9b-b657-4f07-9335-da97b690cba6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.186213 Dec 15 12:55:25.892512 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 943/1868] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:25 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:26.908952 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-448d482d-a21b-498c-8024-c24261ba3245 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:26.909658 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-448d482d-a21b-498c-8024-c24261ba3245 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:26.916405 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-448d482d-a21b-498c-8024-c24261ba3245 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:26.917024 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-448d482d-a21b-498c-8024-c24261ba3245 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:26.917988 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-448d482d-a21b-498c-8024-c24261ba3245 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:26.918418 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-448d482d-a21b-498c-8024-c24261ba3245 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:27.051591 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-448d482d-a21b-498c-8024-c24261ba3245 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:27.060270 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-448d482d-a21b-498c-8024-c24261ba3245 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.154915 Dec 15 12:55:27.060861 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 926/1869] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:26 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:28.077326 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2e316bf9-613b-45c1-a86c-6a0ff07cc5f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:28.077966 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2e316bf9-613b-45c1-a86c-6a0ff07cc5f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:28.084097 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2e316bf9-613b-45c1-a86c-6a0ff07cc5f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:28.084540 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2e316bf9-613b-45c1-a86c-6a0ff07cc5f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:28.085303 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2e316bf9-613b-45c1-a86c-6a0ff07cc5f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:28.085758 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2e316bf9-613b-45c1-a86c-6a0ff07cc5f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:28.220743 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2e316bf9-613b-45c1-a86c-6a0ff07cc5f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:28.228986 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2e316bf9-613b-45c1-a86c-6a0ff07cc5f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.154723 Dec 15 12:55:28.229757 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 944/1870] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:28 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:29.253857 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-98251cd3-9cca-4fde-a1e3-4e842a9b7239 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:29.254479 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-98251cd3-9cca-4fde-a1e3-4e842a9b7239 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:29.261528 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-98251cd3-9cca-4fde-a1e3-4e842a9b7239 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:29.261977 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-98251cd3-9cca-4fde-a1e3-4e842a9b7239 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:29.262771 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-98251cd3-9cca-4fde-a1e3-4e842a9b7239 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:29.263205 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-98251cd3-9cca-4fde-a1e3-4e842a9b7239 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:29.398759 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-98251cd3-9cca-4fde-a1e3-4e842a9b7239 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:29.407323 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-98251cd3-9cca-4fde-a1e3-4e842a9b7239 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.164637 Dec 15 12:55:29.407900 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 927/1871] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:29 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:30.424036 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2104488b-ed6f-4d82-b34b-5ea50b1c8800 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:30.424631 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2104488b-ed6f-4d82-b34b-5ea50b1c8800 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:30.430461 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2104488b-ed6f-4d82-b34b-5ea50b1c8800 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:30.430906 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2104488b-ed6f-4d82-b34b-5ea50b1c8800 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:30.431777 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2104488b-ed6f-4d82-b34b-5ea50b1c8800 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:30.432205 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2104488b-ed6f-4d82-b34b-5ea50b1c8800 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:30.573058 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2104488b-ed6f-4d82-b34b-5ea50b1c8800 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:30.580870 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2104488b-ed6f-4d82-b34b-5ea50b1c8800 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.160550 Dec 15 12:55:30.581440 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 945/1872] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:30 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:31.599176 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-927176c2-98a4-4a65-862e-86b120713934 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:31.599701 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-927176c2-98a4-4a65-862e-86b120713934 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:31.606739 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-927176c2-98a4-4a65-862e-86b120713934 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:31.607187 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-927176c2-98a4-4a65-862e-86b120713934 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:31.607966 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-927176c2-98a4-4a65-862e-86b120713934 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:31.608398 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-927176c2-98a4-4a65-862e-86b120713934 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:31.750284 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-927176c2-98a4-4a65-862e-86b120713934 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:31.758168 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-927176c2-98a4-4a65-862e-86b120713934 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.162484 Dec 15 12:55:31.758747 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 928/1873] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:31 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:32.774701 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-68b54ca0-3e84-4429-a719-9c42596e38d0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:32.775422 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-68b54ca0-3e84-4429-a719-9c42596e38d0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:32.791999 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-68b54ca0-3e84-4429-a719-9c42596e38d0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:32.792452 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-68b54ca0-3e84-4429-a719-9c42596e38d0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:32.793253 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-68b54ca0-3e84-4429-a719-9c42596e38d0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:32.793739 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-68b54ca0-3e84-4429-a719-9c42596e38d0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:32.948020 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-68b54ca0-3e84-4429-a719-9c42596e38d0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:32.955639 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-68b54ca0-3e84-4429-a719-9c42596e38d0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.184512 Dec 15 12:55:32.956204 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 946/1874] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:32 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:33.973796 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4fba516e-2fb7-48aa-bd4a-3e6d24344e33 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:33.974342 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4fba516e-2fb7-48aa-bd4a-3e6d24344e33 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:33.982195 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4fba516e-2fb7-48aa-bd4a-3e6d24344e33 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:33.982195 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4fba516e-2fb7-48aa-bd4a-3e6d24344e33 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:33.982195 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4fba516e-2fb7-48aa-bd4a-3e6d24344e33 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:33.982555 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4fba516e-2fb7-48aa-bd4a-3e6d24344e33 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:34.119555 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4fba516e-2fb7-48aa-bd4a-3e6d24344e33 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:34.127227 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4fba516e-2fb7-48aa-bd4a-3e6d24344e33 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.157181 Dec 15 12:55:34.127782 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 929/1875] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:33 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:35.144533 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-af1f2641-f41e-40eb-958f-0cdd53f8aa6c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:35.145155 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-af1f2641-f41e-40eb-958f-0cdd53f8aa6c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:35.152239 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-af1f2641-f41e-40eb-958f-0cdd53f8aa6c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:35.152677 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-af1f2641-f41e-40eb-958f-0cdd53f8aa6c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:35.153447 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-af1f2641-f41e-40eb-958f-0cdd53f8aa6c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:35.153901 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-af1f2641-f41e-40eb-958f-0cdd53f8aa6c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:35.284126 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-af1f2641-f41e-40eb-958f-0cdd53f8aa6c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:35.292595 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-af1f2641-f41e-40eb-958f-0cdd53f8aa6c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.151568 Dec 15 12:55:35.293188 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 947/1876] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:35 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:36.309857 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d9ff49ef-9a43-49d5-abb1-226b3e25a34b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:36.310468 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d9ff49ef-9a43-49d5-abb1-226b3e25a34b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:36.316822 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d9ff49ef-9a43-49d5-abb1-226b3e25a34b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:36.317263 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d9ff49ef-9a43-49d5-abb1-226b3e25a34b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:36.318066 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d9ff49ef-9a43-49d5-abb1-226b3e25a34b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:36.318499 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d9ff49ef-9a43-49d5-abb1-226b3e25a34b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:36.454074 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d9ff49ef-9a43-49d5-abb1-226b3e25a34b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:36.461787 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d9ff49ef-9a43-49d5-abb1-226b3e25a34b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.155904 Dec 15 12:55:36.462358 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 930/1877] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:36 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:37.480538 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d623257c-349a-4e75-8cec-7afe366094e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:37.481136 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d623257c-349a-4e75-8cec-7afe366094e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:37.487389 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d623257c-349a-4e75-8cec-7afe366094e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:37.487832 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d623257c-349a-4e75-8cec-7afe366094e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:37.488644 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d623257c-349a-4e75-8cec-7afe366094e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:37.489079 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d623257c-349a-4e75-8cec-7afe366094e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:37.617274 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d623257c-349a-4e75-8cec-7afe366094e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:37.625059 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d623257c-349a-4e75-8cec-7afe366094e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.149108 Dec 15 12:55:37.625647 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 948/1878] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:37 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:38.642747 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5a588665-97ec-4ad7-8cc4-8663b4288129 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:38.643385 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5a588665-97ec-4ad7-8cc4-8663b4288129 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:38.649856 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5a588665-97ec-4ad7-8cc4-8663b4288129 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:38.650567 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5a588665-97ec-4ad7-8cc4-8663b4288129 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:38.651366 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5a588665-97ec-4ad7-8cc4-8663b4288129 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:38.651796 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5a588665-97ec-4ad7-8cc4-8663b4288129 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:38.785252 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5a588665-97ec-4ad7-8cc4-8663b4288129 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:38.793555 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5a588665-97ec-4ad7-8cc4-8663b4288129 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.154596 Dec 15 12:55:38.794134 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 931/1879] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:38 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:39.812233 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3a33d243-d057-47d8-a010-5eda0c0ddb9b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:39.812923 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3a33d243-d057-47d8-a010-5eda0c0ddb9b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:39.820118 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3a33d243-d057-47d8-a010-5eda0c0ddb9b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:39.820691 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3a33d243-d057-47d8-a010-5eda0c0ddb9b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:39.821547 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3a33d243-d057-47d8-a010-5eda0c0ddb9b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:39.822338 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3a33d243-d057-47d8-a010-5eda0c0ddb9b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:39.973050 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3a33d243-d057-47d8-a010-5eda0c0ddb9b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:39.984419 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3a33d243-d057-47d8-a010-5eda0c0ddb9b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.176476 Dec 15 12:55:39.985447 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 949/1880] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:39 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:41.002521 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-496d5ad0-4717-4683-a421-8655a41b9b9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:41.003135 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-496d5ad0-4717-4683-a421-8655a41b9b9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:41.010507 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-496d5ad0-4717-4683-a421-8655a41b9b9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:41.011275 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-496d5ad0-4717-4683-a421-8655a41b9b9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:41.012387 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-496d5ad0-4717-4683-a421-8655a41b9b9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:41.012825 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-496d5ad0-4717-4683-a421-8655a41b9b9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:41.152539 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-496d5ad0-4717-4683-a421-8655a41b9b9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:41.160549 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-496d5ad0-4717-4683-a421-8655a41b9b9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.161749 Dec 15 12:55:41.161122 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 932/1881] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:40 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:42.187892 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2e8b5da1-9d5d-4b08-b63d-530d49ae6c3d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:42.188717 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2e8b5da1-9d5d-4b08-b63d-530d49ae6c3d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:42.195370 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2e8b5da1-9d5d-4b08-b63d-530d49ae6c3d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:42.195819 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2e8b5da1-9d5d-4b08-b63d-530d49ae6c3d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:42.196606 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2e8b5da1-9d5d-4b08-b63d-530d49ae6c3d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:42.197055 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2e8b5da1-9d5d-4b08-b63d-530d49ae6c3d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:42.549737 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2e8b5da1-9d5d-4b08-b63d-530d49ae6c3d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:42.557853 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2e8b5da1-9d5d-4b08-b63d-530d49ae6c3d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.373631 Dec 15 12:55:42.558424 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 950/1882] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:42 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:43.575820 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6368fbd5-fa23-43fc-97d5-8d4bd8880005 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:43.576472 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6368fbd5-fa23-43fc-97d5-8d4bd8880005 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:43.582919 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6368fbd5-fa23-43fc-97d5-8d4bd8880005 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:43.583368 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6368fbd5-fa23-43fc-97d5-8d4bd8880005 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:43.584146 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6368fbd5-fa23-43fc-97d5-8d4bd8880005 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:43.584602 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6368fbd5-fa23-43fc-97d5-8d4bd8880005 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:43.715232 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6368fbd5-fa23-43fc-97d5-8d4bd8880005 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:43.722996 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6368fbd5-fa23-43fc-97d5-8d4bd8880005 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.151541 Dec 15 12:55:43.723506 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 933/1883] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:43 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:44.745099 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1e2b6661-f11a-4cc5-abc5-128ce5e606a0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:44.745746 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1e2b6661-f11a-4cc5-abc5-128ce5e606a0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:44.751932 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1e2b6661-f11a-4cc5-abc5-128ce5e606a0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:44.752372 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1e2b6661-f11a-4cc5-abc5-128ce5e606a0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:44.753258 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1e2b6661-f11a-4cc5-abc5-128ce5e606a0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:44.753725 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1e2b6661-f11a-4cc5-abc5-128ce5e606a0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:44.887813 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1e2b6661-f11a-4cc5-abc5-128ce5e606a0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:44.896134 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1e2b6661-f11a-4cc5-abc5-128ce5e606a0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.155410 Dec 15 12:55:44.896711 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 951/1884] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:44 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:45.913284 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1fe07499-838d-470a-9121-c3150a49c38a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:45.913950 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1fe07499-838d-470a-9121-c3150a49c38a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:45.920434 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1fe07499-838d-470a-9121-c3150a49c38a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:45.920878 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1fe07499-838d-470a-9121-c3150a49c38a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:45.921695 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1fe07499-838d-470a-9121-c3150a49c38a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:45.922122 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1fe07499-838d-470a-9121-c3150a49c38a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:46.053562 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1fe07499-838d-470a-9121-c3150a49c38a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:46.061916 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1fe07499-838d-470a-9121-c3150a49c38a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.152244 Dec 15 12:55:46.062479 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 934/1885] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:45 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:47.079108 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-389c2233-46e2-443c-8540-fefd47cc6c8a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:47.079678 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-389c2233-46e2-443c-8540-fefd47cc6c8a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:47.086015 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-389c2233-46e2-443c-8540-fefd47cc6c8a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:47.086466 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-389c2233-46e2-443c-8540-fefd47cc6c8a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:47.087250 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-389c2233-46e2-443c-8540-fefd47cc6c8a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:47.088397 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-389c2233-46e2-443c-8540-fefd47cc6c8a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:47.219582 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-389c2233-46e2-443c-8540-fefd47cc6c8a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:47.227614 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-389c2233-46e2-443c-8540-fefd47cc6c8a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.152215 Dec 15 12:55:47.228358 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 952/1886] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:47 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:48.245107 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5ea45d3a-b8bd-4d9e-82ab-52fff7af7bfd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:48.245727 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5ea45d3a-b8bd-4d9e-82ab-52fff7af7bfd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:48.252145 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ea45d3a-b8bd-4d9e-82ab-52fff7af7bfd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:48.252590 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ea45d3a-b8bd-4d9e-82ab-52fff7af7bfd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:48.253365 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ea45d3a-b8bd-4d9e-82ab-52fff7af7bfd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:48.253902 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ea45d3a-b8bd-4d9e-82ab-52fff7af7bfd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:48.407287 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5ea45d3a-b8bd-4d9e-82ab-52fff7af7bfd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:48.415308 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5ea45d3a-b8bd-4d9e-82ab-52fff7af7bfd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.174012 Dec 15 12:55:48.416121 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 935/1887] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:48 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:49.432727 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-19ceb4d2-e8e4-4ed2-9bd5-249f57ddee82 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:49.433385 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-19ceb4d2-e8e4-4ed2-9bd5-249f57ddee82 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:49.439656 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-19ceb4d2-e8e4-4ed2-9bd5-249f57ddee82 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:49.440106 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-19ceb4d2-e8e4-4ed2-9bd5-249f57ddee82 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:49.440884 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-19ceb4d2-e8e4-4ed2-9bd5-249f57ddee82 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:49.441319 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-19ceb4d2-e8e4-4ed2-9bd5-249f57ddee82 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:49.572257 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-19ceb4d2-e8e4-4ed2-9bd5-249f57ddee82 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:49.580516 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-19ceb4d2-e8e4-4ed2-9bd5-249f57ddee82 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.152046 Dec 15 12:55:49.581088 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 953/1888] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:49 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:50.597918 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6f8a8a02-ac36-469a-9878-4e0deca8188c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:50.598772 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6f8a8a02-ac36-469a-9878-4e0deca8188c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:50.605253 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6f8a8a02-ac36-469a-9878-4e0deca8188c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:50.605822 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6f8a8a02-ac36-469a-9878-4e0deca8188c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:50.606692 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6f8a8a02-ac36-469a-9878-4e0deca8188c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:50.607110 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6f8a8a02-ac36-469a-9878-4e0deca8188c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:50.753268 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6f8a8a02-ac36-469a-9878-4e0deca8188c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:50.762155 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6f8a8a02-ac36-469a-9878-4e0deca8188c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.167828 Dec 15 12:55:50.762728 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 936/1889] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:50 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:51.779048 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8ad3228b-5f92-46d0-a347-40c09c62917b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:51.779704 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8ad3228b-5f92-46d0-a347-40c09c62917b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:51.785993 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8ad3228b-5f92-46d0-a347-40c09c62917b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:51.786442 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8ad3228b-5f92-46d0-a347-40c09c62917b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:51.787220 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8ad3228b-5f92-46d0-a347-40c09c62917b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:51.787657 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8ad3228b-5f92-46d0-a347-40c09c62917b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:51.919066 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-8ad3228b-5f92-46d0-a347-40c09c62917b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:51.928119 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8ad3228b-5f92-46d0-a347-40c09c62917b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.153171 Dec 15 12:55:51.928711 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 954/1890] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:51 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:52.945126 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b1ec20a8-3442-456c-b445-803e052e9de1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:52.945690 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b1ec20a8-3442-456c-b445-803e052e9de1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:52.952559 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1ec20a8-3442-456c-b445-803e052e9de1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:52.952859 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1ec20a8-3442-456c-b445-803e052e9de1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:52.953640 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1ec20a8-3442-456c-b445-803e052e9de1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:52.954078 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1ec20a8-3442-456c-b445-803e052e9de1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:53.094248 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b1ec20a8-3442-456c-b445-803e052e9de1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:53.101833 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b1ec20a8-3442-456c-b445-803e052e9de1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.160461 Dec 15 12:55:53.102395 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 937/1891] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:52 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:54.198610 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bf2015ec-0f8a-4353-a3ac-cb3a56e4ea3e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:54.199225 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bf2015ec-0f8a-4353-a3ac-cb3a56e4ea3e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:54.205000 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bf2015ec-0f8a-4353-a3ac-cb3a56e4ea3e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:54.205448 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bf2015ec-0f8a-4353-a3ac-cb3a56e4ea3e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:54.206250 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bf2015ec-0f8a-4353-a3ac-cb3a56e4ea3e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:54.206683 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bf2015ec-0f8a-4353-a3ac-cb3a56e4ea3e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:54.349145 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-bf2015ec-0f8a-4353-a3ac-cb3a56e4ea3e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:54.357483 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bf2015ec-0f8a-4353-a3ac-cb3a56e4ea3e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.239045 Dec 15 12:55:54.358087 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 955/1892] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:54 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:55.376199 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a1cce84b-b123-4ffa-a5f8-e624455977b0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:55.376724 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a1cce84b-b123-4ffa-a5f8-e624455977b0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:55.383254 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1cce84b-b123-4ffa-a5f8-e624455977b0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:55.383701 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1cce84b-b123-4ffa-a5f8-e624455977b0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:55.385094 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1cce84b-b123-4ffa-a5f8-e624455977b0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:55.385560 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1cce84b-b123-4ffa-a5f8-e624455977b0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:55.515801 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a1cce84b-b123-4ffa-a5f8-e624455977b0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:55.523958 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a1cce84b-b123-4ffa-a5f8-e624455977b0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.151392 Dec 15 12:55:55.524600 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 938/1893] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:55 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:56.541942 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ee924391-2b9b-4424-aac2-64e8c11a3227 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:56.542550 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ee924391-2b9b-4424-aac2-64e8c11a3227 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:56.548945 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ee924391-2b9b-4424-aac2-64e8c11a3227 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:56.549389 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ee924391-2b9b-4424-aac2-64e8c11a3227 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:56.550197 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ee924391-2b9b-4424-aac2-64e8c11a3227 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:56.550633 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ee924391-2b9b-4424-aac2-64e8c11a3227 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:56.693972 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ee924391-2b9b-4424-aac2-64e8c11a3227 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:56.702548 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ee924391-2b9b-4424-aac2-64e8c11a3227 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.164991 Dec 15 12:55:56.703126 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 956/1894] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:56 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:57.719768 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-71336fbd-1935-4362-82ae-f414bfae8926 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:57.720393 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-71336fbd-1935-4362-82ae-f414bfae8926 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:57.726405 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-71336fbd-1935-4362-82ae-f414bfae8926 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:57.726845 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-71336fbd-1935-4362-82ae-f414bfae8926 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:57.727631 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-71336fbd-1935-4362-82ae-f414bfae8926 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:57.728083 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-71336fbd-1935-4362-82ae-f414bfae8926 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:57.858951 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-71336fbd-1935-4362-82ae-f414bfae8926 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:57.869269 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-71336fbd-1935-4362-82ae-f414bfae8926 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.153073 Dec 15 12:55:57.869876 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 939/1895] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:57 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:55:58.887484 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-91d893fd-beeb-476c-a354-92ed958fa97f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:55:58.888098 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-91d893fd-beeb-476c-a354-92ed958fa97f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:55:58.894401 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-91d893fd-beeb-476c-a354-92ed958fa97f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:58.894846 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-91d893fd-beeb-476c-a354-92ed958fa97f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:58.895618 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-91d893fd-beeb-476c-a354-92ed958fa97f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:55:58.896068 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-91d893fd-beeb-476c-a354-92ed958fa97f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:55:59.039686 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-91d893fd-beeb-476c-a354-92ed958fa97f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:55:59.048736 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-91d893fd-beeb-476c-a354-92ed958fa97f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.165464 Dec 15 12:55:59.049726 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 957/1896] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:55:58 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:00.067208 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-446478cc-c93e-4248-ae81-329575f875f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:00.067852 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-446478cc-c93e-4248-ae81-329575f875f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:00.074307 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-446478cc-c93e-4248-ae81-329575f875f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:00.074764 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-446478cc-c93e-4248-ae81-329575f875f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:00.075531 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-446478cc-c93e-4248-ae81-329575f875f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:00.075964 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-446478cc-c93e-4248-ae81-329575f875f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:00.206662 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-446478cc-c93e-4248-ae81-329575f875f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:00.215528 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-446478cc-c93e-4248-ae81-329575f875f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.151875 Dec 15 12:56:00.216119 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 940/1897] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:00 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:01.232576 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bb49dabf-f5e2-47c4-aa8c-4b54fc87790f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:01.233203 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bb49dabf-f5e2-47c4-aa8c-4b54fc87790f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:01.239473 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bb49dabf-f5e2-47c4-aa8c-4b54fc87790f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:01.239923 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bb49dabf-f5e2-47c4-aa8c-4b54fc87790f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:01.240703 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bb49dabf-f5e2-47c4-aa8c-4b54fc87790f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:01.241141 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bb49dabf-f5e2-47c4-aa8c-4b54fc87790f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:01.380810 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-bb49dabf-f5e2-47c4-aa8c-4b54fc87790f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:01.388934 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bb49dabf-f5e2-47c4-aa8c-4b54fc87790f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.160724 Dec 15 12:56:01.389401 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 958/1898] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:01 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:02.408069 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-97f0982f-3c24-40f3-a696-65cf7ff0ab60 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:02.408687 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-97f0982f-3c24-40f3-a696-65cf7ff0ab60 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:02.414859 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-97f0982f-3c24-40f3-a696-65cf7ff0ab60 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:02.415297 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-97f0982f-3c24-40f3-a696-65cf7ff0ab60 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:02.416063 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-97f0982f-3c24-40f3-a696-65cf7ff0ab60 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:02.416640 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-97f0982f-3c24-40f3-a696-65cf7ff0ab60 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:02.567251 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-97f0982f-3c24-40f3-a696-65cf7ff0ab60 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:02.575977 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-97f0982f-3c24-40f3-a696-65cf7ff0ab60 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.171701 Dec 15 12:56:02.576539 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 941/1899] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:02 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:03.594118 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3d21c9b4-9fb0-41c5-be0f-e21c64c0ed49 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:03.594765 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3d21c9b4-9fb0-41c5-be0f-e21c64c0ed49 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:03.601599 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3d21c9b4-9fb0-41c5-be0f-e21c64c0ed49 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:03.602048 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3d21c9b4-9fb0-41c5-be0f-e21c64c0ed49 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:03.602840 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3d21c9b4-9fb0-41c5-be0f-e21c64c0ed49 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:03.603271 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3d21c9b4-9fb0-41c5-be0f-e21c64c0ed49 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:03.739959 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3d21c9b4-9fb0-41c5-be0f-e21c64c0ed49 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:03.754732 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3d21c9b4-9fb0-41c5-be0f-e21c64c0ed49 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.157560 Dec 15 12:56:03.755723 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 959/1900] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:03 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:04.773158 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9908247f-c336-4a40-b8ae-653a007a7d4b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:04.773787 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9908247f-c336-4a40-b8ae-653a007a7d4b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:04.780596 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9908247f-c336-4a40-b8ae-653a007a7d4b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:04.781035 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9908247f-c336-4a40-b8ae-653a007a7d4b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:04.781825 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9908247f-c336-4a40-b8ae-653a007a7d4b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:04.782256 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9908247f-c336-4a40-b8ae-653a007a7d4b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:04.924359 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9908247f-c336-4a40-b8ae-653a007a7d4b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:04.932213 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9908247f-c336-4a40-b8ae-653a007a7d4b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.162535 Dec 15 12:56:04.932961 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 942/1901] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:04 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:05.949733 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-25fbe763-789a-4255-9742-82ccadadc25a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:05.950361 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-25fbe763-789a-4255-9742-82ccadadc25a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:05.956638 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-25fbe763-789a-4255-9742-82ccadadc25a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:05.957091 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-25fbe763-789a-4255-9742-82ccadadc25a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:05.957907 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-25fbe763-789a-4255-9742-82ccadadc25a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:05.958342 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-25fbe763-789a-4255-9742-82ccadadc25a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:06.091159 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-25fbe763-789a-4255-9742-82ccadadc25a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:06.099348 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-25fbe763-789a-4255-9742-82ccadadc25a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.153322 Dec 15 12:56:06.100145 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 960/1902] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:05 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:07.117035 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bc200277-35ea-43e8-a821-16edb20c77ec tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:07.117612 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bc200277-35ea-43e8-a821-16edb20c77ec tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:07.124739 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc200277-35ea-43e8-a821-16edb20c77ec tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:07.125219 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc200277-35ea-43e8-a821-16edb20c77ec tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:07.126028 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc200277-35ea-43e8-a821-16edb20c77ec tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:07.126464 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc200277-35ea-43e8-a821-16edb20c77ec tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:07.259035 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bc200277-35ea-43e8-a821-16edb20c77ec tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:07.267710 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bc200277-35ea-43e8-a821-16edb20c77ec tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.154397 Dec 15 12:56:07.268284 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 943/1903] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:07 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:08.285527 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9947bc87-7fb6-4a10-a56b-73b6c6721dc8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:08.286861 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9947bc87-7fb6-4a10-a56b-73b6c6721dc8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:08.293933 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9947bc87-7fb6-4a10-a56b-73b6c6721dc8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:08.294395 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9947bc87-7fb6-4a10-a56b-73b6c6721dc8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:08.295232 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9947bc87-7fb6-4a10-a56b-73b6c6721dc8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:08.295723 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9947bc87-7fb6-4a10-a56b-73b6c6721dc8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:08.434705 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9947bc87-7fb6-4a10-a56b-73b6c6721dc8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:08.443682 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9947bc87-7fb6-4a10-a56b-73b6c6721dc8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.161751 Dec 15 12:56:08.444272 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 961/1904] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:08 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:09.465639 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b1c9f3cb-43c6-400d-9e89-62c00d542fb7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:09.466259 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b1c9f3cb-43c6-400d-9e89-62c00d542fb7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:09.472536 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1c9f3cb-43c6-400d-9e89-62c00d542fb7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:09.472982 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1c9f3cb-43c6-400d-9e89-62c00d542fb7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:09.473783 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1c9f3cb-43c6-400d-9e89-62c00d542fb7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:09.474223 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b1c9f3cb-43c6-400d-9e89-62c00d542fb7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:09.609840 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b1c9f3cb-43c6-400d-9e89-62c00d542fb7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:09.617468 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b1c9f3cb-43c6-400d-9e89-62c00d542fb7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.156141 Dec 15 12:56:09.618062 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 944/1905] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:09 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:10.635289 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-114167e7-6f5d-4a79-9a99-f9264ae83c98 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:10.636080 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-114167e7-6f5d-4a79-9a99-f9264ae83c98 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:10.642433 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-114167e7-6f5d-4a79-9a99-f9264ae83c98 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:10.642876 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-114167e7-6f5d-4a79-9a99-f9264ae83c98 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:10.643656 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-114167e7-6f5d-4a79-9a99-f9264ae83c98 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:10.644081 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-114167e7-6f5d-4a79-9a99-f9264ae83c98 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:10.779647 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-114167e7-6f5d-4a79-9a99-f9264ae83c98 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:10.788173 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-114167e7-6f5d-4a79-9a99-f9264ae83c98 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.157012 Dec 15 12:56:10.788758 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 962/1906] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:10 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:11.805969 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-807d749d-531e-45be-99fa-4b66aca5a814 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:11.806583 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-807d749d-531e-45be-99fa-4b66aca5a814 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:11.813421 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-807d749d-531e-45be-99fa-4b66aca5a814 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:11.813898 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-807d749d-531e-45be-99fa-4b66aca5a814 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:11.814669 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-807d749d-531e-45be-99fa-4b66aca5a814 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:11.815100 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-807d749d-531e-45be-99fa-4b66aca5a814 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:11.949913 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-807d749d-531e-45be-99fa-4b66aca5a814 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:11.957871 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-807d749d-531e-45be-99fa-4b66aca5a814 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.155535 Dec 15 12:56:11.958443 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 945/1907] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:11 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:12.975533 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8ac98ee5-8651-490b-a57d-a37028ba8cc4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:12.976342 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8ac98ee5-8651-490b-a57d-a37028ba8cc4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:12.982803 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8ac98ee5-8651-490b-a57d-a37028ba8cc4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:12.983246 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8ac98ee5-8651-490b-a57d-a37028ba8cc4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:12.984026 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8ac98ee5-8651-490b-a57d-a37028ba8cc4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:12.984459 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8ac98ee5-8651-490b-a57d-a37028ba8cc4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:13.120624 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-8ac98ee5-8651-490b-a57d-a37028ba8cc4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:13.128981 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8ac98ee5-8651-490b-a57d-a37028ba8cc4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.157062 Dec 15 12:56:13.129625 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 963/1908] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:12 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:14.146966 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-84862f13-af7a-44f4-bc76-3225eca9bd3c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:14.147580 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-84862f13-af7a-44f4-bc76-3225eca9bd3c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:14.154620 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-84862f13-af7a-44f4-bc76-3225eca9bd3c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:14.155068 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-84862f13-af7a-44f4-bc76-3225eca9bd3c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:14.155859 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-84862f13-af7a-44f4-bc76-3225eca9bd3c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:14.156294 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-84862f13-af7a-44f4-bc76-3225eca9bd3c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:14.290846 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-84862f13-af7a-44f4-bc76-3225eca9bd3c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:14.299127 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-84862f13-af7a-44f4-bc76-3225eca9bd3c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.155697 Dec 15 12:56:14.299551 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 946/1909] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:14 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:15.316127 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-dad845eb-edf6-4eab-a642-19fc0cc7a8ea tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:15.316777 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-dad845eb-edf6-4eab-a642-19fc0cc7a8ea tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:15.323570 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dad845eb-edf6-4eab-a642-19fc0cc7a8ea tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:15.324018 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dad845eb-edf6-4eab-a642-19fc0cc7a8ea tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:15.324819 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dad845eb-edf6-4eab-a642-19fc0cc7a8ea tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:15.325263 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dad845eb-edf6-4eab-a642-19fc0cc7a8ea tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:15.455380 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-dad845eb-edf6-4eab-a642-19fc0cc7a8ea tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:15.463808 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-dad845eb-edf6-4eab-a642-19fc0cc7a8ea tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.150938 Dec 15 12:56:15.464378 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 964/1910] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:15 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:16.483608 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-17e4e89a-4dd1-41d0-ba7c-7b3742ed191a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:16.484170 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-17e4e89a-4dd1-41d0-ba7c-7b3742ed191a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:16.490119 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-17e4e89a-4dd1-41d0-ba7c-7b3742ed191a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:16.490565 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-17e4e89a-4dd1-41d0-ba7c-7b3742ed191a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:16.491351 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-17e4e89a-4dd1-41d0-ba7c-7b3742ed191a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:16.491782 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-17e4e89a-4dd1-41d0-ba7c-7b3742ed191a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:16.625015 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-17e4e89a-4dd1-41d0-ba7c-7b3742ed191a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:16.633120 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-17e4e89a-4dd1-41d0-ba7c-7b3742ed191a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.153701 Dec 15 12:56:16.633984 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 947/1911] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:16 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:17.652992 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3e5492a7-dbd7-49a5-808b-eda428362dee tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:17.653635 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3e5492a7-dbd7-49a5-808b-eda428362dee tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:17.659997 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3e5492a7-dbd7-49a5-808b-eda428362dee tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:17.660473 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3e5492a7-dbd7-49a5-808b-eda428362dee tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:17.661294 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3e5492a7-dbd7-49a5-808b-eda428362dee tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:17.661763 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3e5492a7-dbd7-49a5-808b-eda428362dee tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:17.793473 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3e5492a7-dbd7-49a5-808b-eda428362dee tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:17.801278 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3e5492a7-dbd7-49a5-808b-eda428362dee tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.152117 Dec 15 12:56:17.801885 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 965/1912] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:17 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:18.345059 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 12:56:18.345671 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 12:56:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 12:56:18.819242 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d64bdbc3-fe44-4b8e-983e-287e7e8171e4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:18.819847 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d64bdbc3-fe44-4b8e-983e-287e7e8171e4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:18.826682 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d64bdbc3-fe44-4b8e-983e-287e7e8171e4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:18.827118 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d64bdbc3-fe44-4b8e-983e-287e7e8171e4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:18.827891 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d64bdbc3-fe44-4b8e-983e-287e7e8171e4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:18.828315 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d64bdbc3-fe44-4b8e-983e-287e7e8171e4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:18.966454 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d64bdbc3-fe44-4b8e-983e-287e7e8171e4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:18.975072 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d64bdbc3-fe44-4b8e-983e-287e7e8171e4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.159418 Dec 15 12:56:18.975640 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 948/1913] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:18 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:19.992618 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c29ade2d-fcf6-4a90-8e33-db048c750fb8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:19.993229 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c29ade2d-fcf6-4a90-8e33-db048c750fb8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:20.000114 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c29ade2d-fcf6-4a90-8e33-db048c750fb8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:20.000623 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c29ade2d-fcf6-4a90-8e33-db048c750fb8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:20.001433 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c29ade2d-fcf6-4a90-8e33-db048c750fb8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:20.001895 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c29ade2d-fcf6-4a90-8e33-db048c750fb8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:20.141159 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c29ade2d-fcf6-4a90-8e33-db048c750fb8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:20.149059 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c29ade2d-fcf6-4a90-8e33-db048c750fb8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.160114 Dec 15 12:56:20.149652 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 966/1914] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:19 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:21.166956 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3f588ef6-fac1-48c8-a1ca-951083198bbf tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:21.167578 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3f588ef6-fac1-48c8-a1ca-951083198bbf tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:21.173965 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3f588ef6-fac1-48c8-a1ca-951083198bbf tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:21.174415 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3f588ef6-fac1-48c8-a1ca-951083198bbf tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:21.175207 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3f588ef6-fac1-48c8-a1ca-951083198bbf tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:21.175656 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3f588ef6-fac1-48c8-a1ca-951083198bbf tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:21.310185 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3f588ef6-fac1-48c8-a1ca-951083198bbf tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:21.318559 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3f588ef6-fac1-48c8-a1ca-951083198bbf tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.155234 Dec 15 12:56:21.319151 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 949/1915] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:21 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:22.336299 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e9d21280-3aa3-42a3-9073-619b9199760f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:22.336924 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e9d21280-3aa3-42a3-9073-619b9199760f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:22.344391 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e9d21280-3aa3-42a3-9073-619b9199760f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:22.344833 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e9d21280-3aa3-42a3-9073-619b9199760f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:22.345835 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e9d21280-3aa3-42a3-9073-619b9199760f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:22.346265 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e9d21280-3aa3-42a3-9073-619b9199760f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:22.486678 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e9d21280-3aa3-42a3-9073-619b9199760f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:22.494643 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e9d21280-3aa3-42a3-9073-619b9199760f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.161989 Dec 15 12:56:22.495705 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 967/1916] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:22 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:23.513185 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0249ee80-5a5e-441c-96bd-9e441d15b6d2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:23.513846 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0249ee80-5a5e-441c-96bd-9e441d15b6d2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:23.520155 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0249ee80-5a5e-441c-96bd-9e441d15b6d2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:23.520605 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0249ee80-5a5e-441c-96bd-9e441d15b6d2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:23.521388 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0249ee80-5a5e-441c-96bd-9e441d15b6d2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:23.521855 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0249ee80-5a5e-441c-96bd-9e441d15b6d2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:23.655309 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0249ee80-5a5e-441c-96bd-9e441d15b6d2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:23.663865 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0249ee80-5a5e-441c-96bd-9e441d15b6d2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.155514 Dec 15 12:56:23.664444 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 950/1917] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:23 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:56:24.215694 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 12:56:24.216235 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 12:56:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 12:56:24.680221 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a9829fcf-388d-4a47-a7f5-73ff62c20d7d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:24.680839 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a9829fcf-388d-4a47-a7f5-73ff62c20d7d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:24.687658 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a9829fcf-388d-4a47-a7f5-73ff62c20d7d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:24.688109 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a9829fcf-388d-4a47-a7f5-73ff62c20d7d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:24.688900 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a9829fcf-388d-4a47-a7f5-73ff62c20d7d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:24.689341 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a9829fcf-388d-4a47-a7f5-73ff62c20d7d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:24.836379 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a9829fcf-388d-4a47-a7f5-73ff62c20d7d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:24.845241 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a9829fcf-388d-4a47-a7f5-73ff62c20d7d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.168714 Dec 15 12:56:24.845859 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 968/1918] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:24 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:25.862657 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a10fc51e-60d0-419d-b768-4f9c1063f9c9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:25.863202 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a10fc51e-60d0-419d-b768-4f9c1063f9c9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:25.870332 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a10fc51e-60d0-419d-b768-4f9c1063f9c9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:25.870910 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a10fc51e-60d0-419d-b768-4f9c1063f9c9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:25.871706 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a10fc51e-60d0-419d-b768-4f9c1063f9c9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:25.872136 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a10fc51e-60d0-419d-b768-4f9c1063f9c9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:26.007853 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a10fc51e-60d0-419d-b768-4f9c1063f9c9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:26.016068 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a10fc51e-60d0-419d-b768-4f9c1063f9c9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.157153 Dec 15 12:56:26.016640 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 951/1919] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:25 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:27.035208 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7a62a5b2-2148-4fad-80e7-84dcbc4685db tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:27.035889 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7a62a5b2-2148-4fad-80e7-84dcbc4685db tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:27.042354 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7a62a5b2-2148-4fad-80e7-84dcbc4685db tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:27.042807 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7a62a5b2-2148-4fad-80e7-84dcbc4685db tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:27.043594 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7a62a5b2-2148-4fad-80e7-84dcbc4685db tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:27.044031 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7a62a5b2-2148-4fad-80e7-84dcbc4685db tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:27.192351 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7a62a5b2-2148-4fad-80e7-84dcbc4685db tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:27.200795 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7a62a5b2-2148-4fad-80e7-84dcbc4685db tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.169384 Dec 15 12:56:27.201346 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 969/1920] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:27 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:28.218423 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c6445f43-d55b-465b-b694-8d498ded267f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:28.219038 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c6445f43-d55b-465b-b694-8d498ded267f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:28.225236 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c6445f43-d55b-465b-b694-8d498ded267f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:28.225729 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c6445f43-d55b-465b-b694-8d498ded267f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:28.226523 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c6445f43-d55b-465b-b694-8d498ded267f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:28.226952 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c6445f43-d55b-465b-b694-8d498ded267f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:28.365902 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c6445f43-d55b-465b-b694-8d498ded267f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:28.374431 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c6445f43-d55b-465b-b694-8d498ded267f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.159656 Dec 15 12:56:28.375006 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 952/1921] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:28 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:56:29.391756 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bb519915-3db2-4350-a82a-b3427d205799 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:29.392376 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bb519915-3db2-4350-a82a-b3427d205799 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:29.398723 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bb519915-3db2-4350-a82a-b3427d205799 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:29.399177 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bb519915-3db2-4350-a82a-b3427d205799 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:29.399952 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bb519915-3db2-4350-a82a-b3427d205799 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:29.400446 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bb519915-3db2-4350-a82a-b3427d205799 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:29.534135 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-bb519915-3db2-4350-a82a-b3427d205799 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:29.542571 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bb519915-3db2-4350-a82a-b3427d205799 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.154469 Dec 15 12:56:29.543134 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 970/1922] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:29 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:30.559765 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4e661b4e-484d-4dad-8378-e02894249e6f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:30.560310 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4e661b4e-484d-4dad-8378-e02894249e6f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:30.566615 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e661b4e-484d-4dad-8378-e02894249e6f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:30.567064 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e661b4e-484d-4dad-8378-e02894249e6f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:30.574428 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e661b4e-484d-4dad-8378-e02894249e6f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:30.574868 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e661b4e-484d-4dad-8378-e02894249e6f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:30.713627 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4e661b4e-484d-4dad-8378-e02894249e6f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:30.722787 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4e661b4e-484d-4dad-8378-e02894249e6f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.167301 Dec 15 12:56:30.723412 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 953/1923] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:30 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:31.747145 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-99f69dfc-81e5-4759-9dd0-6f80fc45bc4a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:31.747758 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-99f69dfc-81e5-4759-9dd0-6f80fc45bc4a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:31.753469 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-99f69dfc-81e5-4759-9dd0-6f80fc45bc4a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:31.753942 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-99f69dfc-81e5-4759-9dd0-6f80fc45bc4a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:31.754712 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-99f69dfc-81e5-4759-9dd0-6f80fc45bc4a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:31.755140 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-99f69dfc-81e5-4759-9dd0-6f80fc45bc4a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:31.899220 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-99f69dfc-81e5-4759-9dd0-6f80fc45bc4a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:31.907058 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-99f69dfc-81e5-4759-9dd0-6f80fc45bc4a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.163581 Dec 15 12:56:31.907613 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 971/1924] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:31 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:32.924791 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-eeb43a30-1bf8-46d5-8a1d-9aad45c61cc3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:32.925398 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-eeb43a30-1bf8-46d5-8a1d-9aad45c61cc3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:32.931781 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eeb43a30-1bf8-46d5-8a1d-9aad45c61cc3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:32.932228 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eeb43a30-1bf8-46d5-8a1d-9aad45c61cc3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:32.933009 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eeb43a30-1bf8-46d5-8a1d-9aad45c61cc3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:32.933470 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eeb43a30-1bf8-46d5-8a1d-9aad45c61cc3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:33.070389 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-eeb43a30-1bf8-46d5-8a1d-9aad45c61cc3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:33.079072 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-eeb43a30-1bf8-46d5-8a1d-9aad45c61cc3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.157927 Dec 15 12:56:33.079640 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 954/1925] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:32 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:34.095681 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-41b89233-d4cf-49f3-9c61-54c6efa27024 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:34.096438 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-41b89233-d4cf-49f3-9c61-54c6efa27024 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:34.102467 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-41b89233-d4cf-49f3-9c61-54c6efa27024 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:34.102850 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-41b89233-d4cf-49f3-9c61-54c6efa27024 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:34.103987 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-41b89233-d4cf-49f3-9c61-54c6efa27024 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:34.104497 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-41b89233-d4cf-49f3-9c61-54c6efa27024 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:34.238698 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-41b89233-d4cf-49f3-9c61-54c6efa27024 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:34.247061 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-41b89233-d4cf-49f3-9c61-54c6efa27024 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.154932 Dec 15 12:56:34.247633 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 972/1926] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:34 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:35.264819 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-902e64e8-01b2-4650-bf08-c5fd15c525a5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:35.265478 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-902e64e8-01b2-4650-bf08-c5fd15c525a5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:35.271811 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-902e64e8-01b2-4650-bf08-c5fd15c525a5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:35.272260 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-902e64e8-01b2-4650-bf08-c5fd15c525a5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:35.273044 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-902e64e8-01b2-4650-bf08-c5fd15c525a5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:35.273476 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-902e64e8-01b2-4650-bf08-c5fd15c525a5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:35.408670 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-902e64e8-01b2-4650-bf08-c5fd15c525a5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:35.417809 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-902e64e8-01b2-4650-bf08-c5fd15c525a5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.156689 Dec 15 12:56:35.418415 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 955/1927] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:35 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:36.435260 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8fb095bd-5ef9-423c-9c4c-3e201e2a33fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:36.436065 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8fb095bd-5ef9-423c-9c4c-3e201e2a33fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:36.442491 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8fb095bd-5ef9-423c-9c4c-3e201e2a33fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:36.442943 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8fb095bd-5ef9-423c-9c4c-3e201e2a33fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:36.443725 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8fb095bd-5ef9-423c-9c4c-3e201e2a33fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:36.444163 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8fb095bd-5ef9-423c-9c4c-3e201e2a33fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:36.581977 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-8fb095bd-5ef9-423c-9c4c-3e201e2a33fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:36.590489 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8fb095bd-5ef9-423c-9c4c-3e201e2a33fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.158899 Dec 15 12:56:36.591078 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 973/1928] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:36 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:37.131301 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 12:56:37.131541 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 12:56:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 12:56:37.608033 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-33decc62-a513-40d9-919a-6900d1ce9735 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:37.608592 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-33decc62-a513-40d9-919a-6900d1ce9735 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:37.615009 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-33decc62-a513-40d9-919a-6900d1ce9735 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:37.615454 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-33decc62-a513-40d9-919a-6900d1ce9735 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:37.616241 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-33decc62-a513-40d9-919a-6900d1ce9735 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:37.616678 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-33decc62-a513-40d9-919a-6900d1ce9735 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:37.748946 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-33decc62-a513-40d9-919a-6900d1ce9735 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:37.757028 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-33decc62-a513-40d9-919a-6900d1ce9735 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.153034 Dec 15 12:56:37.757660 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 956/1929] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:37 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:38.775737 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6c8429f2-02ee-4875-bd34-18fd27f7b38b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:38.776381 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6c8429f2-02ee-4875-bd34-18fd27f7b38b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:38.782779 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c8429f2-02ee-4875-bd34-18fd27f7b38b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:38.783231 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c8429f2-02ee-4875-bd34-18fd27f7b38b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:38.784130 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c8429f2-02ee-4875-bd34-18fd27f7b38b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:38.784863 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c8429f2-02ee-4875-bd34-18fd27f7b38b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:38.924022 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6c8429f2-02ee-4875-bd34-18fd27f7b38b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:38.931989 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6c8429f2-02ee-4875-bd34-18fd27f7b38b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.160288 Dec 15 12:56:38.932553 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 974/1930] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:38 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:39.949809 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4b1af46a-2c7e-4b9b-8643-7897e1f7151b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:39.950434 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4b1af46a-2c7e-4b9b-8643-7897e1f7151b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:39.957195 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4b1af46a-2c7e-4b9b-8643-7897e1f7151b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:39.957672 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4b1af46a-2c7e-4b9b-8643-7897e1f7151b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:39.958464 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4b1af46a-2c7e-4b9b-8643-7897e1f7151b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:39.958900 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4b1af46a-2c7e-4b9b-8643-7897e1f7151b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:39.988573 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 12:56:39.994953 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 12:56:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 (ip 10.222.0.76) !!! Dec 15 12:56:40.114211 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4b1af46a-2c7e-4b9b-8643-7897e1f7151b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:40.122333 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4b1af46a-2c7e-4b9b-8643-7897e1f7151b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.176489 Dec 15 12:56:40.122906 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 957/1931] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:39 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:41.140159 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-12212bbd-cadd-44d5-87de-0382b98157fb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:41.140768 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-12212bbd-cadd-44d5-87de-0382b98157fb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:41.147851 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-12212bbd-cadd-44d5-87de-0382b98157fb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:41.148308 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-12212bbd-cadd-44d5-87de-0382b98157fb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:41.149145 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-12212bbd-cadd-44d5-87de-0382b98157fb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:41.149627 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-12212bbd-cadd-44d5-87de-0382b98157fb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:41.288167 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-12212bbd-cadd-44d5-87de-0382b98157fb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:41.296528 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-12212bbd-cadd-44d5-87de-0382b98157fb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.159960 Dec 15 12:56:41.297101 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 975/1932] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:41 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:42.314301 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7995aa45-02bd-4474-8b15-3fa7b68c73c4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:42.314908 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7995aa45-02bd-4474-8b15-3fa7b68c73c4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:42.321218 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7995aa45-02bd-4474-8b15-3fa7b68c73c4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:42.321696 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7995aa45-02bd-4474-8b15-3fa7b68c73c4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:42.322821 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7995aa45-02bd-4474-8b15-3fa7b68c73c4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:42.323255 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7995aa45-02bd-4474-8b15-3fa7b68c73c4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:42.456429 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7995aa45-02bd-4474-8b15-3fa7b68c73c4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:42.464934 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7995aa45-02bd-4474-8b15-3fa7b68c73c4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.154226 Dec 15 12:56:42.465532 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 958/1933] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:42 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:43.482254 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1c4c830b-1907-4af8-ad78-29a2f409f151 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:43.482850 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1c4c830b-1907-4af8-ad78-29a2f409f151 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:43.489464 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1c4c830b-1907-4af8-ad78-29a2f409f151 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:43.489947 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1c4c830b-1907-4af8-ad78-29a2f409f151 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:43.490746 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1c4c830b-1907-4af8-ad78-29a2f409f151 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:43.491185 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1c4c830b-1907-4af8-ad78-29a2f409f151 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:43.625701 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1c4c830b-1907-4af8-ad78-29a2f409f151 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:43.633714 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1c4c830b-1907-4af8-ad78-29a2f409f151 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.154927 Dec 15 12:56:43.634837 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 976/1934] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:43 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:44.651192 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bc79839e-4c95-482b-81e5-cacdb02287e8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:44.652659 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bc79839e-4c95-482b-81e5-cacdb02287e8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:44.659008 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc79839e-4c95-482b-81e5-cacdb02287e8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:44.659457 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc79839e-4c95-482b-81e5-cacdb02287e8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:44.660232 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc79839e-4c95-482b-81e5-cacdb02287e8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:44.660667 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc79839e-4c95-482b-81e5-cacdb02287e8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:44.795426 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bc79839e-4c95-482b-81e5-cacdb02287e8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:44.807256 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bc79839e-4c95-482b-81e5-cacdb02287e8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.159523 Dec 15 12:56:44.808569 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 959/1935] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:44 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:45.825748 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b605b421-2448-408f-9c6e-3723dc9ea456 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:45.826338 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b605b421-2448-408f-9c6e-3723dc9ea456 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:45.832523 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b605b421-2448-408f-9c6e-3723dc9ea456 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:45.832969 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b605b421-2448-408f-9c6e-3723dc9ea456 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:45.833785 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b605b421-2448-408f-9c6e-3723dc9ea456 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:45.834220 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b605b421-2448-408f-9c6e-3723dc9ea456 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:45.966722 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b605b421-2448-408f-9c6e-3723dc9ea456 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:45.974401 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b605b421-2448-408f-9c6e-3723dc9ea456 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.152298 Dec 15 12:56:45.974956 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 977/1936] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:45 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:46.991956 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-15698b9c-a848-4cb7-b795-bc917ae27809 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:46.992577 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-15698b9c-a848-4cb7-b795-bc917ae27809 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:46.999763 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-15698b9c-a848-4cb7-b795-bc917ae27809 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:47.000213 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-15698b9c-a848-4cb7-b795-bc917ae27809 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:47.001007 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-15698b9c-a848-4cb7-b795-bc917ae27809 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:47.001441 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-15698b9c-a848-4cb7-b795-bc917ae27809 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:47.134419 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-15698b9c-a848-4cb7-b795-bc917ae27809 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:47.143090 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-15698b9c-a848-4cb7-b795-bc917ae27809 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.154852 Dec 15 12:56:47.143758 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 960/1937] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:46 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:48.159721 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8ff4a24f-fbac-4176-8e13-4216831e3a45 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:48.160327 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8ff4a24f-fbac-4176-8e13-4216831e3a45 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:48.166508 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8ff4a24f-fbac-4176-8e13-4216831e3a45 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:48.166952 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8ff4a24f-fbac-4176-8e13-4216831e3a45 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:48.167759 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8ff4a24f-fbac-4176-8e13-4216831e3a45 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:48.168186 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8ff4a24f-fbac-4176-8e13-4216831e3a45 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:48.304158 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-8ff4a24f-fbac-4176-8e13-4216831e3a45 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:48.312818 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8ff4a24f-fbac-4176-8e13-4216831e3a45 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.156790 Dec 15 12:56:48.313371 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 978/1938] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:48 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:49.330351 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ae18dd07-a099-400a-9c9d-7b5a6c98e4b2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:49.330988 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ae18dd07-a099-400a-9c9d-7b5a6c98e4b2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:49.337553 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ae18dd07-a099-400a-9c9d-7b5a6c98e4b2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:49.337997 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ae18dd07-a099-400a-9c9d-7b5a6c98e4b2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:49.338805 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ae18dd07-a099-400a-9c9d-7b5a6c98e4b2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:49.339485 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ae18dd07-a099-400a-9c9d-7b5a6c98e4b2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:49.470340 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ae18dd07-a099-400a-9c9d-7b5a6c98e4b2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:49.478016 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ae18dd07-a099-400a-9c9d-7b5a6c98e4b2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.151416 Dec 15 12:56:49.478577 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 961/1939] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:49 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:56:50.495552 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d3c352f6-ab74-421d-a106-4d63e8bfd605 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:50.496170 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d3c352f6-ab74-421d-a106-4d63e8bfd605 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:50.502468 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d3c352f6-ab74-421d-a106-4d63e8bfd605 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:50.502913 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d3c352f6-ab74-421d-a106-4d63e8bfd605 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:50.503685 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d3c352f6-ab74-421d-a106-4d63e8bfd605 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:50.504117 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d3c352f6-ab74-421d-a106-4d63e8bfd605 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:50.646184 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d3c352f6-ab74-421d-a106-4d63e8bfd605 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:50.654123 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d3c352f6-ab74-421d-a106-4d63e8bfd605 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.162220 Dec 15 12:56:50.654683 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 979/1940] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:50 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:51.674383 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f4401dbf-f6f7-47ee-a73d-6056c8dc212b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:51.675000 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f4401dbf-f6f7-47ee-a73d-6056c8dc212b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:51.681543 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f4401dbf-f6f7-47ee-a73d-6056c8dc212b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:51.682006 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f4401dbf-f6f7-47ee-a73d-6056c8dc212b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:51.683407 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f4401dbf-f6f7-47ee-a73d-6056c8dc212b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:51.683814 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f4401dbf-f6f7-47ee-a73d-6056c8dc212b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:51.821459 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-f4401dbf-f6f7-47ee-a73d-6056c8dc212b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:51.829804 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f4401dbf-f6f7-47ee-a73d-6056c8dc212b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.159099 Dec 15 12:56:51.830378 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 962/1941] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:51 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:52.846605 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-54096ab2-ab1b-4265-b7ff-f0308e47a890 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:52.847069 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-54096ab2-ab1b-4265-b7ff-f0308e47a890 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:52.853416 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-54096ab2-ab1b-4265-b7ff-f0308e47a890 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:52.853896 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-54096ab2-ab1b-4265-b7ff-f0308e47a890 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:52.855378 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-54096ab2-ab1b-4265-b7ff-f0308e47a890 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:52.855821 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-54096ab2-ab1b-4265-b7ff-f0308e47a890 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:52.997692 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-54096ab2-ab1b-4265-b7ff-f0308e47a890 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:53.006251 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-54096ab2-ab1b-4265-b7ff-f0308e47a890 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.163261 Dec 15 12:56:53.006821 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 980/1942] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:52 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:54.022973 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-43cbd918-2c75-4b66-becc-dc15fe106096 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:54.023595 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-43cbd918-2c75-4b66-becc-dc15fe106096 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:54.030021 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-43cbd918-2c75-4b66-becc-dc15fe106096 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:54.030475 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-43cbd918-2c75-4b66-becc-dc15fe106096 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:54.031276 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-43cbd918-2c75-4b66-becc-dc15fe106096 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:54.031717 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-43cbd918-2c75-4b66-becc-dc15fe106096 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:54.168254 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-43cbd918-2c75-4b66-becc-dc15fe106096 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:54.175979 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-43cbd918-2c75-4b66-becc-dc15fe106096 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.156549 Dec 15 12:56:54.176544 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 963/1943] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:54 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:55.199534 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b5c07bc9-1b40-4191-a3a3-22ecad502265 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:55.200147 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b5c07bc9-1b40-4191-a3a3-22ecad502265 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:55.206516 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5c07bc9-1b40-4191-a3a3-22ecad502265 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:55.206958 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5c07bc9-1b40-4191-a3a3-22ecad502265 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:55.207729 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5c07bc9-1b40-4191-a3a3-22ecad502265 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:55.208155 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5c07bc9-1b40-4191-a3a3-22ecad502265 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:55.346497 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b5c07bc9-1b40-4191-a3a3-22ecad502265 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:55.354201 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b5c07bc9-1b40-4191-a3a3-22ecad502265 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.158255 Dec 15 12:56:55.355447 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 981/1944] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:55 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:56.372669 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8d3c5d21-2e1b-4d6d-b29b-dee6fe8e46c3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:56.373284 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8d3c5d21-2e1b-4d6d-b29b-dee6fe8e46c3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:56.379719 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8d3c5d21-2e1b-4d6d-b29b-dee6fe8e46c3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:56.380194 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8d3c5d21-2e1b-4d6d-b29b-dee6fe8e46c3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:56.381014 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8d3c5d21-2e1b-4d6d-b29b-dee6fe8e46c3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:56.381446 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8d3c5d21-2e1b-4d6d-b29b-dee6fe8e46c3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:56.520938 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8d3c5d21-2e1b-4d6d-b29b-dee6fe8e46c3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:56.529219 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8d3c5d21-2e1b-4d6d-b29b-dee6fe8e46c3 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.160904 Dec 15 12:56:56.529821 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 964/1945] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:56 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:57.546323 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c7bcd20c-b093-4af1-ab9c-9c8de6b49922 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:57.546872 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c7bcd20c-b093-4af1-ab9c-9c8de6b49922 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:57.552957 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c7bcd20c-b093-4af1-ab9c-9c8de6b49922 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:57.553401 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c7bcd20c-b093-4af1-ab9c-9c8de6b49922 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:57.554196 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c7bcd20c-b093-4af1-ab9c-9c8de6b49922 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:57.554622 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c7bcd20c-b093-4af1-ab9c-9c8de6b49922 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:57.684764 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c7bcd20c-b093-4af1-ab9c-9c8de6b49922 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:57.701946 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c7bcd20c-b093-4af1-ab9c-9c8de6b49922 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.159247 Dec 15 12:56:57.702538 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 982/1946] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:57 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:58.718878 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5da82f7f-6a1c-4827-b91d-ebd94176427a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:58.719491 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5da82f7f-6a1c-4827-b91d-ebd94176427a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:58.725527 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5da82f7f-6a1c-4827-b91d-ebd94176427a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:58.725993 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5da82f7f-6a1c-4827-b91d-ebd94176427a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:58.726771 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5da82f7f-6a1c-4827-b91d-ebd94176427a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:58.727202 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5da82f7f-6a1c-4827-b91d-ebd94176427a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:58.875694 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5da82f7f-6a1c-4827-b91d-ebd94176427a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:56:58.883793 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5da82f7f-6a1c-4827-b91d-ebd94176427a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.168616 Dec 15 12:56:58.884401 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 965/1947] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:58 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:56:59.901491 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-051e37a4-e22c-4028-b9e0-1827b9cdc8e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:56:59.902266 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-051e37a4-e22c-4028-b9e0-1827b9cdc8e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:56:59.908064 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-051e37a4-e22c-4028-b9e0-1827b9cdc8e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:59.908506 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-051e37a4-e22c-4028-b9e0-1827b9cdc8e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:56:59.909269 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-051e37a4-e22c-4028-b9e0-1827b9cdc8e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:56:59.909803 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-051e37a4-e22c-4028-b9e0-1827b9cdc8e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:00.052784 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-051e37a4-e22c-4028-b9e0-1827b9cdc8e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:00.060665 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-051e37a4-e22c-4028-b9e0-1827b9cdc8e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.163085 Dec 15 12:57:00.061224 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 983/1948] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:56:59 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:01.077348 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6487da54-d39b-46b8-9eb3-8cd4b3883046 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:01.077990 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6487da54-d39b-46b8-9eb3-8cd4b3883046 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:01.084802 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6487da54-d39b-46b8-9eb3-8cd4b3883046 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:01.085255 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6487da54-d39b-46b8-9eb3-8cd4b3883046 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:01.086098 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6487da54-d39b-46b8-9eb3-8cd4b3883046 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:01.086532 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6487da54-d39b-46b8-9eb3-8cd4b3883046 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:01.223332 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6487da54-d39b-46b8-9eb3-8cd4b3883046 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:01.231838 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6487da54-d39b-46b8-9eb3-8cd4b3883046 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.158095 Dec 15 12:57:01.232426 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 966/1949] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:01 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:02.249885 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-adfa3ff3-ba65-45ec-a602-58e27a8f493d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:02.250439 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-adfa3ff3-ba65-45ec-a602-58e27a8f493d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:02.256334 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-adfa3ff3-ba65-45ec-a602-58e27a8f493d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:02.256784 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-adfa3ff3-ba65-45ec-a602-58e27a8f493d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:02.257589 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-adfa3ff3-ba65-45ec-a602-58e27a8f493d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:02.258031 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-adfa3ff3-ba65-45ec-a602-58e27a8f493d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:02.392056 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-adfa3ff3-ba65-45ec-a602-58e27a8f493d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:02.400811 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-adfa3ff3-ba65-45ec-a602-58e27a8f493d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.155580 Dec 15 12:57:02.401560 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 984/1950] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:02 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:03.418681 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8c4c7f1e-9631-4f7d-80ab-f4b62acd7f99 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:03.419298 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8c4c7f1e-9631-4f7d-80ab-f4b62acd7f99 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:03.425253 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c4c7f1e-9631-4f7d-80ab-f4b62acd7f99 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:03.425728 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c4c7f1e-9631-4f7d-80ab-f4b62acd7f99 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:03.426514 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c4c7f1e-9631-4f7d-80ab-f4b62acd7f99 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:03.426947 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c4c7f1e-9631-4f7d-80ab-f4b62acd7f99 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:03.560833 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8c4c7f1e-9631-4f7d-80ab-f4b62acd7f99 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:03.568899 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8c4c7f1e-9631-4f7d-80ab-f4b62acd7f99 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.154558 Dec 15 12:57:03.569685 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 967/1951] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:03 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:04.586603 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-61c7c02b-c5a5-44f3-b6fb-767f54a2adf2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:04.587518 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-61c7c02b-c5a5-44f3-b6fb-767f54a2adf2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:04.593960 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-61c7c02b-c5a5-44f3-b6fb-767f54a2adf2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:04.594415 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-61c7c02b-c5a5-44f3-b6fb-767f54a2adf2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:04.595206 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-61c7c02b-c5a5-44f3-b6fb-767f54a2adf2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:04.595641 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-61c7c02b-c5a5-44f3-b6fb-767f54a2adf2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:04.737253 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-61c7c02b-c5a5-44f3-b6fb-767f54a2adf2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:04.745648 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-61c7c02b-c5a5-44f3-b6fb-767f54a2adf2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.162617 Dec 15 12:57:04.746247 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 985/1952] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:04 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:05.764894 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4e1f6bf9-317f-4879-bbef-f25dcb9023f1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:05.765553 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4e1f6bf9-317f-4879-bbef-f25dcb9023f1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:05.771874 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e1f6bf9-317f-4879-bbef-f25dcb9023f1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:05.772313 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e1f6bf9-317f-4879-bbef-f25dcb9023f1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:05.773105 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e1f6bf9-317f-4879-bbef-f25dcb9023f1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:05.773525 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e1f6bf9-317f-4879-bbef-f25dcb9023f1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:05.908133 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4e1f6bf9-317f-4879-bbef-f25dcb9023f1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:05.915767 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4e1f6bf9-317f-4879-bbef-f25dcb9023f1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.155347 Dec 15 12:57:05.916322 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 968/1953] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:05 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:06.933158 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bdb9cc89-6759-4a01-b289-28d0f39a2982 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:06.933956 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bdb9cc89-6759-4a01-b289-28d0f39a2982 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:06.940349 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bdb9cc89-6759-4a01-b289-28d0f39a2982 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:06.940798 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bdb9cc89-6759-4a01-b289-28d0f39a2982 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:06.941610 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bdb9cc89-6759-4a01-b289-28d0f39a2982 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:06.942045 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bdb9cc89-6759-4a01-b289-28d0f39a2982 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:07.076238 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-bdb9cc89-6759-4a01-b289-28d0f39a2982 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:07.087467 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bdb9cc89-6759-4a01-b289-28d0f39a2982 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.157807 Dec 15 12:57:07.088373 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 986/1954] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:06 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:08.105623 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2b6765e9-c277-4058-ad3b-c2e2aa97ca19 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:08.106176 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2b6765e9-c277-4058-ad3b-c2e2aa97ca19 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:08.113229 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2b6765e9-c277-4058-ad3b-c2e2aa97ca19 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:08.113721 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2b6765e9-c277-4058-ad3b-c2e2aa97ca19 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:08.114504 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2b6765e9-c277-4058-ad3b-c2e2aa97ca19 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:08.114941 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2b6765e9-c277-4058-ad3b-c2e2aa97ca19 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:08.256377 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2b6765e9-c277-4058-ad3b-c2e2aa97ca19 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:08.265242 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2b6765e9-c277-4058-ad3b-c2e2aa97ca19 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.163404 Dec 15 12:57:08.266008 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 969/1955] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:08 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:57:09.282774 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d1480827-8e5e-456a-a689-366a06a570e8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:09.283382 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d1480827-8e5e-456a-a689-366a06a570e8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:09.289776 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d1480827-8e5e-456a-a689-366a06a570e8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:09.290220 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d1480827-8e5e-456a-a689-366a06a570e8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:09.291002 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d1480827-8e5e-456a-a689-366a06a570e8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:09.295415 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d1480827-8e5e-456a-a689-366a06a570e8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:09.430920 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d1480827-8e5e-456a-a689-366a06a570e8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:09.439576 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d1480827-8e5e-456a-a689-366a06a570e8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.160530 Dec 15 12:57:09.440190 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 987/1956] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:09 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:10.456722 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-81842779-bd10-4c78-a01a-23e330ef9857 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:10.457332 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-81842779-bd10-4c78-a01a-23e330ef9857 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:10.463650 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-81842779-bd10-4c78-a01a-23e330ef9857 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:10.464091 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-81842779-bd10-4c78-a01a-23e330ef9857 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:10.464856 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-81842779-bd10-4c78-a01a-23e330ef9857 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:10.465385 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-81842779-bd10-4c78-a01a-23e330ef9857 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:10.604199 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-81842779-bd10-4c78-a01a-23e330ef9857 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:10.612459 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-81842779-bd10-4c78-a01a-23e330ef9857 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.159476 Dec 15 12:57:10.613017 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 970/1957] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:10 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:11.629599 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-dad6c369-0c09-4d02-a073-b3a17749e5e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:11.630377 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-dad6c369-0c09-4d02-a073-b3a17749e5e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:11.637867 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dad6c369-0c09-4d02-a073-b3a17749e5e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:11.638321 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dad6c369-0c09-4d02-a073-b3a17749e5e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:11.639125 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dad6c369-0c09-4d02-a073-b3a17749e5e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:11.639563 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dad6c369-0c09-4d02-a073-b3a17749e5e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:11.776949 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-dad6c369-0c09-4d02-a073-b3a17749e5e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:11.785342 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-dad6c369-0c09-4d02-a073-b3a17749e5e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.159101 Dec 15 12:57:11.790618 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 988/1958] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:11 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:12.804586 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-88804c9d-66e9-4f5a-82da-70eb705ea9cc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:12.805246 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-88804c9d-66e9-4f5a-82da-70eb705ea9cc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:12.811736 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-88804c9d-66e9-4f5a-82da-70eb705ea9cc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:12.812167 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-88804c9d-66e9-4f5a-82da-70eb705ea9cc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:12.812940 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-88804c9d-66e9-4f5a-82da-70eb705ea9cc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:12.813364 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-88804c9d-66e9-4f5a-82da-70eb705ea9cc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:12.953764 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-88804c9d-66e9-4f5a-82da-70eb705ea9cc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:12.961935 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-88804c9d-66e9-4f5a-82da-70eb705ea9cc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.160762 Dec 15 12:57:12.962388 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 971/1959] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:12 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:13.979647 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d2121aa4-7a67-4a86-b940-c18ff311c949 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:13.980257 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d2121aa4-7a67-4a86-b940-c18ff311c949 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:13.987638 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d2121aa4-7a67-4a86-b940-c18ff311c949 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:13.988095 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d2121aa4-7a67-4a86-b940-c18ff311c949 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:13.988923 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d2121aa4-7a67-4a86-b940-c18ff311c949 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:13.989357 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d2121aa4-7a67-4a86-b940-c18ff311c949 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:14.122802 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d2121aa4-7a67-4a86-b940-c18ff311c949 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:14.130535 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d2121aa4-7a67-4a86-b940-c18ff311c949 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.154559 Dec 15 12:57:14.131460 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 989/1960] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:13 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:15.148638 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-66c3a7db-277d-48fe-849f-6032b2a86626 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:15.149251 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-66c3a7db-277d-48fe-849f-6032b2a86626 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:15.156395 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66c3a7db-277d-48fe-849f-6032b2a86626 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:15.156923 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66c3a7db-277d-48fe-849f-6032b2a86626 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:15.157752 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66c3a7db-277d-48fe-849f-6032b2a86626 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:15.158191 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66c3a7db-277d-48fe-849f-6032b2a86626 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:15.293005 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-66c3a7db-277d-48fe-849f-6032b2a86626 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:15.301270 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-66c3a7db-277d-48fe-849f-6032b2a86626 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.156280 Dec 15 12:57:15.301882 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 972/1961] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:15 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:16.319072 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-30fe85ca-4eb4-4bba-9faa-ab73e9d5d436 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:16.319685 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-30fe85ca-4eb4-4bba-9faa-ab73e9d5d436 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:16.326023 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-30fe85ca-4eb4-4bba-9faa-ab73e9d5d436 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:16.326475 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-30fe85ca-4eb4-4bba-9faa-ab73e9d5d436 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:16.327281 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-30fe85ca-4eb4-4bba-9faa-ab73e9d5d436 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:16.327701 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-30fe85ca-4eb4-4bba-9faa-ab73e9d5d436 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:16.459448 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-30fe85ca-4eb4-4bba-9faa-ab73e9d5d436 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:16.467257 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-30fe85ca-4eb4-4bba-9faa-ab73e9d5d436 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.151783 Dec 15 12:57:16.467765 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 990/1962] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:16 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:17.484143 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b3523066-d2aa-4485-bfed-0b7a3be92a9b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:17.484808 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b3523066-d2aa-4485-bfed-0b7a3be92a9b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:17.491419 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b3523066-d2aa-4485-bfed-0b7a3be92a9b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:17.491855 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b3523066-d2aa-4485-bfed-0b7a3be92a9b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:17.492620 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b3523066-d2aa-4485-bfed-0b7a3be92a9b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:17.493075 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b3523066-d2aa-4485-bfed-0b7a3be92a9b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:17.621740 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b3523066-d2aa-4485-bfed-0b7a3be92a9b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:17.629911 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b3523066-d2aa-4485-bfed-0b7a3be92a9b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.149452 Dec 15 12:57:17.630481 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 973/1963] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:17 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:18.647971 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d1a70ce3-5587-4903-b38d-7bdea4a08cb7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:18.648620 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d1a70ce3-5587-4903-b38d-7bdea4a08cb7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:18.654954 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d1a70ce3-5587-4903-b38d-7bdea4a08cb7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:18.655411 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d1a70ce3-5587-4903-b38d-7bdea4a08cb7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:18.656197 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d1a70ce3-5587-4903-b38d-7bdea4a08cb7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:18.657339 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d1a70ce3-5587-4903-b38d-7bdea4a08cb7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:18.793298 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d1a70ce3-5587-4903-b38d-7bdea4a08cb7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:18.801175 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d1a70ce3-5587-4903-b38d-7bdea4a08cb7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.156856 Dec 15 12:57:18.801775 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 991/1964] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:18 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:19.818543 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bbb1ef07-d1df-4fb5-a04f-b1aebad99a88 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:19.819091 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bbb1ef07-d1df-4fb5-a04f-b1aebad99a88 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:19.826687 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bbb1ef07-d1df-4fb5-a04f-b1aebad99a88 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:19.827324 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bbb1ef07-d1df-4fb5-a04f-b1aebad99a88 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:19.829011 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bbb1ef07-d1df-4fb5-a04f-b1aebad99a88 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:19.829665 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bbb1ef07-d1df-4fb5-a04f-b1aebad99a88 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:19.968329 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bbb1ef07-d1df-4fb5-a04f-b1aebad99a88 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:19.977011 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bbb1ef07-d1df-4fb5-a04f-b1aebad99a88 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.162194 Dec 15 12:57:19.977601 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 974/1965] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:19 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:57:20.994352 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5a087a85-3a94-40b1-a180-8ea5e9c25a73 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:20.994953 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5a087a85-3a94-40b1-a180-8ea5e9c25a73 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:21.001329 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5a087a85-3a94-40b1-a180-8ea5e9c25a73 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:21.001805 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5a087a85-3a94-40b1-a180-8ea5e9c25a73 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:21.002574 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5a087a85-3a94-40b1-a180-8ea5e9c25a73 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:21.003003 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5a087a85-3a94-40b1-a180-8ea5e9c25a73 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:21.135816 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5a087a85-3a94-40b1-a180-8ea5e9c25a73 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:21.143942 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5a087a85-3a94-40b1-a180-8ea5e9c25a73 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.153226 Dec 15 12:57:21.144524 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 992/1966] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:20 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:22.160888 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-14b1ed87-fc6c-42ad-8536-846e465d615c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:22.161520 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-14b1ed87-fc6c-42ad-8536-846e465d615c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:22.167851 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-14b1ed87-fc6c-42ad-8536-846e465d615c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:22.168306 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-14b1ed87-fc6c-42ad-8536-846e465d615c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:22.169077 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-14b1ed87-fc6c-42ad-8536-846e465d615c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:22.169524 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-14b1ed87-fc6c-42ad-8536-846e465d615c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:22.307264 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-14b1ed87-fc6c-42ad-8536-846e465d615c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:22.315818 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-14b1ed87-fc6c-42ad-8536-846e465d615c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.159377 Dec 15 12:57:22.316391 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 975/1967] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:22 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:23.341565 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a8b5b2b6-653a-4389-a3de-d74368bc1a8c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:23.342054 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a8b5b2b6-653a-4389-a3de-d74368bc1a8c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:23.348401 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a8b5b2b6-653a-4389-a3de-d74368bc1a8c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:23.348852 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a8b5b2b6-653a-4389-a3de-d74368bc1a8c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:23.349674 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a8b5b2b6-653a-4389-a3de-d74368bc1a8c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:23.350114 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a8b5b2b6-653a-4389-a3de-d74368bc1a8c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:23.492272 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a8b5b2b6-653a-4389-a3de-d74368bc1a8c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:23.504035 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a8b5b2b6-653a-4389-a3de-d74368bc1a8c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.166039 Dec 15 12:57:23.504761 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 993/1968] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:23 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:24.526347 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7b46e272-deb4-4c15-8e16-351dc068c407 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:24.526958 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7b46e272-deb4-4c15-8e16-351dc068c407 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:24.533578 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7b46e272-deb4-4c15-8e16-351dc068c407 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:24.534021 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7b46e272-deb4-4c15-8e16-351dc068c407 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:24.534799 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7b46e272-deb4-4c15-8e16-351dc068c407 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:24.535230 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7b46e272-deb4-4c15-8e16-351dc068c407 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:24.681070 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7b46e272-deb4-4c15-8e16-351dc068c407 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:24.690039 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7b46e272-deb4-4c15-8e16-351dc068c407 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.171832 Dec 15 12:57:24.690638 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 976/1969] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:24 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:25.709302 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5ba95dbe-e590-473f-a60c-13f94d2b0007 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:25.709963 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5ba95dbe-e590-473f-a60c-13f94d2b0007 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:25.716550 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5ba95dbe-e590-473f-a60c-13f94d2b0007 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:25.716999 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5ba95dbe-e590-473f-a60c-13f94d2b0007 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:25.717831 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5ba95dbe-e590-473f-a60c-13f94d2b0007 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:25.718316 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5ba95dbe-e590-473f-a60c-13f94d2b0007 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:25.860932 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5ba95dbe-e590-473f-a60c-13f94d2b0007 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:25.868984 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5ba95dbe-e590-473f-a60c-13f94d2b0007 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.164877 Dec 15 12:57:25.869581 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 994/1970] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:25 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:26.890047 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1f24b1c8-fe1e-49f8-8bed-cbdd1e67f614 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:26.891331 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1f24b1c8-fe1e-49f8-8bed-cbdd1e67f614 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:26.898107 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1f24b1c8-fe1e-49f8-8bed-cbdd1e67f614 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:26.898551 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1f24b1c8-fe1e-49f8-8bed-cbdd1e67f614 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:26.899347 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1f24b1c8-fe1e-49f8-8bed-cbdd1e67f614 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:26.899781 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1f24b1c8-fe1e-49f8-8bed-cbdd1e67f614 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:27.034230 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1f24b1c8-fe1e-49f8-8bed-cbdd1e67f614 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:27.045067 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1f24b1c8-fe1e-49f8-8bed-cbdd1e67f614 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.158727 Dec 15 12:57:27.045698 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 977/1971] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:26 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:28.062245 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ff76732b-3a14-48f9-b949-1bbb6cc077e7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:28.063624 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ff76732b-3a14-48f9-b949-1bbb6cc077e7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:28.069923 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ff76732b-3a14-48f9-b949-1bbb6cc077e7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:28.070305 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ff76732b-3a14-48f9-b949-1bbb6cc077e7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:28.071073 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ff76732b-3a14-48f9-b949-1bbb6cc077e7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:28.071499 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ff76732b-3a14-48f9-b949-1bbb6cc077e7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:28.211235 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ff76732b-3a14-48f9-b949-1bbb6cc077e7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:28.219660 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ff76732b-3a14-48f9-b949-1bbb6cc077e7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.160471 Dec 15 12:57:28.220392 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 995/1972] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:28 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:29.238374 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-82fce673-0ac5-4f9f-a6cd-ddd5d096b2f4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:29.239149 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-82fce673-0ac5-4f9f-a6cd-ddd5d096b2f4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:29.246449 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-82fce673-0ac5-4f9f-a6cd-ddd5d096b2f4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:29.246894 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-82fce673-0ac5-4f9f-a6cd-ddd5d096b2f4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:29.247704 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-82fce673-0ac5-4f9f-a6cd-ddd5d096b2f4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:29.248134 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-82fce673-0ac5-4f9f-a6cd-ddd5d096b2f4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:29.383012 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-82fce673-0ac5-4f9f-a6cd-ddd5d096b2f4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:29.398826 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-82fce673-0ac5-4f9f-a6cd-ddd5d096b2f4 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.157269 Dec 15 12:57:29.399480 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 978/1973] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:29 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:30.416554 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-18807bd5-e572-4673-88ef-e635356847d8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:30.417185 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-18807bd5-e572-4673-88ef-e635356847d8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:30.423453 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-18807bd5-e572-4673-88ef-e635356847d8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:30.423897 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-18807bd5-e572-4673-88ef-e635356847d8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:30.424679 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-18807bd5-e572-4673-88ef-e635356847d8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:30.425113 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-18807bd5-e572-4673-88ef-e635356847d8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:30.558784 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-18807bd5-e572-4673-88ef-e635356847d8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:30.567795 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-18807bd5-e572-4673-88ef-e635356847d8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.155048 Dec 15 12:57:30.568363 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 996/1974] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:30 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:31.585403 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d1ce82a3-8613-48ef-8acb-45132c375562 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:31.585999 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d1ce82a3-8613-48ef-8acb-45132c375562 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:31.592983 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d1ce82a3-8613-48ef-8acb-45132c375562 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:31.593408 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d1ce82a3-8613-48ef-8acb-45132c375562 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:31.594233 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d1ce82a3-8613-48ef-8acb-45132c375562 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:31.594753 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d1ce82a3-8613-48ef-8acb-45132c375562 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:31.730650 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d1ce82a3-8613-48ef-8acb-45132c375562 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:31.739062 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d1ce82a3-8613-48ef-8acb-45132c375562 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.157501 Dec 15 12:57:31.739796 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 979/1975] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:31 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:32.756697 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2bd6651e-743d-41e0-95cf-060ece11ce32 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:32.757327 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2bd6651e-743d-41e0-95cf-060ece11ce32 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:32.763828 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2bd6651e-743d-41e0-95cf-060ece11ce32 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:32.764267 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2bd6651e-743d-41e0-95cf-060ece11ce32 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:32.765037 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2bd6651e-743d-41e0-95cf-060ece11ce32 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:32.765461 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2bd6651e-743d-41e0-95cf-060ece11ce32 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:32.911851 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2bd6651e-743d-41e0-95cf-060ece11ce32 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:32.919389 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2bd6651e-743d-41e0-95cf-060ece11ce32 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.166379 Dec 15 12:57:32.919946 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 997/1976] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:32 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:33.936487 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-05d853f8-90a1-4442-86f8-71507ba8a973 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:33.937108 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-05d853f8-90a1-4442-86f8-71507ba8a973 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:33.943695 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-05d853f8-90a1-4442-86f8-71507ba8a973 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:33.944139 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-05d853f8-90a1-4442-86f8-71507ba8a973 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:33.944927 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-05d853f8-90a1-4442-86f8-71507ba8a973 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:33.945355 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-05d853f8-90a1-4442-86f8-71507ba8a973 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:34.081664 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-05d853f8-90a1-4442-86f8-71507ba8a973 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:34.090120 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-05d853f8-90a1-4442-86f8-71507ba8a973 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.157696 Dec 15 12:57:34.091391 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 980/1977] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:33 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:35.107063 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b134d67a-1468-4bad-87dc-8ec3809abc7a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:35.107701 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b134d67a-1468-4bad-87dc-8ec3809abc7a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:35.114237 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b134d67a-1468-4bad-87dc-8ec3809abc7a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:35.114680 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b134d67a-1468-4bad-87dc-8ec3809abc7a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:35.115480 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b134d67a-1468-4bad-87dc-8ec3809abc7a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:35.115914 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b134d67a-1468-4bad-87dc-8ec3809abc7a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:35.265560 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b134d67a-1468-4bad-87dc-8ec3809abc7a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:35.274293 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b134d67a-1468-4bad-87dc-8ec3809abc7a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.170879 Dec 15 12:57:35.274861 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 998/1978] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:35 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:36.295228 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-87cccd40-c882-445a-ab8e-7d7ab750bb17 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:36.295937 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-87cccd40-c882-445a-ab8e-7d7ab750bb17 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:36.302198 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-87cccd40-c882-445a-ab8e-7d7ab750bb17 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:36.302644 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-87cccd40-c882-445a-ab8e-7d7ab750bb17 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:36.303427 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-87cccd40-c882-445a-ab8e-7d7ab750bb17 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:36.303857 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-87cccd40-c882-445a-ab8e-7d7ab750bb17 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:36.437922 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-87cccd40-c882-445a-ab8e-7d7ab750bb17 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:36.445806 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-87cccd40-c882-445a-ab8e-7d7ab750bb17 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.154314 Dec 15 12:57:36.446369 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 981/1979] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:36 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:37.464090 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a70e7944-02d0-4ea6-88a6-210de8ab14fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:37.465109 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a70e7944-02d0-4ea6-88a6-210de8ab14fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:37.474840 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a70e7944-02d0-4ea6-88a6-210de8ab14fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:37.475288 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a70e7944-02d0-4ea6-88a6-210de8ab14fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:37.476083 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a70e7944-02d0-4ea6-88a6-210de8ab14fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:37.476524 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a70e7944-02d0-4ea6-88a6-210de8ab14fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:37.615092 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a70e7944-02d0-4ea6-88a6-210de8ab14fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:37.623600 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a70e7944-02d0-4ea6-88a6-210de8ab14fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.163542 Dec 15 12:57:37.624335 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 999/1980] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:37 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:38.641123 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4887bebb-fbad-488e-b6e1-b8d59888a99f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:38.641745 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4887bebb-fbad-488e-b6e1-b8d59888a99f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:38.656300 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4887bebb-fbad-488e-b6e1-b8d59888a99f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:38.656300 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4887bebb-fbad-488e-b6e1-b8d59888a99f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:38.656300 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4887bebb-fbad-488e-b6e1-b8d59888a99f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:38.656300 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4887bebb-fbad-488e-b6e1-b8d59888a99f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:38.985281 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4887bebb-fbad-488e-b6e1-b8d59888a99f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:38.993898 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4887bebb-fbad-488e-b6e1-b8d59888a99f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.356410 Dec 15 12:57:38.994475 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 982/1981] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:38 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:40.010493 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0d6ab3a5-2daf-4263-9247-d12c4624d19b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:40.011117 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0d6ab3a5-2daf-4263-9247-d12c4624d19b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:40.018768 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0d6ab3a5-2daf-4263-9247-d12c4624d19b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:40.019226 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0d6ab3a5-2daf-4263-9247-d12c4624d19b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:40.020341 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0d6ab3a5-2daf-4263-9247-d12c4624d19b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:40.020821 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0d6ab3a5-2daf-4263-9247-d12c4624d19b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:40.163124 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0d6ab3a5-2daf-4263-9247-d12c4624d19b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:40.171010 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0d6ab3a5-2daf-4263-9247-d12c4624d19b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.164476 Dec 15 12:57:40.171581 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1000/1982] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:40 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:41.188083 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-76ec0f67-6273-4354-a9eb-c9e255757995 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:41.188692 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-76ec0f67-6273-4354-a9eb-c9e255757995 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:41.195521 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-76ec0f67-6273-4354-a9eb-c9e255757995 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:41.195959 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-76ec0f67-6273-4354-a9eb-c9e255757995 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:41.196724 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-76ec0f67-6273-4354-a9eb-c9e255757995 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:41.197152 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-76ec0f67-6273-4354-a9eb-c9e255757995 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:41.340660 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-76ec0f67-6273-4354-a9eb-c9e255757995 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:41.348574 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-76ec0f67-6273-4354-a9eb-c9e255757995 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.164201 Dec 15 12:57:41.349137 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 983/1983] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:41 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:42.366548 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3c98716c-0700-4561-bc19-e133e1d2ff5c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:42.367207 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3c98716c-0700-4561-bc19-e133e1d2ff5c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:42.374308 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3c98716c-0700-4561-bc19-e133e1d2ff5c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:42.374495 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3c98716c-0700-4561-bc19-e133e1d2ff5c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:42.375683 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3c98716c-0700-4561-bc19-e133e1d2ff5c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:42.376286 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3c98716c-0700-4561-bc19-e133e1d2ff5c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:42.520470 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3c98716c-0700-4561-bc19-e133e1d2ff5c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:42.529835 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3c98716c-0700-4561-bc19-e133e1d2ff5c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.167067 Dec 15 12:57:42.530426 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1001/1984] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:42 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:43.547047 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2acb34e8-de18-45bd-bd9a-59570989f2da tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:43.547657 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2acb34e8-de18-45bd-bd9a-59570989f2da tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:43.555043 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2acb34e8-de18-45bd-bd9a-59570989f2da tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:43.555415 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2acb34e8-de18-45bd-bd9a-59570989f2da tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:43.556184 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2acb34e8-de18-45bd-bd9a-59570989f2da tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:43.556606 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2acb34e8-de18-45bd-bd9a-59570989f2da tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:43.706465 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2acb34e8-de18-45bd-bd9a-59570989f2da tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:43.714658 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2acb34e8-de18-45bd-bd9a-59570989f2da tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.171083 Dec 15 12:57:43.715214 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 984/1985] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:43 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:44.732001 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-86060807-96b3-4fb4-87b2-4bbf05712d03 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:44.732603 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-86060807-96b3-4fb4-87b2-4bbf05712d03 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:44.739413 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-86060807-96b3-4fb4-87b2-4bbf05712d03 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:44.739867 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-86060807-96b3-4fb4-87b2-4bbf05712d03 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:44.740648 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-86060807-96b3-4fb4-87b2-4bbf05712d03 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:44.741086 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-86060807-96b3-4fb4-87b2-4bbf05712d03 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:44.893455 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-86060807-96b3-4fb4-87b2-4bbf05712d03 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:44.901292 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-86060807-96b3-4fb4-87b2-4bbf05712d03 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.172918 Dec 15 12:57:44.901900 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1002/1986] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:44 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:45.918940 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-465e4457-7bc9-46ea-967a-f32adcc867e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:45.919554 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-465e4457-7bc9-46ea-967a-f32adcc867e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:45.926257 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-465e4457-7bc9-46ea-967a-f32adcc867e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:45.926706 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-465e4457-7bc9-46ea-967a-f32adcc867e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:45.927484 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-465e4457-7bc9-46ea-967a-f32adcc867e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:45.927915 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-465e4457-7bc9-46ea-967a-f32adcc867e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:46.057826 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-465e4457-7bc9-46ea-967a-f32adcc867e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:46.065912 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-465e4457-7bc9-46ea-967a-f32adcc867e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.150563 Dec 15 12:57:46.066595 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 985/1987] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:45 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:47.083291 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3bd6eeef-e661-41de-b56e-aa2223aff8f5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:47.083917 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3bd6eeef-e661-41de-b56e-aa2223aff8f5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:47.091044 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3bd6eeef-e661-41de-b56e-aa2223aff8f5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:47.091495 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3bd6eeef-e661-41de-b56e-aa2223aff8f5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:47.092273 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3bd6eeef-e661-41de-b56e-aa2223aff8f5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:47.092711 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3bd6eeef-e661-41de-b56e-aa2223aff8f5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:47.226614 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3bd6eeef-e661-41de-b56e-aa2223aff8f5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:47.234355 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3bd6eeef-e661-41de-b56e-aa2223aff8f5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.154688 Dec 15 12:57:47.234905 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1003/1988] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:47 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:48.252305 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f473946d-0055-4fef-803e-9e63f75d09cd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:48.253097 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f473946d-0055-4fef-803e-9e63f75d09cd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:48.259465 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f473946d-0055-4fef-803e-9e63f75d09cd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:48.259938 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f473946d-0055-4fef-803e-9e63f75d09cd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:48.260793 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f473946d-0055-4fef-803e-9e63f75d09cd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:48.261228 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f473946d-0055-4fef-803e-9e63f75d09cd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:48.393620 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-f473946d-0055-4fef-803e-9e63f75d09cd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:48.401356 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f473946d-0055-4fef-803e-9e63f75d09cd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.152701 Dec 15 12:57:48.401950 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 986/1989] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:48 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:48.756134 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 12:57:48.756389 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 12:57:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 12:57:49.419299 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c4cb531f-2789-419e-bede-6c75bf511899 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:49.419935 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c4cb531f-2789-419e-bede-6c75bf511899 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:49.427015 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c4cb531f-2789-419e-bede-6c75bf511899 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:49.427459 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c4cb531f-2789-419e-bede-6c75bf511899 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:49.428227 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c4cb531f-2789-419e-bede-6c75bf511899 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:49.428653 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c4cb531f-2789-419e-bede-6c75bf511899 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:49.574925 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c4cb531f-2789-419e-bede-6c75bf511899 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:49.582938 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c4cb531f-2789-419e-bede-6c75bf511899 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.167374 Dec 15 12:57:49.583488 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1004/1990] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:49 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:50.599799 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-cc3562ce-83ed-4f1c-a017-2437178805b8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:50.600376 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-cc3562ce-83ed-4f1c-a017-2437178805b8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:50.607119 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc3562ce-83ed-4f1c-a017-2437178805b8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:50.607572 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc3562ce-83ed-4f1c-a017-2437178805b8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:50.608397 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc3562ce-83ed-4f1c-a017-2437178805b8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:50.608831 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc3562ce-83ed-4f1c-a017-2437178805b8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:50.750048 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-cc3562ce-83ed-4f1c-a017-2437178805b8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:50.759172 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cc3562ce-83ed-4f1c-a017-2437178805b8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.162950 Dec 15 12:57:50.766784 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 987/1991] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:50 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:57:51.782999 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-09895847-b555-4f0f-805a-f0d40c8abf04 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:51.784098 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-09895847-b555-4f0f-805a-f0d40c8abf04 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:51.790400 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-09895847-b555-4f0f-805a-f0d40c8abf04 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:51.790883 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-09895847-b555-4f0f-805a-f0d40c8abf04 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:51.791718 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-09895847-b555-4f0f-805a-f0d40c8abf04 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:51.792312 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-09895847-b555-4f0f-805a-f0d40c8abf04 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:51.930674 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-09895847-b555-4f0f-805a-f0d40c8abf04 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:51.938290 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-09895847-b555-4f0f-805a-f0d40c8abf04 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.159003 Dec 15 12:57:51.938861 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1005/1992] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:51 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:52.955809 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-76e32fc3-b4a6-48a8-a152-156cb1e88693 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:52.956457 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-76e32fc3-b4a6-48a8-a152-156cb1e88693 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:52.963719 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-76e32fc3-b4a6-48a8-a152-156cb1e88693 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:52.964166 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-76e32fc3-b4a6-48a8-a152-156cb1e88693 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:52.964967 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-76e32fc3-b4a6-48a8-a152-156cb1e88693 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:52.965407 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-76e32fc3-b4a6-48a8-a152-156cb1e88693 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:53.103170 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-76e32fc3-b4a6-48a8-a152-156cb1e88693 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:53.112935 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-76e32fc3-b4a6-48a8-a152-156cb1e88693 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.160818 Dec 15 12:57:53.113777 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 988/1993] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:52 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:54.130133 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-39f6aaf3-ba1b-4370-98bb-c5e667a4b2af tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:54.130805 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-39f6aaf3-ba1b-4370-98bb-c5e667a4b2af tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:54.137413 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-39f6aaf3-ba1b-4370-98bb-c5e667a4b2af tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:54.137935 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-39f6aaf3-ba1b-4370-98bb-c5e667a4b2af tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:54.138730 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-39f6aaf3-ba1b-4370-98bb-c5e667a4b2af tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:54.139193 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-39f6aaf3-ba1b-4370-98bb-c5e667a4b2af tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:54.279593 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-39f6aaf3-ba1b-4370-98bb-c5e667a4b2af tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:54.287973 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-39f6aaf3-ba1b-4370-98bb-c5e667a4b2af tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.161687 Dec 15 12:57:54.288548 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1006/1994] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:54 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:55.305721 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9006cdba-37c7-442d-a22d-4820991d0492 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:55.306328 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9006cdba-37c7-442d-a22d-4820991d0492 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:55.312571 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9006cdba-37c7-442d-a22d-4820991d0492 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:55.313009 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9006cdba-37c7-442d-a22d-4820991d0492 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:55.313799 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9006cdba-37c7-442d-a22d-4820991d0492 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:55.314220 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9006cdba-37c7-442d-a22d-4820991d0492 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:55.448115 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9006cdba-37c7-442d-a22d-4820991d0492 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:55.456527 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9006cdba-37c7-442d-a22d-4820991d0492 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.154404 Dec 15 12:57:55.457254 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 989/1995] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:55 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:56.474546 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6cbeca84-ad1a-4183-99c0-18f5e940c4de tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:56.475091 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6cbeca84-ad1a-4183-99c0-18f5e940c4de tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:56.481314 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6cbeca84-ad1a-4183-99c0-18f5e940c4de tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:56.481789 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6cbeca84-ad1a-4183-99c0-18f5e940c4de tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:56.482558 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6cbeca84-ad1a-4183-99c0-18f5e940c4de tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:56.482985 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6cbeca84-ad1a-4183-99c0-18f5e940c4de tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:56.615822 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6cbeca84-ad1a-4183-99c0-18f5e940c4de tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:56.623671 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6cbeca84-ad1a-4183-99c0-18f5e940c4de tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.153066 Dec 15 12:57:56.624226 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1007/1996] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:56 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:57.641828 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ec564903-4efb-4cde-816a-6d33b1a10419 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:57.642447 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ec564903-4efb-4cde-816a-6d33b1a10419 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:57.650022 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ec564903-4efb-4cde-816a-6d33b1a10419 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:57.650379 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ec564903-4efb-4cde-816a-6d33b1a10419 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:57.651206 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ec564903-4efb-4cde-816a-6d33b1a10419 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:57.651780 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ec564903-4efb-4cde-816a-6d33b1a10419 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:57.792002 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ec564903-4efb-4cde-816a-6d33b1a10419 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:57.802162 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ec564903-4efb-4cde-816a-6d33b1a10419 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.164014 Dec 15 12:57:57.802823 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 990/1997] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:57 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:58.458101 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 12:57:58.458652 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 12:57:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 12:57:58.819467 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-84676089-36c1-40b1-b9a8-3e87a581c5d9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:58.819996 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-84676089-36c1-40b1-b9a8-3e87a581c5d9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:57:58.826230 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-84676089-36c1-40b1-b9a8-3e87a581c5d9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:58.826678 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-84676089-36c1-40b1-b9a8-3e87a581c5d9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:58.827446 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-84676089-36c1-40b1-b9a8-3e87a581c5d9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:57:58.827880 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-84676089-36c1-40b1-b9a8-3e87a581c5d9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:57:58.968089 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-84676089-36c1-40b1-b9a8-3e87a581c5d9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:57:58.977197 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-84676089-36c1-40b1-b9a8-3e87a581c5d9 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.161394 Dec 15 12:57:58.977806 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1008/1998] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:58 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:57:59.994977 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0e9e7ef2-aa79-4cc1-863f-e81a96754c93 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:57:59.995555 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0e9e7ef2-aa79-4cc1-863f-e81a96754c93 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:00.001572 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e9e7ef2-aa79-4cc1-863f-e81a96754c93 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:00.002015 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e9e7ef2-aa79-4cc1-863f-e81a96754c93 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:00.002784 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e9e7ef2-aa79-4cc1-863f-e81a96754c93 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:00.003210 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e9e7ef2-aa79-4cc1-863f-e81a96754c93 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:00.142530 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0e9e7ef2-aa79-4cc1-863f-e81a96754c93 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:00.151498 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0e9e7ef2-aa79-4cc1-863f-e81a96754c93 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.160654 Dec 15 12:58:00.152089 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 991/1999] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:57:59 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:01.169287 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b27c6429-96eb-4851-9595-6f11399c7573 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:01.169925 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b27c6429-96eb-4851-9595-6f11399c7573 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:01.176050 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b27c6429-96eb-4851-9595-6f11399c7573 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:01.176492 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b27c6429-96eb-4851-9595-6f11399c7573 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:01.177261 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b27c6429-96eb-4851-9595-6f11399c7573 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:01.177756 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b27c6429-96eb-4851-9595-6f11399c7573 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:01.323481 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b27c6429-96eb-4851-9595-6f11399c7573 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:01.331300 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b27c6429-96eb-4851-9595-6f11399c7573 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.165781 Dec 15 12:58:01.332490 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1009/2000] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:01 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:02.349600 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a044de11-0fe1-488e-a102-acd380907ccb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:02.350205 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a044de11-0fe1-488e-a102-acd380907ccb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:02.356467 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a044de11-0fe1-488e-a102-acd380907ccb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:02.356907 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a044de11-0fe1-488e-a102-acd380907ccb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:02.357699 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a044de11-0fe1-488e-a102-acd380907ccb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:02.358129 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a044de11-0fe1-488e-a102-acd380907ccb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:02.490825 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a044de11-0fe1-488e-a102-acd380907ccb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:02.498774 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a044de11-0fe1-488e-a102-acd380907ccb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.153416 Dec 15 12:58:02.499362 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 992/2001] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:02 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:03.515928 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2063bc1d-5e44-4c50-a2e2-38c052b4473a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:03.516535 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2063bc1d-5e44-4c50-a2e2-38c052b4473a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:03.523109 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2063bc1d-5e44-4c50-a2e2-38c052b4473a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:03.523294 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2063bc1d-5e44-4c50-a2e2-38c052b4473a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:03.524074 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2063bc1d-5e44-4c50-a2e2-38c052b4473a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:03.524498 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2063bc1d-5e44-4c50-a2e2-38c052b4473a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:03.670666 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2063bc1d-5e44-4c50-a2e2-38c052b4473a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:03.679569 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2063bc1d-5e44-4c50-a2e2-38c052b4473a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.167289 Dec 15 12:58:03.680140 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1010/2002] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:03 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:04.696112 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-880944b2-fe13-4030-9125-801cff24c563 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:04.697035 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-880944b2-fe13-4030-9125-801cff24c563 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:04.703345 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-880944b2-fe13-4030-9125-801cff24c563 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:04.703783 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-880944b2-fe13-4030-9125-801cff24c563 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:04.704562 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-880944b2-fe13-4030-9125-801cff24c563 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:04.704982 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-880944b2-fe13-4030-9125-801cff24c563 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:04.839445 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-880944b2-fe13-4030-9125-801cff24c563 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:04.847544 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-880944b2-fe13-4030-9125-801cff24c563 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.155082 Dec 15 12:58:04.848121 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 993/2003] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:04 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:05.866134 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f51342e5-c856-4fb6-ae3b-0c3d61f1aec7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:05.866709 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f51342e5-c856-4fb6-ae3b-0c3d61f1aec7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:05.872908 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f51342e5-c856-4fb6-ae3b-0c3d61f1aec7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:05.873348 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f51342e5-c856-4fb6-ae3b-0c3d61f1aec7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:05.874158 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f51342e5-c856-4fb6-ae3b-0c3d61f1aec7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:05.874591 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f51342e5-c856-4fb6-ae3b-0c3d61f1aec7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:06.027249 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f51342e5-c856-4fb6-ae3b-0c3d61f1aec7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:06.035556 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f51342e5-c856-4fb6-ae3b-0c3d61f1aec7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.173033 Dec 15 12:58:06.036141 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1011/2004] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:05 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:07.052099 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c75d271c-7073-451b-9cdd-a7575de6d937 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:07.052729 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c75d271c-7073-451b-9cdd-a7575de6d937 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:07.058989 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c75d271c-7073-451b-9cdd-a7575de6d937 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:07.059434 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c75d271c-7073-451b-9cdd-a7575de6d937 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:07.060213 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c75d271c-7073-451b-9cdd-a7575de6d937 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:07.060643 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c75d271c-7073-451b-9cdd-a7575de6d937 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:07.200290 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c75d271c-7073-451b-9cdd-a7575de6d937 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:07.208544 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c75d271c-7073-451b-9cdd-a7575de6d937 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.159536 Dec 15 12:58:07.209255 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 994/2005] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:07 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:08.225910 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7d39b706-9eb6-4ecf-9b3d-ce80d17d38fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:08.226476 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7d39b706-9eb6-4ecf-9b3d-ce80d17d38fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:08.233008 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7d39b706-9eb6-4ecf-9b3d-ce80d17d38fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:08.233457 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7d39b706-9eb6-4ecf-9b3d-ce80d17d38fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:08.234278 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7d39b706-9eb6-4ecf-9b3d-ce80d17d38fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:08.234709 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7d39b706-9eb6-4ecf-9b3d-ce80d17d38fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:08.371973 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7d39b706-9eb6-4ecf-9b3d-ce80d17d38fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:08.379780 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7d39b706-9eb6-4ecf-9b3d-ce80d17d38fd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.158127 Dec 15 12:58:08.380501 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1012/2006] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:08 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:09.397395 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2574002e-dfc4-4086-bca7-cb077c21bb16 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:09.398062 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2574002e-dfc4-4086-bca7-cb077c21bb16 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:09.404299 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2574002e-dfc4-4086-bca7-cb077c21bb16 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:09.404777 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2574002e-dfc4-4086-bca7-cb077c21bb16 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:09.405578 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2574002e-dfc4-4086-bca7-cb077c21bb16 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:09.406013 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2574002e-dfc4-4086-bca7-cb077c21bb16 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:09.543313 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2574002e-dfc4-4086-bca7-cb077c21bb16 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:09.550964 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2574002e-dfc4-4086-bca7-cb077c21bb16 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.157237 Dec 15 12:58:09.551575 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 995/2007] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:09 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:10.568976 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0ee7f19c-5f4e-4301-afb6-88c76a53efaf tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:10.569544 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0ee7f19c-5f4e-4301-afb6-88c76a53efaf tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:10.576197 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0ee7f19c-5f4e-4301-afb6-88c76a53efaf tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:10.576638 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0ee7f19c-5f4e-4301-afb6-88c76a53efaf tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:10.577422 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0ee7f19c-5f4e-4301-afb6-88c76a53efaf tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:10.577901 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0ee7f19c-5f4e-4301-afb6-88c76a53efaf tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:10.711085 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0ee7f19c-5f4e-4301-afb6-88c76a53efaf tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:10.718939 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0ee7f19c-5f4e-4301-afb6-88c76a53efaf tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.153959 Dec 15 12:58:10.719495 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1013/2008] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:10 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:11.736565 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d3a1972c-1095-41d3-bbd1-d7eb63f61d3a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:11.737159 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d3a1972c-1095-41d3-bbd1-d7eb63f61d3a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:11.744258 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d3a1972c-1095-41d3-bbd1-d7eb63f61d3a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:11.744715 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d3a1972c-1095-41d3-bbd1-d7eb63f61d3a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:11.745496 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d3a1972c-1095-41d3-bbd1-d7eb63f61d3a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:11.745953 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d3a1972c-1095-41d3-bbd1-d7eb63f61d3a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:11.887912 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d3a1972c-1095-41d3-bbd1-d7eb63f61d3a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:11.895549 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d3a1972c-1095-41d3-bbd1-d7eb63f61d3a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.162661 Dec 15 12:58:11.896116 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 996/2009] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:11 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:12.912701 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c811afc2-1b71-42d7-b4be-28c4f2e884fc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:12.913327 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c811afc2-1b71-42d7-b4be-28c4f2e884fc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:12.919994 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c811afc2-1b71-42d7-b4be-28c4f2e884fc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:12.920441 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c811afc2-1b71-42d7-b4be-28c4f2e884fc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:12.921234 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c811afc2-1b71-42d7-b4be-28c4f2e884fc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:12.921698 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c811afc2-1b71-42d7-b4be-28c4f2e884fc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:13.063887 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c811afc2-1b71-42d7-b4be-28c4f2e884fc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:13.073536 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c811afc2-1b71-42d7-b4be-28c4f2e884fc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.164493 Dec 15 12:58:13.074163 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1014/2010] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:12 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:14.090866 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2e693472-2cd7-4aa2-866f-df1b3bab8f9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:14.091486 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2e693472-2cd7-4aa2-866f-df1b3bab8f9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:14.097539 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2e693472-2cd7-4aa2-866f-df1b3bab8f9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:14.097977 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2e693472-2cd7-4aa2-866f-df1b3bab8f9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:14.098880 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2e693472-2cd7-4aa2-866f-df1b3bab8f9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:14.099286 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2e693472-2cd7-4aa2-866f-df1b3bab8f9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:14.232445 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2e693472-2cd7-4aa2-866f-df1b3bab8f9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:14.240298 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2e693472-2cd7-4aa2-866f-df1b3bab8f9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.153044 Dec 15 12:58:14.240859 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 997/2011] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:14 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:15.257241 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-be955021-75de-45ef-99f7-fe099bdcfed1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:15.257892 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-be955021-75de-45ef-99f7-fe099bdcfed1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:15.264946 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-be955021-75de-45ef-99f7-fe099bdcfed1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:15.265403 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-be955021-75de-45ef-99f7-fe099bdcfed1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:15.266255 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-be955021-75de-45ef-99f7-fe099bdcfed1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:15.266699 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-be955021-75de-45ef-99f7-fe099bdcfed1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:15.406313 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-be955021-75de-45ef-99f7-fe099bdcfed1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:15.415166 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-be955021-75de-45ef-99f7-fe099bdcfed1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.161763 Dec 15 12:58:15.418795 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1015/2012] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:15 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:16.435532 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-da361723-3fdf-4449-bbfa-2064189bf7fc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:16.436162 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-da361723-3fdf-4449-bbfa-2064189bf7fc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:16.442544 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-da361723-3fdf-4449-bbfa-2064189bf7fc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:16.443021 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-da361723-3fdf-4449-bbfa-2064189bf7fc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:16.443799 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-da361723-3fdf-4449-bbfa-2064189bf7fc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:16.444234 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-da361723-3fdf-4449-bbfa-2064189bf7fc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:16.580524 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-da361723-3fdf-4449-bbfa-2064189bf7fc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:16.589119 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-da361723-3fdf-4449-bbfa-2064189bf7fc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.157239 Dec 15 12:58:16.590074 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 998/2013] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:16 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:17.606762 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-317e1f7b-63ef-4e4a-9e89-ca2022a8e18b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:17.607428 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-317e1f7b-63ef-4e4a-9e89-ca2022a8e18b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:17.614613 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-317e1f7b-63ef-4e4a-9e89-ca2022a8e18b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:17.615145 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-317e1f7b-63ef-4e4a-9e89-ca2022a8e18b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:17.615943 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-317e1f7b-63ef-4e4a-9e89-ca2022a8e18b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:17.616368 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-317e1f7b-63ef-4e4a-9e89-ca2022a8e18b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:17.752892 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-317e1f7b-63ef-4e4a-9e89-ca2022a8e18b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:17.761200 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-317e1f7b-63ef-4e4a-9e89-ca2022a8e18b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.158175 Dec 15 12:58:17.761812 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1016/2014] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:17 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:18.778801 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b5b1903b-2e5b-4d62-86d1-614b8483cdcb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:18.779403 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b5b1903b-2e5b-4d62-86d1-614b8483cdcb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:18.786191 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b5b1903b-2e5b-4d62-86d1-614b8483cdcb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:18.786637 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b5b1903b-2e5b-4d62-86d1-614b8483cdcb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:18.787409 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b5b1903b-2e5b-4d62-86d1-614b8483cdcb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:18.787842 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b5b1903b-2e5b-4d62-86d1-614b8483cdcb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:18.918281 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b5b1903b-2e5b-4d62-86d1-614b8483cdcb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:18.926634 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b5b1903b-2e5b-4d62-86d1-614b8483cdcb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.151460 Dec 15 12:58:18.927217 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 999/2015] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:18 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:19.945800 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2d0dad72-7c81-427f-97b7-8d98bcf2aed6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:19.946656 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2d0dad72-7c81-427f-97b7-8d98bcf2aed6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:19.953377 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2d0dad72-7c81-427f-97b7-8d98bcf2aed6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:19.953853 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2d0dad72-7c81-427f-97b7-8d98bcf2aed6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:19.954631 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2d0dad72-7c81-427f-97b7-8d98bcf2aed6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:19.955064 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2d0dad72-7c81-427f-97b7-8d98bcf2aed6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:20.098546 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2d0dad72-7c81-427f-97b7-8d98bcf2aed6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:20.106368 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2d0dad72-7c81-427f-97b7-8d98bcf2aed6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.165808 Dec 15 12:58:20.106931 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1017/2016] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:19 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:21.124457 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c702e52d-cddc-48a0-af60-71b395b4a14e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:21.125085 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c702e52d-cddc-48a0-af60-71b395b4a14e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:21.131493 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c702e52d-cddc-48a0-af60-71b395b4a14e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:21.131928 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c702e52d-cddc-48a0-af60-71b395b4a14e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:21.132726 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c702e52d-cddc-48a0-af60-71b395b4a14e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:21.133153 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c702e52d-cddc-48a0-af60-71b395b4a14e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:21.273421 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c702e52d-cddc-48a0-af60-71b395b4a14e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:21.281102 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c702e52d-cddc-48a0-af60-71b395b4a14e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.160259 Dec 15 12:58:21.281668 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1000/2017] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:21 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:22.301661 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-20074fb8-7b07-4249-b0c0-013b965e135f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:22.302350 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-20074fb8-7b07-4249-b0c0-013b965e135f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:22.309160 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20074fb8-7b07-4249-b0c0-013b965e135f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:22.309641 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20074fb8-7b07-4249-b0c0-013b965e135f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:22.310449 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20074fb8-7b07-4249-b0c0-013b965e135f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:22.310879 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20074fb8-7b07-4249-b0c0-013b965e135f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:22.460662 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-20074fb8-7b07-4249-b0c0-013b965e135f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:22.472965 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-20074fb8-7b07-4249-b0c0-013b965e135f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.174495 Dec 15 12:58:22.474171 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1018/2018] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:22 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:23.491634 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0c0bc3c4-0c8d-466f-aa14-4c4177e2bb71 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:23.491634 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0c0bc3c4-0c8d-466f-aa14-4c4177e2bb71 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:23.498267 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0c0bc3c4-0c8d-466f-aa14-4c4177e2bb71 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:23.498706 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0c0bc3c4-0c8d-466f-aa14-4c4177e2bb71 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:23.499474 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0c0bc3c4-0c8d-466f-aa14-4c4177e2bb71 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:23.499896 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0c0bc3c4-0c8d-466f-aa14-4c4177e2bb71 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:23.641158 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0c0bc3c4-0c8d-466f-aa14-4c4177e2bb71 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:23.652457 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0c0bc3c4-0c8d-466f-aa14-4c4177e2bb71 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.165334 Dec 15 12:58:23.653112 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1001/2019] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:23 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:24.669824 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-89c640a5-58de-4566-bf47-461ff95f0e69 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:24.670439 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-89c640a5-58de-4566-bf47-461ff95f0e69 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:24.677363 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-89c640a5-58de-4566-bf47-461ff95f0e69 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:24.677920 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-89c640a5-58de-4566-bf47-461ff95f0e69 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:24.678715 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-89c640a5-58de-4566-bf47-461ff95f0e69 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:24.679156 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-89c640a5-58de-4566-bf47-461ff95f0e69 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:24.818710 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-89c640a5-58de-4566-bf47-461ff95f0e69 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:24.826957 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-89c640a5-58de-4566-bf47-461ff95f0e69 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.160781 Dec 15 12:58:24.827538 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1019/2020] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:24 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:25.844606 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-cd375c75-d65f-4136-9639-918a812188f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:25.845163 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-cd375c75-d65f-4136-9639-918a812188f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:25.852349 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cd375c75-d65f-4136-9639-918a812188f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:25.852786 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cd375c75-d65f-4136-9639-918a812188f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:25.853570 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cd375c75-d65f-4136-9639-918a812188f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:25.853996 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cd375c75-d65f-4136-9639-918a812188f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:25.992920 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-cd375c75-d65f-4136-9639-918a812188f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:26.000571 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cd375c75-d65f-4136-9639-918a812188f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.159707 Dec 15 12:58:26.001135 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1002/2021] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:25 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:27.019057 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b3fbc0cc-51fb-4285-9fec-acea9f6fda5a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:27.019609 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b3fbc0cc-51fb-4285-9fec-acea9f6fda5a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:27.026378 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b3fbc0cc-51fb-4285-9fec-acea9f6fda5a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:27.026825 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b3fbc0cc-51fb-4285-9fec-acea9f6fda5a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:27.027611 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b3fbc0cc-51fb-4285-9fec-acea9f6fda5a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:27.028044 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b3fbc0cc-51fb-4285-9fec-acea9f6fda5a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:27.164165 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b3fbc0cc-51fb-4285-9fec-acea9f6fda5a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:27.172715 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b3fbc0cc-51fb-4285-9fec-acea9f6fda5a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.157343 Dec 15 12:58:27.173291 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1020/2022] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:27 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:28.190339 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ca2fc5e4-be2a-4719-aa78-9a529f564810 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:28.191058 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ca2fc5e4-be2a-4719-aa78-9a529f564810 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:28.198278 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ca2fc5e4-be2a-4719-aa78-9a529f564810 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:28.198723 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ca2fc5e4-be2a-4719-aa78-9a529f564810 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:28.199502 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ca2fc5e4-be2a-4719-aa78-9a529f564810 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:28.199935 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ca2fc5e4-be2a-4719-aa78-9a529f564810 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:28.340083 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ca2fc5e4-be2a-4719-aa78-9a529f564810 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:28.347822 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ca2fc5e4-be2a-4719-aa78-9a529f564810 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.161521 Dec 15 12:58:28.348908 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1003/2023] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:28 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:29.366571 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e28dafc8-a877-420e-a7d0-b85dc6596bee tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:29.367182 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e28dafc8-a877-420e-a7d0-b85dc6596bee tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:29.373866 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e28dafc8-a877-420e-a7d0-b85dc6596bee tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:29.374312 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e28dafc8-a877-420e-a7d0-b85dc6596bee tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:29.375091 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e28dafc8-a877-420e-a7d0-b85dc6596bee tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:29.375518 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e28dafc8-a877-420e-a7d0-b85dc6596bee tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:29.509634 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e28dafc8-a877-420e-a7d0-b85dc6596bee tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:29.517320 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e28dafc8-a877-420e-a7d0-b85dc6596bee tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.155130 Dec 15 12:58:29.517924 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1021/2024] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:29 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:30.534716 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-77052431-6b1b-4cff-bea3-0dc4eb9a024c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:30.535362 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-77052431-6b1b-4cff-bea3-0dc4eb9a024c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:30.541826 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-77052431-6b1b-4cff-bea3-0dc4eb9a024c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:30.542270 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-77052431-6b1b-4cff-bea3-0dc4eb9a024c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:30.543076 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-77052431-6b1b-4cff-bea3-0dc4eb9a024c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:30.543506 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-77052431-6b1b-4cff-bea3-0dc4eb9a024c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:30.675381 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-77052431-6b1b-4cff-bea3-0dc4eb9a024c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:30.684411 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-77052431-6b1b-4cff-bea3-0dc4eb9a024c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.153242 Dec 15 12:58:30.684997 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1004/2025] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:30 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:31.702597 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b44c6933-8368-4015-a792-bb9dfe8c873d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:31.703213 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b44c6933-8368-4015-a792-bb9dfe8c873d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:31.709711 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b44c6933-8368-4015-a792-bb9dfe8c873d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:31.710157 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b44c6933-8368-4015-a792-bb9dfe8c873d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:31.710932 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b44c6933-8368-4015-a792-bb9dfe8c873d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:31.711365 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b44c6933-8368-4015-a792-bb9dfe8c873d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:31.847258 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b44c6933-8368-4015-a792-bb9dfe8c873d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:31.855566 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b44c6933-8368-4015-a792-bb9dfe8c873d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.156786 Dec 15 12:58:31.856129 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1022/2026] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:31 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:58:32.872803 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-93054723-0102-4c21-9869-7d5e596bd3fb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:32.873424 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-93054723-0102-4c21-9869-7d5e596bd3fb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:32.880395 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-93054723-0102-4c21-9869-7d5e596bd3fb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:32.880895 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-93054723-0102-4c21-9869-7d5e596bd3fb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:32.881761 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-93054723-0102-4c21-9869-7d5e596bd3fb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:32.882241 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-93054723-0102-4c21-9869-7d5e596bd3fb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:33.015194 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-93054723-0102-4c21-9869-7d5e596bd3fb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:33.023048 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-93054723-0102-4c21-9869-7d5e596bd3fb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.154103 Dec 15 12:58:33.030197 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1005/2027] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:32 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:34.040847 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-689a5008-6259-42fc-9b8b-763a11c09045 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:34.041477 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-689a5008-6259-42fc-9b8b-763a11c09045 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:34.047648 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-689a5008-6259-42fc-9b8b-763a11c09045 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:34.048098 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-689a5008-6259-42fc-9b8b-763a11c09045 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:34.048874 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-689a5008-6259-42fc-9b8b-763a11c09045 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:34.049310 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-689a5008-6259-42fc-9b8b-763a11c09045 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:34.198875 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-689a5008-6259-42fc-9b8b-763a11c09045 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:34.206719 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-689a5008-6259-42fc-9b8b-763a11c09045 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.169502 Dec 15 12:58:34.207323 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1023/2028] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:34 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:58:35.224079 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9b08da36-d540-42ee-ae0c-fdda839fac58 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:35.224550 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9b08da36-d540-42ee-ae0c-fdda839fac58 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:35.230859 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9b08da36-d540-42ee-ae0c-fdda839fac58 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:35.231217 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9b08da36-d540-42ee-ae0c-fdda839fac58 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:35.231996 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9b08da36-d540-42ee-ae0c-fdda839fac58 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:35.232425 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9b08da36-d540-42ee-ae0c-fdda839fac58 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:35.372661 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9b08da36-d540-42ee-ae0c-fdda839fac58 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:35.381227 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9b08da36-d540-42ee-ae0c-fdda839fac58 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.161125 Dec 15 12:58:35.381817 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1006/2029] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:35 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:36.399385 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a8a35805-584a-43f6-891c-e8cf0e5de7e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:36.400010 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a8a35805-584a-43f6-891c-e8cf0e5de7e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:36.414437 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a8a35805-584a-43f6-891c-e8cf0e5de7e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:36.414896 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a8a35805-584a-43f6-891c-e8cf0e5de7e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:36.415700 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a8a35805-584a-43f6-891c-e8cf0e5de7e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:36.416170 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a8a35805-584a-43f6-891c-e8cf0e5de7e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:36.547000 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a8a35805-584a-43f6-891c-e8cf0e5de7e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:36.554985 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a8a35805-584a-43f6-891c-e8cf0e5de7e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.160134 Dec 15 12:58:36.555550 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1024/2030] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:36 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:37.572337 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bb581d60-79cd-4deb-aa8b-1fa4ad828b78 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:37.573008 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bb581d60-79cd-4deb-aa8b-1fa4ad828b78 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:37.579079 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bb581d60-79cd-4deb-aa8b-1fa4ad828b78 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:37.579519 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bb581d60-79cd-4deb-aa8b-1fa4ad828b78 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:37.580279 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bb581d60-79cd-4deb-aa8b-1fa4ad828b78 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:37.580706 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bb581d60-79cd-4deb-aa8b-1fa4ad828b78 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:37.719516 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bb581d60-79cd-4deb-aa8b-1fa4ad828b78 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:37.728213 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bb581d60-79cd-4deb-aa8b-1fa4ad828b78 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.159656 Dec 15 12:58:37.728778 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1007/2031] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:37 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:38.745813 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d51cb2a9-f27f-4b7f-9094-decc7516a38f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:38.746403 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d51cb2a9-f27f-4b7f-9094-decc7516a38f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:38.753097 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d51cb2a9-f27f-4b7f-9094-decc7516a38f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:38.753567 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d51cb2a9-f27f-4b7f-9094-decc7516a38f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:38.754806 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d51cb2a9-f27f-4b7f-9094-decc7516a38f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:38.755335 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d51cb2a9-f27f-4b7f-9094-decc7516a38f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:38.890382 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d51cb2a9-f27f-4b7f-9094-decc7516a38f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:38.898394 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d51cb2a9-f27f-4b7f-9094-decc7516a38f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.156277 Dec 15 12:58:38.898953 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1025/2032] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:38 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:39.915145 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1b1ea46a-1f03-4957-97d9-0356c269b1e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:39.915787 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1b1ea46a-1f03-4957-97d9-0356c269b1e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:39.922057 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b1ea46a-1f03-4957-97d9-0356c269b1e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:39.922503 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b1ea46a-1f03-4957-97d9-0356c269b1e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:39.923286 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b1ea46a-1f03-4957-97d9-0356c269b1e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:39.923720 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b1ea46a-1f03-4957-97d9-0356c269b1e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:40.072829 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1b1ea46a-1f03-4957-97d9-0356c269b1e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:40.080787 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1b1ea46a-1f03-4957-97d9-0356c269b1e5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.169292 Dec 15 12:58:40.081350 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1008/2033] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:39 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:41.097821 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5540d6c7-1221-418e-b894-bae27a69f61f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:41.099057 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5540d6c7-1221-418e-b894-bae27a69f61f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:41.105922 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5540d6c7-1221-418e-b894-bae27a69f61f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:41.106391 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5540d6c7-1221-418e-b894-bae27a69f61f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:41.107222 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5540d6c7-1221-418e-b894-bae27a69f61f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:41.107650 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5540d6c7-1221-418e-b894-bae27a69f61f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:41.241256 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5540d6c7-1221-418e-b894-bae27a69f61f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:41.249107 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5540d6c7-1221-418e-b894-bae27a69f61f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.155060 Dec 15 12:58:41.249699 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1026/2034] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:41 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:42.266543 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-af373191-be32-4e72-970f-ddd6ba51a8cb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:42.267072 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-af373191-be32-4e72-970f-ddd6ba51a8cb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:42.273720 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-af373191-be32-4e72-970f-ddd6ba51a8cb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:42.274174 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-af373191-be32-4e72-970f-ddd6ba51a8cb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:42.274959 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-af373191-be32-4e72-970f-ddd6ba51a8cb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:42.275420 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-af373191-be32-4e72-970f-ddd6ba51a8cb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:42.419149 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-af373191-be32-4e72-970f-ddd6ba51a8cb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:42.427699 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-af373191-be32-4e72-970f-ddd6ba51a8cb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.164725 Dec 15 12:58:42.428264 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1009/2035] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:42 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:43.444927 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fc14835c-c760-4b0d-8f8b-a0025c0b5160 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:43.445608 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fc14835c-c760-4b0d-8f8b-a0025c0b5160 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:43.452523 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fc14835c-c760-4b0d-8f8b-a0025c0b5160 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:43.452971 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fc14835c-c760-4b0d-8f8b-a0025c0b5160 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:43.453809 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fc14835c-c760-4b0d-8f8b-a0025c0b5160 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:43.454244 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fc14835c-c760-4b0d-8f8b-a0025c0b5160 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:43.592736 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-fc14835c-c760-4b0d-8f8b-a0025c0b5160 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:43.601012 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fc14835c-c760-4b0d-8f8b-a0025c0b5160 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.160367 Dec 15 12:58:43.601622 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1027/2036] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:43 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:44.618038 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2591048f-620c-4f6a-9a82-068559828a5c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:44.618844 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2591048f-620c-4f6a-9a82-068559828a5c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:44.625195 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2591048f-620c-4f6a-9a82-068559828a5c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:44.625681 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2591048f-620c-4f6a-9a82-068559828a5c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:44.626476 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2591048f-620c-4f6a-9a82-068559828a5c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:44.626912 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2591048f-620c-4f6a-9a82-068559828a5c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:44.764514 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2591048f-620c-4f6a-9a82-068559828a5c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:44.772247 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2591048f-620c-4f6a-9a82-068559828a5c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.157871 Dec 15 12:58:44.772800 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1010/2037] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:44 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:45.789790 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-aa33af25-e651-415b-92fe-f49032f8d192 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:45.790428 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-aa33af25-e651-415b-92fe-f49032f8d192 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:45.797140 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa33af25-e651-415b-92fe-f49032f8d192 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:45.797631 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa33af25-e651-415b-92fe-f49032f8d192 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:45.798430 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa33af25-e651-415b-92fe-f49032f8d192 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:45.798860 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa33af25-e651-415b-92fe-f49032f8d192 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:45.935181 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-aa33af25-e651-415b-92fe-f49032f8d192 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:45.942892 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-aa33af25-e651-415b-92fe-f49032f8d192 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.157878 Dec 15 12:58:45.943540 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1028/2038] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:45 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:46.960699 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1ea7bb7b-a2d6-4f8d-a236-c0fa14f58575 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:46.961275 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1ea7bb7b-a2d6-4f8d-a236-c0fa14f58575 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:46.967612 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1ea7bb7b-a2d6-4f8d-a236-c0fa14f58575 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:46.968056 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1ea7bb7b-a2d6-4f8d-a236-c0fa14f58575 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:46.968829 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1ea7bb7b-a2d6-4f8d-a236-c0fa14f58575 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:46.969312 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1ea7bb7b-a2d6-4f8d-a236-c0fa14f58575 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:47.102298 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1ea7bb7b-a2d6-4f8d-a236-c0fa14f58575 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:47.110448 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1ea7bb7b-a2d6-4f8d-a236-c0fa14f58575 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.154043 Dec 15 12:58:47.111042 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1011/2039] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:46 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:48.127928 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-dd1231e9-7769-4733-9db3-cc65e2a565d6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:48.128533 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-dd1231e9-7769-4733-9db3-cc65e2a565d6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:48.135140 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dd1231e9-7769-4733-9db3-cc65e2a565d6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:48.135580 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dd1231e9-7769-4733-9db3-cc65e2a565d6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:48.136350 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dd1231e9-7769-4733-9db3-cc65e2a565d6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:48.136779 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dd1231e9-7769-4733-9db3-cc65e2a565d6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:48.274103 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-dd1231e9-7769-4733-9db3-cc65e2a565d6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:48.281856 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-dd1231e9-7769-4733-9db3-cc65e2a565d6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.157520 Dec 15 12:58:48.282424 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1029/2040] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:48 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:49.299977 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-aaa80103-2e8a-4c60-82c4-462e9d17078b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:49.300593 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-aaa80103-2e8a-4c60-82c4-462e9d17078b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:49.307116 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aaa80103-2e8a-4c60-82c4-462e9d17078b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:49.307559 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aaa80103-2e8a-4c60-82c4-462e9d17078b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:49.308334 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aaa80103-2e8a-4c60-82c4-462e9d17078b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:49.308766 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aaa80103-2e8a-4c60-82c4-462e9d17078b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:49.438058 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-aaa80103-2e8a-4c60-82c4-462e9d17078b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:49.447403 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-aaa80103-2e8a-4c60-82c4-462e9d17078b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.150989 Dec 15 12:58:49.447998 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1012/2041] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:49 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:50.465057 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1e860e33-26cf-4f77-abe0-1561c5c2402d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:50.465746 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1e860e33-26cf-4f77-abe0-1561c5c2402d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:50.471885 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1e860e33-26cf-4f77-abe0-1561c5c2402d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:50.472328 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1e860e33-26cf-4f77-abe0-1561c5c2402d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:50.473089 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1e860e33-26cf-4f77-abe0-1561c5c2402d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:50.473526 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1e860e33-26cf-4f77-abe0-1561c5c2402d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:50.611823 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1e860e33-26cf-4f77-abe0-1561c5c2402d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:50.619664 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1e860e33-26cf-4f77-abe0-1561c5c2402d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.158254 Dec 15 12:58:50.620229 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1030/2042] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:50 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:51.636460 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fd9f3699-7769-4b1a-96fa-bc22cda918dd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:51.637077 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fd9f3699-7769-4b1a-96fa-bc22cda918dd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:51.643934 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fd9f3699-7769-4b1a-96fa-bc22cda918dd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:51.644200 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fd9f3699-7769-4b1a-96fa-bc22cda918dd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:51.644981 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fd9f3699-7769-4b1a-96fa-bc22cda918dd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:51.645409 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fd9f3699-7769-4b1a-96fa-bc22cda918dd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:51.779307 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fd9f3699-7769-4b1a-96fa-bc22cda918dd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:51.789104 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fd9f3699-7769-4b1a-96fa-bc22cda918dd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.156577 Dec 15 12:58:51.789765 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1013/2043] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:51 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:52.807197 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d3a9fb73-75ac-45a5-a8ff-8b19dc08d0fe tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:52.807825 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d3a9fb73-75ac-45a5-a8ff-8b19dc08d0fe tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:52.815540 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d3a9fb73-75ac-45a5-a8ff-8b19dc08d0fe tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:52.815992 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d3a9fb73-75ac-45a5-a8ff-8b19dc08d0fe tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:52.816779 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d3a9fb73-75ac-45a5-a8ff-8b19dc08d0fe tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:52.817212 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d3a9fb73-75ac-45a5-a8ff-8b19dc08d0fe tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:52.956319 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d3a9fb73-75ac-45a5-a8ff-8b19dc08d0fe tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:52.964301 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d3a9fb73-75ac-45a5-a8ff-8b19dc08d0fe tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.161663 Dec 15 12:58:52.964867 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1031/2044] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:52 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:53.981878 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-82d97ed2-cf24-490d-b5d1-5a0f7334eb51 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:53.982555 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-82d97ed2-cf24-490d-b5d1-5a0f7334eb51 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:53.988790 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-82d97ed2-cf24-490d-b5d1-5a0f7334eb51 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:53.989228 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-82d97ed2-cf24-490d-b5d1-5a0f7334eb51 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:53.990072 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-82d97ed2-cf24-490d-b5d1-5a0f7334eb51 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:53.991462 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-82d97ed2-cf24-490d-b5d1-5a0f7334eb51 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:54.140831 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-82d97ed2-cf24-490d-b5d1-5a0f7334eb51 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:54.149232 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-82d97ed2-cf24-490d-b5d1-5a0f7334eb51 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.170988 Dec 15 12:58:54.149912 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1014/2045] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:53 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:55.166237 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-39b3b299-f592-4d71-822e-6705ee728352 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:55.166847 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-39b3b299-f592-4d71-822e-6705ee728352 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:55.173593 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-39b3b299-f592-4d71-822e-6705ee728352 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:55.174042 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-39b3b299-f592-4d71-822e-6705ee728352 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:55.174844 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-39b3b299-f592-4d71-822e-6705ee728352 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:55.176561 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-39b3b299-f592-4d71-822e-6705ee728352 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:55.310673 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-39b3b299-f592-4d71-822e-6705ee728352 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:55.318739 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-39b3b299-f592-4d71-822e-6705ee728352 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.156598 Dec 15 12:58:55.319306 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1032/2046] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:55 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:56.336084 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2132bb10-6866-481c-ad1e-fd6288c36dea tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:56.336696 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2132bb10-6866-481c-ad1e-fd6288c36dea tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:56.343040 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2132bb10-6866-481c-ad1e-fd6288c36dea tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:56.343480 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2132bb10-6866-481c-ad1e-fd6288c36dea tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:56.344244 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2132bb10-6866-481c-ad1e-fd6288c36dea tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:56.344672 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2132bb10-6866-481c-ad1e-fd6288c36dea tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:56.481389 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2132bb10-6866-481c-ad1e-fd6288c36dea tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:56.489203 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2132bb10-6866-481c-ad1e-fd6288c36dea tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.157136 Dec 15 12:58:56.489802 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1015/2047] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:56 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:57.507594 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ca54ef4a-7233-4a71-834a-2b1a30c7e660 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:57.508156 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ca54ef4a-7233-4a71-834a-2b1a30c7e660 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:57.514914 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ca54ef4a-7233-4a71-834a-2b1a30c7e660 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:57.515369 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ca54ef4a-7233-4a71-834a-2b1a30c7e660 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:57.516186 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ca54ef4a-7233-4a71-834a-2b1a30c7e660 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:57.516627 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ca54ef4a-7233-4a71-834a-2b1a30c7e660 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:57.660474 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ca54ef4a-7233-4a71-834a-2b1a30c7e660 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:57.668629 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ca54ef4a-7233-4a71-834a-2b1a30c7e660 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.165115 Dec 15 12:58:57.669219 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1033/2048] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:57 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:58.686327 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c7f158d6-f23d-4983-9b20-cb5ef0b5949a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:58.686927 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c7f158d6-f23d-4983-9b20-cb5ef0b5949a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:58.695387 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c7f158d6-f23d-4983-9b20-cb5ef0b5949a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:58.695387 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c7f158d6-f23d-4983-9b20-cb5ef0b5949a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:58.695387 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c7f158d6-f23d-4983-9b20-cb5ef0b5949a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:58.695387 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c7f158d6-f23d-4983-9b20-cb5ef0b5949a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:58.828041 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c7f158d6-f23d-4983-9b20-cb5ef0b5949a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:58:58.836411 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c7f158d6-f23d-4983-9b20-cb5ef0b5949a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.153891 Dec 15 12:58:58.836984 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1016/2049] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:58 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:58:59.852771 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-106fc1cc-5acb-4c33-8feb-e5455813ad5a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:58:59.853392 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-106fc1cc-5acb-4c33-8feb-e5455813ad5a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:58:59.859847 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-106fc1cc-5acb-4c33-8feb-e5455813ad5a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:59.860337 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-106fc1cc-5acb-4c33-8feb-e5455813ad5a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:59.861107 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-106fc1cc-5acb-4c33-8feb-e5455813ad5a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:58:59.861590 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-106fc1cc-5acb-4c33-8feb-e5455813ad5a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:58:59.995886 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-106fc1cc-5acb-4c33-8feb-e5455813ad5a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:00.003907 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-106fc1cc-5acb-4c33-8feb-e5455813ad5a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.155278 Dec 15 12:59:00.004478 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1034/2050] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:58:59 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:01.021529 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0d72cb93-0c2f-4686-9525-79c6bc719f68 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:01.023100 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0d72cb93-0c2f-4686-9525-79c6bc719f68 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:01.028476 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0d72cb93-0c2f-4686-9525-79c6bc719f68 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:01.028920 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0d72cb93-0c2f-4686-9525-79c6bc719f68 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:01.029730 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0d72cb93-0c2f-4686-9525-79c6bc719f68 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:01.030159 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0d72cb93-0c2f-4686-9525-79c6bc719f68 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:01.159299 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0d72cb93-0c2f-4686-9525-79c6bc719f68 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:01.168954 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0d72cb93-0c2f-4686-9525-79c6bc719f68 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.151103 Dec 15 12:59:01.169564 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1017/2051] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:01 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:02.186844 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6c4eb096-0652-4b20-80ff-b64c01b3ac83 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:02.187457 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6c4eb096-0652-4b20-80ff-b64c01b3ac83 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:02.194457 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c4eb096-0652-4b20-80ff-b64c01b3ac83 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:02.194908 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c4eb096-0652-4b20-80ff-b64c01b3ac83 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:02.195689 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c4eb096-0652-4b20-80ff-b64c01b3ac83 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:02.196126 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c4eb096-0652-4b20-80ff-b64c01b3ac83 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:02.336040 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6c4eb096-0652-4b20-80ff-b64c01b3ac83 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:02.344387 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6c4eb096-0652-4b20-80ff-b64c01b3ac83 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.161197 Dec 15 12:59:02.345154 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1035/2052] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:02 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:03.361515 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-cbea5ed6-ccbd-4dfb-9946-b1aafcae1377 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:03.362162 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-cbea5ed6-ccbd-4dfb-9946-b1aafcae1377 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:03.368636 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cbea5ed6-ccbd-4dfb-9946-b1aafcae1377 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:03.369079 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cbea5ed6-ccbd-4dfb-9946-b1aafcae1377 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:03.369889 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cbea5ed6-ccbd-4dfb-9946-b1aafcae1377 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:03.370316 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cbea5ed6-ccbd-4dfb-9946-b1aafcae1377 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:03.499920 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-cbea5ed6-ccbd-4dfb-9946-b1aafcae1377 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:03.508640 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cbea5ed6-ccbd-4dfb-9946-b1aafcae1377 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.150807 Dec 15 12:59:03.509478 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1018/2053] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:03 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:04.526269 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-eee60b3c-14d6-4d18-8e66-863e6aea45d8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:04.526866 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-eee60b3c-14d6-4d18-8e66-863e6aea45d8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:04.533239 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eee60b3c-14d6-4d18-8e66-863e6aea45d8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:04.533731 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eee60b3c-14d6-4d18-8e66-863e6aea45d8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:04.534514 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eee60b3c-14d6-4d18-8e66-863e6aea45d8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:04.534958 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eee60b3c-14d6-4d18-8e66-863e6aea45d8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:04.670499 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-eee60b3c-14d6-4d18-8e66-863e6aea45d8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:04.678933 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-eee60b3c-14d6-4d18-8e66-863e6aea45d8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.156188 Dec 15 12:59:04.679510 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1036/2054] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:04 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:05.697186 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-87cea365-1b3b-4582-83ca-9bda09e4b7c6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:05.697832 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-87cea365-1b3b-4582-83ca-9bda09e4b7c6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:05.704704 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-87cea365-1b3b-4582-83ca-9bda09e4b7c6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:05.705140 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-87cea365-1b3b-4582-83ca-9bda09e4b7c6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:05.705962 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-87cea365-1b3b-4582-83ca-9bda09e4b7c6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:05.706393 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-87cea365-1b3b-4582-83ca-9bda09e4b7c6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:05.847054 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-87cea365-1b3b-4582-83ca-9bda09e4b7c6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:05.857358 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-87cea365-1b3b-4582-83ca-9bda09e4b7c6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.164994 Dec 15 12:59:05.858355 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1019/2055] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:05 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:06.874767 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-391d270d-27aa-468d-a2b1-5e61bfd2b153 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:06.875410 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-391d270d-27aa-468d-a2b1-5e61bfd2b153 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:06.882032 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-391d270d-27aa-468d-a2b1-5e61bfd2b153 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:06.882497 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-391d270d-27aa-468d-a2b1-5e61bfd2b153 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:06.883292 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-391d270d-27aa-468d-a2b1-5e61bfd2b153 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:06.883762 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-391d270d-27aa-468d-a2b1-5e61bfd2b153 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:07.019808 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-391d270d-27aa-468d-a2b1-5e61bfd2b153 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:07.028117 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-391d270d-27aa-468d-a2b1-5e61bfd2b153 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.156909 Dec 15 12:59:07.028692 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1037/2056] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:06 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:08.045159 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8b3536d4-5b19-46a0-b9d5-eca630616100 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:08.045803 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8b3536d4-5b19-46a0-b9d5-eca630616100 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:08.052095 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8b3536d4-5b19-46a0-b9d5-eca630616100 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:08.053195 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8b3536d4-5b19-46a0-b9d5-eca630616100 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:08.054100 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8b3536d4-5b19-46a0-b9d5-eca630616100 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:08.054535 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8b3536d4-5b19-46a0-b9d5-eca630616100 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:08.189277 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8b3536d4-5b19-46a0-b9d5-eca630616100 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:08.198025 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8b3536d4-5b19-46a0-b9d5-eca630616100 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.156441 Dec 15 12:59:08.198611 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1020/2057] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:08 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:09.215657 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-16e302e4-8848-4375-ad3e-c909835190e0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:09.216386 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-16e302e4-8848-4375-ad3e-c909835190e0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:09.222611 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-16e302e4-8848-4375-ad3e-c909835190e0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:09.223072 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-16e302e4-8848-4375-ad3e-c909835190e0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:09.223854 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-16e302e4-8848-4375-ad3e-c909835190e0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:09.224308 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-16e302e4-8848-4375-ad3e-c909835190e0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:09.368173 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-16e302e4-8848-4375-ad3e-c909835190e0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:09.375914 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-16e302e4-8848-4375-ad3e-c909835190e0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.163959 Dec 15 12:59:09.376475 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1038/2058] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:09 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:10.394099 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0da1a65d-c56c-4626-b27c-928b219f471e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:10.394700 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0da1a65d-c56c-4626-b27c-928b219f471e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:10.401650 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0da1a65d-c56c-4626-b27c-928b219f471e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:10.402095 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0da1a65d-c56c-4626-b27c-928b219f471e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:10.402875 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0da1a65d-c56c-4626-b27c-928b219f471e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:10.403302 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0da1a65d-c56c-4626-b27c-928b219f471e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:10.577288 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0da1a65d-c56c-4626-b27c-928b219f471e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:10.585077 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0da1a65d-c56c-4626-b27c-928b219f471e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.194694 Dec 15 12:59:10.585763 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1021/2059] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:10 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:11.603315 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e615141c-7805-4fb8-bd0a-f79c841c3224 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:11.603871 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e615141c-7805-4fb8-bd0a-f79c841c3224 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:11.610103 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e615141c-7805-4fb8-bd0a-f79c841c3224 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:11.610557 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e615141c-7805-4fb8-bd0a-f79c841c3224 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:11.611333 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e615141c-7805-4fb8-bd0a-f79c841c3224 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:11.611788 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e615141c-7805-4fb8-bd0a-f79c841c3224 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:11.753677 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e615141c-7805-4fb8-bd0a-f79c841c3224 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:11.762990 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e615141c-7805-4fb8-bd0a-f79c841c3224 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.164168 Dec 15 12:59:11.763567 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1039/2060] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:11 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:12.781028 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0090bde7-0a19-4f36-abd5-d7191cf81680 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:12.781671 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0090bde7-0a19-4f36-abd5-d7191cf81680 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:12.788504 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0090bde7-0a19-4f36-abd5-d7191cf81680 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:12.788937 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0090bde7-0a19-4f36-abd5-d7191cf81680 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:12.790393 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0090bde7-0a19-4f36-abd5-d7191cf81680 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:12.790819 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0090bde7-0a19-4f36-abd5-d7191cf81680 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:12.921817 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0090bde7-0a19-4f36-abd5-d7191cf81680 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:12.929600 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0090bde7-0a19-4f36-abd5-d7191cf81680 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.152346 Dec 15 12:59:12.930156 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1022/2061] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:12 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:13.946987 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a2b3b70e-2c33-47c4-a88d-cd1b5ef2f852 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:13.947582 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a2b3b70e-2c33-47c4-a88d-cd1b5ef2f852 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:13.953793 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a2b3b70e-2c33-47c4-a88d-cd1b5ef2f852 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:13.954236 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a2b3b70e-2c33-47c4-a88d-cd1b5ef2f852 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:13.954995 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a2b3b70e-2c33-47c4-a88d-cd1b5ef2f852 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:13.955421 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a2b3b70e-2c33-47c4-a88d-cd1b5ef2f852 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:14.094319 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a2b3b70e-2c33-47c4-a88d-cd1b5ef2f852 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:14.102941 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a2b3b70e-2c33-47c4-a88d-cd1b5ef2f852 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.159656 Dec 15 12:59:14.103518 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1040/2062] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:13 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:15.120701 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e9119ac3-34db-4709-b668-be71c43c2866 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:15.121319 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e9119ac3-34db-4709-b668-be71c43c2866 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:15.128502 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e9119ac3-34db-4709-b668-be71c43c2866 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:15.128952 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e9119ac3-34db-4709-b668-be71c43c2866 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:15.129892 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e9119ac3-34db-4709-b668-be71c43c2866 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:15.130335 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e9119ac3-34db-4709-b668-be71c43c2866 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:15.266425 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e9119ac3-34db-4709-b668-be71c43c2866 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:15.274845 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e9119ac3-34db-4709-b668-be71c43c2866 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.158230 Dec 15 12:59:15.275431 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1023/2063] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:15 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:16.291838 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f4842252-f4d9-4778-82f5-55764683da42 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:16.292472 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f4842252-f4d9-4778-82f5-55764683da42 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:16.298842 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4842252-f4d9-4778-82f5-55764683da42 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:16.299286 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4842252-f4d9-4778-82f5-55764683da42 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:16.300321 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4842252-f4d9-4778-82f5-55764683da42 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:16.300475 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4842252-f4d9-4778-82f5-55764683da42 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:16.440236 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f4842252-f4d9-4778-82f5-55764683da42 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:16.448627 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f4842252-f4d9-4778-82f5-55764683da42 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.160451 Dec 15 12:59:16.449195 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1041/2064] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:16 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:17.466613 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c7656023-d402-467f-aba2-a81f11f50374 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:17.467197 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c7656023-d402-467f-aba2-a81f11f50374 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:17.473846 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c7656023-d402-467f-aba2-a81f11f50374 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:17.474309 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c7656023-d402-467f-aba2-a81f11f50374 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:17.475086 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c7656023-d402-467f-aba2-a81f11f50374 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:17.475518 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c7656023-d402-467f-aba2-a81f11f50374 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:17.630835 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c7656023-d402-467f-aba2-a81f11f50374 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:17.640075 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c7656023-d402-467f-aba2-a81f11f50374 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.177351 Dec 15 12:59:17.640649 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1024/2065] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:17 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:59:18.657681 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c81bce1a-40b5-475f-bc39-9b2648d00dc5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:18.658417 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c81bce1a-40b5-475f-bc39-9b2648d00dc5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:18.665452 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c81bce1a-40b5-475f-bc39-9b2648d00dc5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:18.665939 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c81bce1a-40b5-475f-bc39-9b2648d00dc5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:18.666815 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c81bce1a-40b5-475f-bc39-9b2648d00dc5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:18.667255 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c81bce1a-40b5-475f-bc39-9b2648d00dc5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:18.799090 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c81bce1a-40b5-475f-bc39-9b2648d00dc5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:18.807237 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c81bce1a-40b5-475f-bc39-9b2648d00dc5 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.153197 Dec 15 12:59:18.807810 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1042/2066] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:18 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:19.824196 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e804553c-e66e-4a41-a4dc-33857f8c55f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:19.824817 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e804553c-e66e-4a41-a4dc-33857f8c55f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:19.831368 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e804553c-e66e-4a41-a4dc-33857f8c55f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:19.831808 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e804553c-e66e-4a41-a4dc-33857f8c55f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:19.832579 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e804553c-e66e-4a41-a4dc-33857f8c55f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:19.833037 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e804553c-e66e-4a41-a4dc-33857f8c55f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:19.971130 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e804553c-e66e-4a41-a4dc-33857f8c55f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:19.980343 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e804553c-e66e-4a41-a4dc-33857f8c55f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.159645 Dec 15 12:59:19.980819 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1025/2067] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:19 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:20.997894 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c58f051f-d94a-41bd-9af2-db059e039e8b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:20.998498 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c58f051f-d94a-41bd-9af2-db059e039e8b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:21.005298 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c58f051f-d94a-41bd-9af2-db059e039e8b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:21.005868 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c58f051f-d94a-41bd-9af2-db059e039e8b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:21.006690 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c58f051f-d94a-41bd-9af2-db059e039e8b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:21.007146 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c58f051f-d94a-41bd-9af2-db059e039e8b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:21.149188 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c58f051f-d94a-41bd-9af2-db059e039e8b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:21.157075 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c58f051f-d94a-41bd-9af2-db059e039e8b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.163426 Dec 15 12:59:21.157654 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1043/2068] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:20 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:22.173369 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-cc4fb0b3-d60b-4732-b1a6-dca6e5b23e34 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:22.174045 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-cc4fb0b3-d60b-4732-b1a6-dca6e5b23e34 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:22.180305 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc4fb0b3-d60b-4732-b1a6-dca6e5b23e34 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:22.180754 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc4fb0b3-d60b-4732-b1a6-dca6e5b23e34 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:22.181588 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc4fb0b3-d60b-4732-b1a6-dca6e5b23e34 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:22.182041 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc4fb0b3-d60b-4732-b1a6-dca6e5b23e34 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:22.318981 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-cc4fb0b3-d60b-4732-b1a6-dca6e5b23e34 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:22.327523 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cc4fb0b3-d60b-4732-b1a6-dca6e5b23e34 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.157804 Dec 15 12:59:22.328095 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1026/2069] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:22 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:23.344546 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-21419a5e-45e1-4b41-99e6-609e31b3ce39 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:23.345234 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-21419a5e-45e1-4b41-99e6-609e31b3ce39 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:23.351647 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-21419a5e-45e1-4b41-99e6-609e31b3ce39 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:23.352097 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-21419a5e-45e1-4b41-99e6-609e31b3ce39 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:23.352875 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-21419a5e-45e1-4b41-99e6-609e31b3ce39 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:23.353404 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-21419a5e-45e1-4b41-99e6-609e31b3ce39 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:23.490669 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-21419a5e-45e1-4b41-99e6-609e31b3ce39 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:23.499127 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-21419a5e-45e1-4b41-99e6-609e31b3ce39 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.158172 Dec 15 12:59:23.499691 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1044/2070] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:23 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:24.516796 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-832d3388-8dd3-4e4a-83a2-19f621cb612c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:24.517446 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-832d3388-8dd3-4e4a-83a2-19f621cb612c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:24.523863 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-832d3388-8dd3-4e4a-83a2-19f621cb612c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:24.524310 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-832d3388-8dd3-4e4a-83a2-19f621cb612c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:24.525091 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-832d3388-8dd3-4e4a-83a2-19f621cb612c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:24.526153 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-832d3388-8dd3-4e4a-83a2-19f621cb612c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:24.665642 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-832d3388-8dd3-4e4a-83a2-19f621cb612c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:24.674791 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-832d3388-8dd3-4e4a-83a2-19f621cb612c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.160778 Dec 15 12:59:24.680132 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1027/2071] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:24 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:25.694583 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-37c43fd0-b153-42d6-ae04-d2783a2b219d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:25.695669 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-37c43fd0-b153-42d6-ae04-d2783a2b219d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:25.706538 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-37c43fd0-b153-42d6-ae04-d2783a2b219d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:25.707385 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-37c43fd0-b153-42d6-ae04-d2783a2b219d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:25.708852 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-37c43fd0-b153-42d6-ae04-d2783a2b219d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:25.709729 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-37c43fd0-b153-42d6-ae04-d2783a2b219d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:25.914545 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-37c43fd0-b153-42d6-ae04-d2783a2b219d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:25.922361 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-37c43fd0-b153-42d6-ae04-d2783a2b219d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.234030 Dec 15 12:59:25.922995 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1045/2072] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:25 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:26.940667 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-62a980f7-484f-4e6f-a47c-30cc5fa66cd2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:26.941248 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-62a980f7-484f-4e6f-a47c-30cc5fa66cd2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:26.947505 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-62a980f7-484f-4e6f-a47c-30cc5fa66cd2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:26.947951 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-62a980f7-484f-4e6f-a47c-30cc5fa66cd2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:26.948730 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-62a980f7-484f-4e6f-a47c-30cc5fa66cd2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:26.949160 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-62a980f7-484f-4e6f-a47c-30cc5fa66cd2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:27.087776 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-62a980f7-484f-4e6f-a47c-30cc5fa66cd2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:27.097125 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-62a980f7-484f-4e6f-a47c-30cc5fa66cd2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.160061 Dec 15 12:59:27.097766 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1028/2073] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:26 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:28.115444 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6e683647-16a1-4eb5-a255-c1f17c160e58 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:28.116138 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6e683647-16a1-4eb5-a255-c1f17c160e58 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:28.123455 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e683647-16a1-4eb5-a255-c1f17c160e58 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:28.123961 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e683647-16a1-4eb5-a255-c1f17c160e58 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:28.124836 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e683647-16a1-4eb5-a255-c1f17c160e58 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:28.125335 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e683647-16a1-4eb5-a255-c1f17c160e58 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:28.274853 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6e683647-16a1-4eb5-a255-c1f17c160e58 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:28.282853 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6e683647-16a1-4eb5-a255-c1f17c160e58 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.171503 Dec 15 12:59:28.283424 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1046/2074] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:28 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 12:59:29.299987 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-180fb2de-fd59-48ad-94fb-6c984b5ce35e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:29.300610 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-180fb2de-fd59-48ad-94fb-6c984b5ce35e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:29.306589 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-180fb2de-fd59-48ad-94fb-6c984b5ce35e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:29.307054 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-180fb2de-fd59-48ad-94fb-6c984b5ce35e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:29.313932 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-180fb2de-fd59-48ad-94fb-6c984b5ce35e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:29.314381 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-180fb2de-fd59-48ad-94fb-6c984b5ce35e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:29.445176 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-180fb2de-fd59-48ad-94fb-6c984b5ce35e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:29.453821 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-180fb2de-fd59-48ad-94fb-6c984b5ce35e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.157736 Dec 15 12:59:29.454393 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1029/2075] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:29 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:30.471559 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-273ef599-2144-41fb-a71f-32cf821c4e2e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:30.472169 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-273ef599-2144-41fb-a71f-32cf821c4e2e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:30.478126 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-273ef599-2144-41fb-a71f-32cf821c4e2e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:30.478572 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-273ef599-2144-41fb-a71f-32cf821c4e2e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:30.479350 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-273ef599-2144-41fb-a71f-32cf821c4e2e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:30.479785 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-273ef599-2144-41fb-a71f-32cf821c4e2e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:30.610568 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-273ef599-2144-41fb-a71f-32cf821c4e2e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:30.618862 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-273ef599-2144-41fb-a71f-32cf821c4e2e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.151025 Dec 15 12:59:30.619439 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1047/2076] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:30 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:31.636915 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-62eb3064-c955-497b-8b36-14ca2f6e7368 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:31.638513 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-62eb3064-c955-497b-8b36-14ca2f6e7368 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:31.645009 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-62eb3064-c955-497b-8b36-14ca2f6e7368 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:31.645450 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-62eb3064-c955-497b-8b36-14ca2f6e7368 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:31.646270 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-62eb3064-c955-497b-8b36-14ca2f6e7368 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:31.646704 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-62eb3064-c955-497b-8b36-14ca2f6e7368 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:31.782167 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-62eb3064-c955-497b-8b36-14ca2f6e7368 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:31.790078 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-62eb3064-c955-497b-8b36-14ca2f6e7368 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.157314 Dec 15 12:59:31.790651 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1030/2077] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:31 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:32.807189 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9503f611-bed6-4fb0-b657-cd9e73be8719 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:32.807802 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9503f611-bed6-4fb0-b657-cd9e73be8719 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:32.815586 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9503f611-bed6-4fb0-b657-cd9e73be8719 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:32.816147 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9503f611-bed6-4fb0-b657-cd9e73be8719 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:32.817107 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9503f611-bed6-4fb0-b657-cd9e73be8719 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:32.817573 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9503f611-bed6-4fb0-b657-cd9e73be8719 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:32.947526 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9503f611-bed6-4fb0-b657-cd9e73be8719 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:32.957373 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9503f611-bed6-4fb0-b657-cd9e73be8719 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.153564 Dec 15 12:59:32.958283 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1048/2078] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:32 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:33.980055 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0b468c88-4183-4487-8098-a58b6951d4a0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:33.980687 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0b468c88-4183-4487-8098-a58b6951d4a0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:33.987859 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0b468c88-4183-4487-8098-a58b6951d4a0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:33.988394 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0b468c88-4183-4487-8098-a58b6951d4a0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:33.989203 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0b468c88-4183-4487-8098-a58b6951d4a0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:33.989666 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0b468c88-4183-4487-8098-a58b6951d4a0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:34.329645 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0b468c88-4183-4487-8098-a58b6951d4a0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:34.337270 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0b468c88-4183-4487-8098-a58b6951d4a0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.360999 Dec 15 12:59:34.337884 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1031/2079] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:33 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:35.355844 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-97e071b3-6af8-4f29-a2d5-484500880f00 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:35.356774 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-97e071b3-6af8-4f29-a2d5-484500880f00 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:35.363806 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-97e071b3-6af8-4f29-a2d5-484500880f00 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:35.364182 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-97e071b3-6af8-4f29-a2d5-484500880f00 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:35.364970 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-97e071b3-6af8-4f29-a2d5-484500880f00 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:35.365407 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-97e071b3-6af8-4f29-a2d5-484500880f00 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:35.494561 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-97e071b3-6af8-4f29-a2d5-484500880f00 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:35.502907 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-97e071b3-6af8-4f29-a2d5-484500880f00 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.151298 Dec 15 12:59:35.503479 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1049/2080] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:35 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:36.521002 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-66149b4d-7abf-4ef5-877c-837d541f8f5b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:36.521585 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-66149b4d-7abf-4ef5-877c-837d541f8f5b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:36.527774 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66149b4d-7abf-4ef5-877c-837d541f8f5b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:36.528214 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66149b4d-7abf-4ef5-877c-837d541f8f5b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:36.529109 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66149b4d-7abf-4ef5-877c-837d541f8f5b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:36.529562 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-66149b4d-7abf-4ef5-877c-837d541f8f5b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:36.673811 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-66149b4d-7abf-4ef5-877c-837d541f8f5b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:36.681649 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-66149b4d-7abf-4ef5-877c-837d541f8f5b tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.164284 Dec 15 12:59:36.682229 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1032/2081] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:36 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:37.698348 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-411417e2-b2f4-4287-9b26-769c1663ff01 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:37.699126 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-411417e2-b2f4-4287-9b26-769c1663ff01 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:37.707168 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-411417e2-b2f4-4287-9b26-769c1663ff01 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:37.707623 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-411417e2-b2f4-4287-9b26-769c1663ff01 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:37.708426 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-411417e2-b2f4-4287-9b26-769c1663ff01 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:37.708859 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-411417e2-b2f4-4287-9b26-769c1663ff01 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:37.841077 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-411417e2-b2f4-4287-9b26-769c1663ff01 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:37.848923 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-411417e2-b2f4-4287-9b26-769c1663ff01 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.154441 Dec 15 12:59:37.849482 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1050/2082] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:37 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:38.363211 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 12:59:38.363731 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 12:59:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 12:59:38.870979 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-80e870de-d1ee-4dfb-ae18-1a1037db9142 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:38.871500 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-80e870de-d1ee-4dfb-ae18-1a1037db9142 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:38.878478 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-80e870de-d1ee-4dfb-ae18-1a1037db9142 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:38.878918 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-80e870de-d1ee-4dfb-ae18-1a1037db9142 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:38.879679 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-80e870de-d1ee-4dfb-ae18-1a1037db9142 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:38.880103 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-80e870de-d1ee-4dfb-ae18-1a1037db9142 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:39.023598 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-80e870de-d1ee-4dfb-ae18-1a1037db9142 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:39.031719 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-80e870de-d1ee-4dfb-ae18-1a1037db9142 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.164399 Dec 15 12:59:39.032294 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1033/2083] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:38 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:40.048581 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-13c020e9-a3f9-4b03-b3f0-1f5d24837821 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:40.049201 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-13c020e9-a3f9-4b03-b3f0-1f5d24837821 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:40.055974 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-13c020e9-a3f9-4b03-b3f0-1f5d24837821 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:40.056642 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-13c020e9-a3f9-4b03-b3f0-1f5d24837821 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:40.057451 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-13c020e9-a3f9-4b03-b3f0-1f5d24837821 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:40.057907 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-13c020e9-a3f9-4b03-b3f0-1f5d24837821 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:40.202674 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-13c020e9-a3f9-4b03-b3f0-1f5d24837821 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:40.210711 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-13c020e9-a3f9-4b03-b3f0-1f5d24837821 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.165817 Dec 15 12:59:40.211265 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1051/2084] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:40 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:41.228687 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-cfdab21c-d752-4ad7-ab28-acdbfd9571d7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:41.229358 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-cfdab21c-d752-4ad7-ab28-acdbfd9571d7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:41.236544 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cfdab21c-d752-4ad7-ab28-acdbfd9571d7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:41.236988 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cfdab21c-d752-4ad7-ab28-acdbfd9571d7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:41.237793 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cfdab21c-d752-4ad7-ab28-acdbfd9571d7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:41.238226 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cfdab21c-d752-4ad7-ab28-acdbfd9571d7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:41.380593 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-cfdab21c-d752-4ad7-ab28-acdbfd9571d7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:41.388882 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cfdab21c-d752-4ad7-ab28-acdbfd9571d7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.163839 Dec 15 12:59:41.389450 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1034/2085] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:41 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:42.408280 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-90a00856-e434-4523-adfb-94bd2d1e3ce2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:42.408880 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-90a00856-e434-4523-adfb-94bd2d1e3ce2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:42.415341 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-90a00856-e434-4523-adfb-94bd2d1e3ce2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:42.415789 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-90a00856-e434-4523-adfb-94bd2d1e3ce2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:42.416583 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-90a00856-e434-4523-adfb-94bd2d1e3ce2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:42.417024 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-90a00856-e434-4523-adfb-94bd2d1e3ce2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:42.562530 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-90a00856-e434-4523-adfb-94bd2d1e3ce2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:42.570629 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-90a00856-e434-4523-adfb-94bd2d1e3ce2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.166000 Dec 15 12:59:42.571202 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1052/2086] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:42 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:43.590189 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-227e5a35-cdac-470c-b4e0-434b0fc994d7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:43.591217 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-227e5a35-cdac-470c-b4e0-434b0fc994d7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:43.599835 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-227e5a35-cdac-470c-b4e0-434b0fc994d7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:43.600286 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-227e5a35-cdac-470c-b4e0-434b0fc994d7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:43.601086 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-227e5a35-cdac-470c-b4e0-434b0fc994d7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:43.601634 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-227e5a35-cdac-470c-b4e0-434b0fc994d7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:43.735365 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-227e5a35-cdac-470c-b4e0-434b0fc994d7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:43.743052 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-227e5a35-cdac-470c-b4e0-434b0fc994d7 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.157818 Dec 15 12:59:43.743632 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1035/2087] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:43 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:44.234272 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 12:59:44.234855 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 12:59:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 12:59:44.760308 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-16b2bd80-40d3-494a-a528-23b4ef6adfac tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:44.761037 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-16b2bd80-40d3-494a-a528-23b4ef6adfac tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:44.768008 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-16b2bd80-40d3-494a-a528-23b4ef6adfac tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:44.768463 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-16b2bd80-40d3-494a-a528-23b4ef6adfac tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:44.769244 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-16b2bd80-40d3-494a-a528-23b4ef6adfac tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:44.769716 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-16b2bd80-40d3-494a-a528-23b4ef6adfac tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:44.901660 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-16b2bd80-40d3-494a-a528-23b4ef6adfac tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:44.910468 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-16b2bd80-40d3-494a-a528-23b4ef6adfac tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.154091 Dec 15 12:59:44.911070 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1053/2088] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:44 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:45.927916 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-79f8ec41-988e-443f-8a98-2fd045cb32bd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:45.928524 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-79f8ec41-988e-443f-8a98-2fd045cb32bd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:45.934783 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-79f8ec41-988e-443f-8a98-2fd045cb32bd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:45.935334 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-79f8ec41-988e-443f-8a98-2fd045cb32bd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:45.936135 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-79f8ec41-988e-443f-8a98-2fd045cb32bd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:45.936573 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-79f8ec41-988e-443f-8a98-2fd045cb32bd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:46.075597 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-79f8ec41-988e-443f-8a98-2fd045cb32bd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:46.083440 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-79f8ec41-988e-443f-8a98-2fd045cb32bd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.159107 Dec 15 12:59:46.084001 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1036/2089] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:45 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:47.101263 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-662f2d7e-f333-4437-871f-431fabd65180 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:47.101856 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-662f2d7e-f333-4437-871f-431fabd65180 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:47.108793 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-662f2d7e-f333-4437-871f-431fabd65180 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:47.109243 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-662f2d7e-f333-4437-871f-431fabd65180 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:47.110046 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-662f2d7e-f333-4437-871f-431fabd65180 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:47.110482 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-662f2d7e-f333-4437-871f-431fabd65180 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:47.239067 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-662f2d7e-f333-4437-871f-431fabd65180 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:47.254481 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-662f2d7e-f333-4437-871f-431fabd65180 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.156898 Dec 15 12:59:47.255050 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1054/2090] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:47 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:48.271105 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-265b662a-8088-4451-b8cd-22e477ec4e4c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:48.271715 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-265b662a-8088-4451-b8cd-22e477ec4e4c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:48.277979 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-265b662a-8088-4451-b8cd-22e477ec4e4c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:48.278625 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-265b662a-8088-4451-b8cd-22e477ec4e4c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:48.279425 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-265b662a-8088-4451-b8cd-22e477ec4e4c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:48.279886 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-265b662a-8088-4451-b8cd-22e477ec4e4c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:48.417854 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-265b662a-8088-4451-b8cd-22e477ec4e4c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:48.426097 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-265b662a-8088-4451-b8cd-22e477ec4e4c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.158722 Dec 15 12:59:48.426665 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1037/2091] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:48 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:49.443631 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bace1d66-e1b2-44d8-8660-4d9acbc310c6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:49.444222 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bace1d66-e1b2-44d8-8660-4d9acbc310c6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:49.450711 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bace1d66-e1b2-44d8-8660-4d9acbc310c6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:49.451149 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bace1d66-e1b2-44d8-8660-4d9acbc310c6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:49.451916 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bace1d66-e1b2-44d8-8660-4d9acbc310c6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:49.452347 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bace1d66-e1b2-44d8-8660-4d9acbc310c6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:49.584862 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-bace1d66-e1b2-44d8-8660-4d9acbc310c6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:49.594500 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bace1d66-e1b2-44d8-8660-4d9acbc310c6 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.154363 Dec 15 12:59:49.595079 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1055/2092] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:49 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:50.611070 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0c1a868d-de1a-494d-a894-9f3048651707 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:50.611641 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0c1a868d-de1a-494d-a894-9f3048651707 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:50.618059 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0c1a868d-de1a-494d-a894-9f3048651707 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:50.618502 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0c1a868d-de1a-494d-a894-9f3048651707 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:50.619260 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0c1a868d-de1a-494d-a894-9f3048651707 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:50.619687 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0c1a868d-de1a-494d-a894-9f3048651707 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:50.761959 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0c1a868d-de1a-494d-a894-9f3048651707 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:50.770342 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0c1a868d-de1a-494d-a894-9f3048651707 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.162986 Dec 15 12:59:50.770907 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1038/2093] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:50 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:51.788454 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8ca2464f-02c7-4533-865f-a91f6ae76996 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:51.789078 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8ca2464f-02c7-4533-865f-a91f6ae76996 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:51.796179 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8ca2464f-02c7-4533-865f-a91f6ae76996 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:51.796628 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8ca2464f-02c7-4533-865f-a91f6ae76996 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:51.797409 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8ca2464f-02c7-4533-865f-a91f6ae76996 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:51.797883 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8ca2464f-02c7-4533-865f-a91f6ae76996 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:51.927657 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-8ca2464f-02c7-4533-865f-a91f6ae76996 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:51.935774 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8ca2464f-02c7-4533-865f-a91f6ae76996 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.151018 Dec 15 12:59:51.936394 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1056/2094] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:51 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:52.953086 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-69ba19b3-4029-40fb-98f8-7bbb2c48b56c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:52.953706 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-69ba19b3-4029-40fb-98f8-7bbb2c48b56c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:52.959998 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-69ba19b3-4029-40fb-98f8-7bbb2c48b56c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:52.960442 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-69ba19b3-4029-40fb-98f8-7bbb2c48b56c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:52.961200 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-69ba19b3-4029-40fb-98f8-7bbb2c48b56c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:52.961659 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-69ba19b3-4029-40fb-98f8-7bbb2c48b56c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:53.094350 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-69ba19b3-4029-40fb-98f8-7bbb2c48b56c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:53.103232 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-69ba19b3-4029-40fb-98f8-7bbb2c48b56c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.153970 Dec 15 12:59:53.103807 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1039/2095] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:52 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:54.120992 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1f8b033d-2340-467e-961e-68f9421a9d17 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:54.121640 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1f8b033d-2340-467e-961e-68f9421a9d17 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:54.128965 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1f8b033d-2340-467e-961e-68f9421a9d17 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:54.129411 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1f8b033d-2340-467e-961e-68f9421a9d17 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:54.130224 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1f8b033d-2340-467e-961e-68f9421a9d17 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:54.130693 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1f8b033d-2340-467e-961e-68f9421a9d17 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:54.269195 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1f8b033d-2340-467e-961e-68f9421a9d17 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:54.277694 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1f8b033d-2340-467e-961e-68f9421a9d17 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.160130 Dec 15 12:59:54.278712 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1057/2096] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:54 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:55.295692 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f80f6f42-5913-4a04-a2f6-a0b8d0dfea13 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:55.296403 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f80f6f42-5913-4a04-a2f6-a0b8d0dfea13 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:55.303454 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f80f6f42-5913-4a04-a2f6-a0b8d0dfea13 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:55.303976 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f80f6f42-5913-4a04-a2f6-a0b8d0dfea13 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:55.304769 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f80f6f42-5913-4a04-a2f6-a0b8d0dfea13 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:55.305207 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f80f6f42-5913-4a04-a2f6-a0b8d0dfea13 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:55.446824 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-f80f6f42-5913-4a04-a2f6-a0b8d0dfea13 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:55.454805 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f80f6f42-5913-4a04-a2f6-a0b8d0dfea13 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.163256 Dec 15 12:59:55.455370 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1040/2097] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:55 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:56.476524 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-93b85317-148e-4cc0-8630-eea5a439617c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:56.477176 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-93b85317-148e-4cc0-8630-eea5a439617c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:56.483648 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-93b85317-148e-4cc0-8630-eea5a439617c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:56.484102 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-93b85317-148e-4cc0-8630-eea5a439617c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:56.485085 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-93b85317-148e-4cc0-8630-eea5a439617c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:56.485368 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-93b85317-148e-4cc0-8630-eea5a439617c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:56.617326 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-93b85317-148e-4cc0-8630-eea5a439617c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:56.625812 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-93b85317-148e-4cc0-8630-eea5a439617c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.156471 Dec 15 12:59:56.626386 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1058/2098] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:56 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:57.151258 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 12:59:57.151576 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 12:59:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 12:59:57.643906 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-20c1f4ce-895c-4a80-a203-f66c909c3fb0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:57.644520 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-20c1f4ce-895c-4a80-a203-f66c909c3fb0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:57.650598 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-20c1f4ce-895c-4a80-a203-f66c909c3fb0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:57.651053 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-20c1f4ce-895c-4a80-a203-f66c909c3fb0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:57.651831 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-20c1f4ce-895c-4a80-a203-f66c909c3fb0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:57.652268 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-20c1f4ce-895c-4a80-a203-f66c909c3fb0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:57.788612 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-20c1f4ce-895c-4a80-a203-f66c909c3fb0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:57.796490 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-20c1f4ce-895c-4a80-a203-f66c909c3fb0 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.156230 Dec 15 12:59:57.797675 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1041/2099] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:57 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:58.814907 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e4421062-e405-40ef-98df-0fee6c6256f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:58.815548 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e4421062-e405-40ef-98df-0fee6c6256f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:58.822299 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e4421062-e405-40ef-98df-0fee6c6256f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:58.822746 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e4421062-e405-40ef-98df-0fee6c6256f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:58.823543 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e4421062-e405-40ef-98df-0fee6c6256f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:58.823982 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e4421062-e405-40ef-98df-0fee6c6256f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:58.954476 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e4421062-e405-40ef-98df-0fee6c6256f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 12:59:58.962329 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e4421062-e405-40ef-98df-0fee6c6256f8 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.151616 Dec 15 12:59:58.962887 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1059/2100] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:58 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 12:59:59.979845 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-203242e2-5c88-4981-a705-1d3dc7faf9c1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 12:59:59.980476 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-203242e2-5c88-4981-a705-1d3dc7faf9c1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 12:59:59.987738 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-203242e2-5c88-4981-a705-1d3dc7faf9c1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:59.988182 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-203242e2-5c88-4981-a705-1d3dc7faf9c1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 12:59:59.988955 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-203242e2-5c88-4981-a705-1d3dc7faf9c1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 12:59:59.989495 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-203242e2-5c88-4981-a705-1d3dc7faf9c1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:00.021355 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:00:00.021687 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 13:00:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 (ip 10.222.0.76) !!! Dec 15 13:00:00.138054 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-203242e2-5c88-4981-a705-1d3dc7faf9c1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:00.146807 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-203242e2-5c88-4981-a705-1d3dc7faf9c1 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.170592 Dec 15 13:00:00.147369 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1042/2101] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 12:59:59 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:00:01.164160 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2b35e457-7535-47b8-8a3b-2ff0f1fcc738 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:00:01.164802 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2b35e457-7535-47b8-8a3b-2ff0f1fcc738 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:01.171463 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2b35e457-7535-47b8-8a3b-2ff0f1fcc738 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:01.171911 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2b35e457-7535-47b8-8a3b-2ff0f1fcc738 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:01.172718 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2b35e457-7535-47b8-8a3b-2ff0f1fcc738 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:01.173151 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2b35e457-7535-47b8-8a3b-2ff0f1fcc738 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:01.317500 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2b35e457-7535-47b8-8a3b-2ff0f1fcc738 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:01.325752 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2b35e457-7535-47b8-8a3b-2ff0f1fcc738 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.165056 Dec 15 13:00:01.326295 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1060/2102] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:00:01 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:00:02.342677 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-efb14a86-2d71-4b6f-bde6-bedda17cbabc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:00:02.343298 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-efb14a86-2d71-4b6f-bde6-bedda17cbabc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:02.349628 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-efb14a86-2d71-4b6f-bde6-bedda17cbabc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:02.350081 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-efb14a86-2d71-4b6f-bde6-bedda17cbabc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:02.350857 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-efb14a86-2d71-4b6f-bde6-bedda17cbabc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:02.351293 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-efb14a86-2d71-4b6f-bde6-bedda17cbabc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:02.494242 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-efb14a86-2d71-4b6f-bde6-bedda17cbabc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:02.502780 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-efb14a86-2d71-4b6f-bde6-bedda17cbabc tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.164140 Dec 15 13:00:02.503355 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1043/2103] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:00:02 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:00:03.520097 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0b252406-8c68-46f9-a52f-3888a8fe4570 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:00:03.520781 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0b252406-8c68-46f9-a52f-3888a8fe4570 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:03.526885 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0b252406-8c68-46f9-a52f-3888a8fe4570 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:03.527336 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0b252406-8c68-46f9-a52f-3888a8fe4570 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:03.528827 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0b252406-8c68-46f9-a52f-3888a8fe4570 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:03.529347 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0b252406-8c68-46f9-a52f-3888a8fe4570 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:03.672319 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0b252406-8c68-46f9-a52f-3888a8fe4570 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:03.680109 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0b252406-8c68-46f9-a52f-3888a8fe4570 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.163666 Dec 15 13:00:03.680676 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1061/2104] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:00:03 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:00:04.702787 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-affd4d99-8f49-49c8-a84e-d5a1f63f5ceb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:00:04.703836 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-affd4d99-8f49-49c8-a84e-d5a1f63f5ceb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:04.713977 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-affd4d99-8f49-49c8-a84e-d5a1f63f5ceb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:04.714677 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-affd4d99-8f49-49c8-a84e-d5a1f63f5ceb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:04.715982 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-affd4d99-8f49-49c8-a84e-d5a1f63f5ceb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:04.716728 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-affd4d99-8f49-49c8-a84e-d5a1f63f5ceb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:04.859744 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-affd4d99-8f49-49c8-a84e-d5a1f63f5ceb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:04.867689 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-affd4d99-8f49-49c8-a84e-d5a1f63f5ceb tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.173130 Dec 15 13:00:04.868252 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1044/2105] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:00:04 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:00:05.884857 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-81a1fe92-a62e-4a6b-a5e9-1383443c647f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:00:05.885548 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-81a1fe92-a62e-4a6b-a5e9-1383443c647f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:05.892948 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-81a1fe92-a62e-4a6b-a5e9-1383443c647f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:05.893415 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-81a1fe92-a62e-4a6b-a5e9-1383443c647f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:05.894399 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-81a1fe92-a62e-4a6b-a5e9-1383443c647f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:05.894729 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-81a1fe92-a62e-4a6b-a5e9-1383443c647f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:06.042014 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-81a1fe92-a62e-4a6b-a5e9-1383443c647f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:06.051704 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-81a1fe92-a62e-4a6b-a5e9-1383443c647f tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.170408 Dec 15 13:00:06.052564 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1062/2106] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:00:05 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:00:07.071054 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3292ea08-6136-418c-8a40-a06af1e39ba2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:00:07.071613 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3292ea08-6136-418c-8a40-a06af1e39ba2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:07.078604 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3292ea08-6136-418c-8a40-a06af1e39ba2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:07.079054 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3292ea08-6136-418c-8a40-a06af1e39ba2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:07.079868 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3292ea08-6136-418c-8a40-a06af1e39ba2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:07.080304 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3292ea08-6136-418c-8a40-a06af1e39ba2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:07.219349 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3292ea08-6136-418c-8a40-a06af1e39ba2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:07.227005 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3292ea08-6136-418c-8a40-a06af1e39ba2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.159710 Dec 15 13:00:07.227560 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1045/2107] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:00:07 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:00:08.244400 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a34aa86a-85c4-40df-9c32-c6e44af084da tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:00:08.245105 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a34aa86a-85c4-40df-9c32-c6e44af084da tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:08.252067 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a34aa86a-85c4-40df-9c32-c6e44af084da tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:08.252520 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a34aa86a-85c4-40df-9c32-c6e44af084da tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:08.253300 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a34aa86a-85c4-40df-9c32-c6e44af084da tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:08.253769 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a34aa86a-85c4-40df-9c32-c6e44af084da tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:08.391582 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a34aa86a-85c4-40df-9c32-c6e44af084da tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:08.400040 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a34aa86a-85c4-40df-9c32-c6e44af084da tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.159227 Dec 15 13:00:08.400616 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1063/2108] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:00:08 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:00:09.417330 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1ccec69e-19b6-4d16-82e0-c98d1ac46029 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:00:09.417979 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1ccec69e-19b6-4d16-82e0-c98d1ac46029 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:09.425422 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1ccec69e-19b6-4d16-82e0-c98d1ac46029 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:09.425889 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1ccec69e-19b6-4d16-82e0-c98d1ac46029 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:09.426666 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1ccec69e-19b6-4d16-82e0-c98d1ac46029 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:09.427091 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1ccec69e-19b6-4d16-82e0-c98d1ac46029 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:09.561850 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1ccec69e-19b6-4d16-82e0-c98d1ac46029 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:09.569662 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1ccec69e-19b6-4d16-82e0-c98d1ac46029 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.155989 Dec 15 13:00:09.570222 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1046/2109] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:00:09 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:00:10.591151 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-da484e9f-ee07-4f58-8462-fdc8a3973dee tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:00:10.592023 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-da484e9f-ee07-4f58-8462-fdc8a3973dee tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: 7081597f-acfc-473d-8e16-f7b52bcdd7c9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:10.598877 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-da484e9f-ee07-4f58-8462-fdc8a3973dee tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:10.599330 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-da484e9f-ee07-4f58-8462-fdc8a3973dee tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:10.600120 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-da484e9f-ee07-4f58-8462-fdc8a3973dee tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:10.600560 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-da484e9f-ee07-4f58-8462-fdc8a3973dee tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:10.747207 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-da484e9f-ee07-4f58-8462-fdc8a3973dee tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:10.755166 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-da484e9f-ee07-4f58-8462-fdc8a3973dee tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9" status: 200 len: 1559 microversion: 2.1 time: 0.170544 Dec 15 13:00:10.755732 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1064/2110] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:00:10 2021] GET /compute/v2.1/servers/7081597f-acfc-473d-8e16-f7b52bcdd7c9 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:00:23.831964 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-deb3fe95-f938-46a0-b5e0-826ebe801cba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:00:23.832561 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-deb3fe95-f938-46a0-b5e0-826ebe801cba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:23.838951 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-deb3fe95-f938-46a0-b5e0-826ebe801cba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:23.839396 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-deb3fe95-f938-46a0-b5e0-826ebe801cba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:23.840169 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-deb3fe95-f938-46a0-b5e0-826ebe801cba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:23.840597 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-deb3fe95-f938-46a0-b5e0-826ebe801cba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:23.874468 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-deb3fe95-f938-46a0-b5e0-826ebe801cba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Going to try to terminate instance {{(pid=122615) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:00:23.881333 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.compute.api [None req-deb3fe95-f938-46a0-b5e0-826ebe801cba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Working on deleting snapshot a3cb10ab-f185-49dd-9a57-54c3bf734809 from shelved instance... Dec 15 13:00:24.575927 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-deb3fe95-f938-46a0-b5e0-826ebe801cba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Doing local delete in cell 8bd32f78-c52f-42b9-874a-80fccc21ade4(cell1) {{(pid=122615) _delete /opt/stack/nova/nova/compute/api.py:2439}} Dec 15 13:00:24.576712 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-deb3fe95-f938-46a0-b5e0-826ebe801cba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:24.577174 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-deb3fe95-f938-46a0-b5e0-826ebe801cba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:24.577691 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.compute.api [None req-deb3fe95-f938-46a0-b5e0-826ebe801cba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Dec 15 13:00:24.584633 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.network.neutron [None req-deb3fe95-f938-46a0-b5e0-826ebe801cba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] deallocate_for_instance() {{(pid=122615) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1676}} Dec 15 13:00:25.728033 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.network.neutron [None req-deb3fe95-f938-46a0-b5e0-826ebe801cba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Updating instance_info_cache with network_info: [] {{(pid=122615) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 15 13:00:25.810460 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-4dabb7df-82bb-4baa-9d7f-fd37954aa325 req-61134fad-3246-45f1-a944-641f85675701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2", "name": "network-vif-deleted", "tag": "67d867cb-3a0f-4a77-8182-0e96b6df907f"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:00:25.813678 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:00:25.813678 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 13:00:25.833334 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-4dabb7df-82bb-4baa-9d7f-fd37954aa325 req-61134fad-3246-45f1-a944-641f85675701 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:25.833928 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-4dabb7df-82bb-4baa-9d7f-fd37954aa325 req-61134fad-3246-45f1-a944-641f85675701 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:25.851691 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.compute.server_external_events [req-4dabb7df-82bb-4baa-9d7f-fd37954aa325 req-61134fad-3246-45f1-a944-641f85675701 service nova] Unable to find a host for instance ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2. Dropping event network-vif-deleted {{(pid=122614) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 15 13:00:25.853076 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-4dabb7df-82bb-4baa-9d7f-fd37954aa325 req-61134fad-3246-45f1-a944-641f85675701 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.130923 Dec 15 13:00:25.853759 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1065/2111] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:00:25 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 132 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Dec 15 13:00:26.140082 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.scheduler.client.report [None req-deb3fe95-f938-46a0-b5e0-826ebe801cba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Deleted allocations for instance ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 Dec 15 13:00:26.276728 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-deb3fe95-f938-46a0-b5e0-826ebe801cba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 204 len: 0 microversion: 2.20 time: 2.449137 Dec 15 13:00:26.277237 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1047/2112] 10.222.0.76 () {60 vars in 1279 bytes} [Wed Dec 15 13:00:23 2021] DELETE /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 0 bytes in 2450 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 13:00:26.286128 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-cb0fb0c5-5233-4bbd-8e25-2d0a6fba112c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:00:26.286821 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-cb0fb0c5-5233-4bbd-8e25-2d0a6fba112c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:26.292749 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cb0fb0c5-5233-4bbd-8e25-2d0a6fba112c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:26.293198 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cb0fb0c5-5233-4bbd-8e25-2d0a6fba112c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:26.294022 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cb0fb0c5-5233-4bbd-8e25-2d0a6fba112c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:26.294692 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cb0fb0c5-5233-4bbd-8e25-2d0a6fba112c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:26.309269 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.wsgi [None req-cb0fb0c5-5233-4bbd-8e25-2d0a6fba112c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] HTTP exception thrown: Instance ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 could not be found. Dec 15 13:00:26.309959 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-cb0fb0c5-5233-4bbd-8e25-2d0a6fba112c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Returning 404 to user: Instance ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 could not be found. {{(pid=122614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:00:26.310798 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-cb0fb0c5-5233-4bbd-8e25-2d0a6fba112c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 404 len: 111 microversion: 2.20 time: 0.028495 Dec 15 13:00:26.311393 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1066/2113] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 13:00:26 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:00:26.320587 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-53a7ab4b-c783-44cb-99a7-97134f0ba32f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '.version_select at 0x7f3c6937b280>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:00:26.340733 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-53a7ab4b-c783-44cb-99a7-97134f0ba32f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-569722076" status: 204 len: 0 microversion: 2.20 time: 0.024081 Dec 15 13:00:26.341318 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1048/2114] 10.222.0.76 () {60 vars in 1258 bytes} [Wed Dec 15 13:00:26 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-569722076 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 13:00:27.491037 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-51ebb7f5-453b-49eb-96da-701ab7a39279 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'create', calling method: .version_select at 0x7f3c68aa1040>, body: {"keypair": {"name": "tempest-keypair-833939605"}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:00:27.506002 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-51ebb7f5-453b-49eb-96da-701ab7a39279 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Getting quotas for project 0465053a5542468dad24b48ad38f5430. Resources: {'key_pairs'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:00:27.510091 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-51ebb7f5-453b-49eb-96da-701ab7a39279 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Getting quotas for user d8dfa6af1a5a4bfcab0eab3ea87226b8 and project 0465053a5542468dad24b48ad38f5430. Resources: {'key_pairs'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:00:27.924227 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-51ebb7f5-453b-49eb-96da-701ab7a39279 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Getting quotas for project 0465053a5542468dad24b48ad38f5430. Resources: {'key_pairs'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:00:27.927979 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-51ebb7f5-453b-49eb-96da-701ab7a39279 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Getting quotas for user d8dfa6af1a5a4bfcab0eab3ea87226b8 and project 0465053a5542468dad24b48ad38f5430. Resources: {'key_pairs'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:00:27.942076 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-51ebb7f5-453b-49eb-96da-701ab7a39279 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.454658 Dec 15 13:00:27.942690 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1067/2115] 10.222.0.76 () {62 vars in 1198 bytes} [Wed Dec 15 13:00:27 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 456 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 15 13:00:29.395717 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7ecacd04-1e7b-413f-a476-9726714ae34e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2108203211", "imageRef": "d302555e-2bff-4492-b57d-d59c0097a278", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea8b0c06-630c-43f7-b272-a4f1ec2cec2a"}], "security_groups": [{"name": "tempest-securitygroup--463584116"}], "key_name": "tempest-keypair-833939605", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:00:29.508797 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.network.neutron [None req-7ecacd04-1e7b-413f-a476-9726714ae34e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] validate_networks() for [('ea8b0c06-630c-43f7-b272-a4f1ec2cec2a', None, None, None, None, None)] {{(pid=122615) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:00:29.953467 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-7ecacd04-1e7b-413f-a476-9726714ae34e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Flavor limits 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:00:29.953929 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-7ecacd04-1e7b-413f-a476-9726714ae34e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Image limits 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:00:29.954403 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-7ecacd04-1e7b-413f-a476-9726714ae34e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Flavor pref 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:00:29.954811 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-7ecacd04-1e7b-413f-a476-9726714ae34e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Image pref 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:00:29.955221 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-7ecacd04-1e7b-413f-a476-9726714ae34e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:00:29.963651 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7ecacd04-1e7b-413f-a476-9726714ae34e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:29.964100 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7ecacd04-1e7b-413f-a476-9726714ae34e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:29.964904 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7ecacd04-1e7b-413f-a476-9726714ae34e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:29.965337 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7ecacd04-1e7b-413f-a476-9726714ae34e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:29.985306 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-7ecacd04-1e7b-413f-a476-9726714ae34e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Getting quotas for project 0465053a5542468dad24b48ad38f5430. Resources: {'instances', 'cores', 'ram'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:00:29.990216 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-7ecacd04-1e7b-413f-a476-9726714ae34e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Getting quotas for user d8dfa6af1a5a4bfcab0eab3ea87226b8 and project 0465053a5542468dad24b48ad38f5430. Resources: {'instances', 'cores', 'ram'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:00:30.002628 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7ecacd04-1e7b-413f-a476-9726714ae34e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Going to run 1 instances... {{(pid=122615) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:00:30.005043 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7ecacd04-1e7b-413f-a476-9726714ae34e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d302555e-2bff-4492-b57d-d59c0097a278',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:00:30.056215 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7ecacd04-1e7b-413f-a476-9726714ae34e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.664837 Dec 15 13:00:30.056876 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1049/2116] 10.222.0.76 () {62 vars in 1187 bytes} [Wed Dec 15 13:00:29 2021] POST /compute/v2.1/servers => generated 401 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 15 13:00:30.067276 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f018f0f7-ccad-4ffe-b0df-467564896e22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:00:30.067980 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f018f0f7-ccad-4ffe-b0df-467564896e22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:30.133034 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f018f0f7-ccad-4ffe-b0df-467564896e22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:30.141676 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f018f0f7-ccad-4ffe-b0df-467564896e22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:30.143711 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f018f0f7-ccad-4ffe-b0df-467564896e22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:30.145311 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f018f0f7-ccad-4ffe-b0df-467564896e22 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206" status: 200 len: 1281 microversion: 2.20 time: 0.082204 Dec 15 13:00:30.146545 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1068/2117] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 13:00:30 2021] GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206 => generated 1281 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:00:31.165738 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2d2940cb-30f6-4bd9-857e-86206e18311e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:00:31.166499 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2d2940cb-30f6-4bd9-857e-86206e18311e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:31.174029 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2d2940cb-30f6-4bd9-857e-86206e18311e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:31.174672 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2d2940cb-30f6-4bd9-857e-86206e18311e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:31.175276 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2d2940cb-30f6-4bd9-857e-86206e18311e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:31.175716 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2d2940cb-30f6-4bd9-857e-86206e18311e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:31.251686 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2d2940cb-30f6-4bd9-857e-86206e18311e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:31.260882 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2d2940cb-30f6-4bd9-857e-86206e18311e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:31.263380 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2d2940cb-30f6-4bd9-857e-86206e18311e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:31.267499 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2d2940cb-30f6-4bd9-857e-86206e18311e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206" status: 200 len: 1351 microversion: 2.20 time: 0.103552 Dec 15 13:00:31.268777 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1050/2118] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 13:00:31 2021] GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206 => generated 1351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:00:32.294235 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a069e9ad-0cd7-4f6c-a47e-c4f6163461a9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:00:32.298523 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a069e9ad-0cd7-4f6c-a47e-c4f6163461a9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:32.312048 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a069e9ad-0cd7-4f6c-a47e-c4f6163461a9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:32.313993 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a069e9ad-0cd7-4f6c-a47e-c4f6163461a9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:32.314998 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a069e9ad-0cd7-4f6c-a47e-c4f6163461a9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:32.315450 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a069e9ad-0cd7-4f6c-a47e-c4f6163461a9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:32.477466 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a069e9ad-0cd7-4f6c-a47e-c4f6163461a9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:32.487284 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a069e9ad-0cd7-4f6c-a47e-c4f6163461a9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:32.489030 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a069e9ad-0cd7-4f6c-a47e-c4f6163461a9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:32.490372 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a069e9ad-0cd7-4f6c-a47e-c4f6163461a9 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206" status: 200 len: 1406 microversion: 2.20 time: 0.207722 Dec 15 13:00:32.491078 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1069/2119] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 13:00:32 2021] GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206 => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:00:32.601331 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [req-7e26cc4d-0ba0-4b14-9f85-a4013f1a888f req-30fd6247-0f44-4823-81ab-76c046e1ecd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25f24920-c5f0-4998-abf1-1f4619400206", "tag": "30bcb6fc-8770-4d42-9db7-cc5543321b77"}]} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:00:32.603395 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:00:32.603395 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: warnings.warn(msg) Dec 15 13:00:32.610940 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-7e26cc4d-0ba0-4b14-9f85-a4013f1a888f req-30fd6247-0f44-4823-81ab-76c046e1ecd9 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:32.611378 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-7e26cc4d-0ba0-4b14-9f85-a4013f1a888f req-30fd6247-0f44-4823-81ab-76c046e1ecd9 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:32.622962 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.compute.server_external_events [req-7e26cc4d-0ba0-4b14-9f85-a4013f1a888f req-30fd6247-0f44-4823-81ab-76c046e1ecd9 service nova] Creating event network-changed:30bcb6fc-8770-4d42-9db7-cc5543321b77 for instance 25f24920-c5f0-4998-abf1-1f4619400206 on hv-cinder-81322 Dec 15 13:00:32.629973 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [req-7e26cc4d-0ba0-4b14-9f85-a4013f1a888f req-30fd6247-0f44-4823-81ab-76c046e1ecd9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112974 Dec 15 13:00:32.630580 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1051/2120] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:00:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:00:33.511574 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-295051d4-a2d5-4656-b5c2-b1d3716ac544 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:00:33.512277 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-295051d4-a2d5-4656-b5c2-b1d3716ac544 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:33.518716 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-295051d4-a2d5-4656-b5c2-b1d3716ac544 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:33.519240 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-295051d4-a2d5-4656-b5c2-b1d3716ac544 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:33.520035 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-295051d4-a2d5-4656-b5c2-b1d3716ac544 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:33.520460 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-295051d4-a2d5-4656-b5c2-b1d3716ac544 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:33.665063 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-295051d4-a2d5-4656-b5c2-b1d3716ac544 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:33.673486 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-295051d4-a2d5-4656-b5c2-b1d3716ac544 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:33.675028 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-295051d4-a2d5-4656-b5c2-b1d3716ac544 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:33.676145 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-295051d4-a2d5-4656-b5c2-b1d3716ac544 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206" status: 200 len: 1406 microversion: 2.20 time: 0.168480 Dec 15 13:00:33.676689 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1070/2121] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 13:00:33 2021] GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:00:34.694795 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-daaa2dde-a04d-4c86-ad9a-9d8f523451ea tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:00:34.695492 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-daaa2dde-a04d-4c86-ad9a-9d8f523451ea tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:34.702291 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-daaa2dde-a04d-4c86-ad9a-9d8f523451ea tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:34.702737 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-daaa2dde-a04d-4c86-ad9a-9d8f523451ea tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:34.703520 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-daaa2dde-a04d-4c86-ad9a-9d8f523451ea tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:34.703955 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-daaa2dde-a04d-4c86-ad9a-9d8f523451ea tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:34.844150 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-daaa2dde-a04d-4c86-ad9a-9d8f523451ea tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:34.851925 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-daaa2dde-a04d-4c86-ad9a-9d8f523451ea tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:34.853412 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-daaa2dde-a04d-4c86-ad9a-9d8f523451ea tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:34.854545 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-daaa2dde-a04d-4c86-ad9a-9d8f523451ea tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206" status: 200 len: 1406 microversion: 2.20 time: 0.163927 Dec 15 13:00:34.855102 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1052/2122] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 13:00:34 2021] GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:00:35.872238 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0e4c1a6c-9543-46d6-917d-8d17f6c98c90 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:00:35.872819 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0e4c1a6c-9543-46d6-917d-8d17f6c98c90 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:35.879553 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0e4c1a6c-9543-46d6-917d-8d17f6c98c90 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:35.880037 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0e4c1a6c-9543-46d6-917d-8d17f6c98c90 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:35.880849 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0e4c1a6c-9543-46d6-917d-8d17f6c98c90 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:35.881294 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0e4c1a6c-9543-46d6-917d-8d17f6c98c90 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:36.023530 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0e4c1a6c-9543-46d6-917d-8d17f6c98c90 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:36.031672 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0e4c1a6c-9543-46d6-917d-8d17f6c98c90 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:36.033211 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0e4c1a6c-9543-46d6-917d-8d17f6c98c90 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:36.034356 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0e4c1a6c-9543-46d6-917d-8d17f6c98c90 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206" status: 200 len: 1406 microversion: 2.20 time: 0.165934 Dec 15 13:00:36.034909 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1071/2123] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 13:00:35 2021] GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:00:37.052495 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-67c6f524-3a23-4ea5-a0ec-f40b4f4c5fcd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:00:37.053116 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-67c6f524-3a23-4ea5-a0ec-f40b4f4c5fcd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:37.059501 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-67c6f524-3a23-4ea5-a0ec-f40b4f4c5fcd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:37.059950 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-67c6f524-3a23-4ea5-a0ec-f40b4f4c5fcd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:37.060729 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-67c6f524-3a23-4ea5-a0ec-f40b4f4c5fcd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:37.061220 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-67c6f524-3a23-4ea5-a0ec-f40b4f4c5fcd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:37.199230 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-67c6f524-3a23-4ea5-a0ec-f40b4f4c5fcd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:37.207628 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-67c6f524-3a23-4ea5-a0ec-f40b4f4c5fcd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:37.209108 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-67c6f524-3a23-4ea5-a0ec-f40b4f4c5fcd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:37.210245 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-67c6f524-3a23-4ea5-a0ec-f40b4f4c5fcd tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206" status: 200 len: 1406 microversion: 2.20 time: 0.161586 Dec 15 13:00:37.210797 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1053/2124] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 13:00:37 2021] GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:00:37.637965 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-d5e5dae0-f8a6-49b4-99d7-faae0ff4184c req-1d20b0b0-44cf-45cf-b411-9ac3897b8a7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f24920-c5f0-4998-abf1-1f4619400206", "name": "network-vif-plugged", "status": "completed", "tag": "30bcb6fc-8770-4d42-9db7-cc5543321b77"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:00:37.641422 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:00:37.641422 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 13:00:37.649671 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-d5e5dae0-f8a6-49b4-99d7-faae0ff4184c req-1d20b0b0-44cf-45cf-b411-9ac3897b8a7d service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:37.650214 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-d5e5dae0-f8a6-49b4-99d7-faae0ff4184c req-1d20b0b0-44cf-45cf-b411-9ac3897b8a7d service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:37.666962 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-d5e5dae0-f8a6-49b4-99d7-faae0ff4184c req-1d20b0b0-44cf-45cf-b411-9ac3897b8a7d service nova] Creating event network-vif-plugged:30bcb6fc-8770-4d42-9db7-cc5543321b77 for instance 25f24920-c5f0-4998-abf1-1f4619400206 on hv-cinder-81322 Dec 15 13:00:37.673662 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-d5e5dae0-f8a6-49b4-99d7-faae0ff4184c req-1d20b0b0-44cf-45cf-b411-9ac3897b8a7d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104686 Dec 15 13:00:37.674317 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1072/2125] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:00:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:00:38.228322 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e02aa0dc-485b-4352-90b4-67e6bfd7d86f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:00:38.228943 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e02aa0dc-485b-4352-90b4-67e6bfd7d86f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:38.235997 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e02aa0dc-485b-4352-90b4-67e6bfd7d86f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:38.236443 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e02aa0dc-485b-4352-90b4-67e6bfd7d86f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:38.237222 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e02aa0dc-485b-4352-90b4-67e6bfd7d86f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:38.237689 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e02aa0dc-485b-4352-90b4-67e6bfd7d86f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:38.368636 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e02aa0dc-485b-4352-90b4-67e6bfd7d86f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:38.376581 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e02aa0dc-485b-4352-90b4-67e6bfd7d86f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:38.378156 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e02aa0dc-485b-4352-90b4-67e6bfd7d86f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:38.380011 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e02aa0dc-485b-4352-90b4-67e6bfd7d86f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206" status: 200 len: 1406 microversion: 2.20 time: 0.154725 Dec 15 13:00:38.380011 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1054/2126] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 13:00:38 2021] GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:00:39.399051 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-817adb8b-a154-4ef1-b134-cc2430e1f181 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:00:39.399752 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-817adb8b-a154-4ef1-b134-cc2430e1f181 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:39.405928 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-817adb8b-a154-4ef1-b134-cc2430e1f181 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:39.406383 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-817adb8b-a154-4ef1-b134-cc2430e1f181 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:39.407160 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-817adb8b-a154-4ef1-b134-cc2430e1f181 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:39.407599 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-817adb8b-a154-4ef1-b134-cc2430e1f181 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:39.543421 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-817adb8b-a154-4ef1-b134-cc2430e1f181 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:39.551960 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-817adb8b-a154-4ef1-b134-cc2430e1f181 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:39.553474 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-817adb8b-a154-4ef1-b134-cc2430e1f181 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:00:39.554655 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-817adb8b-a154-4ef1-b134-cc2430e1f181 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206" status: 200 len: 1598 microversion: 2.20 time: 0.160196 Dec 15 13:00:39.555210 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1073/2127] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 13:00:39 2021] GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:00:39.571686 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5d9ce627-3bc4-445e-9aa1-9c3ba5632d11 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:00:39.572295 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5d9ce627-3bc4-445e-9aa1-9c3ba5632d11 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:39.579190 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5d9ce627-3bc4-445e-9aa1-9c3ba5632d11 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:39.579622 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5d9ce627-3bc4-445e-9aa1-9c3ba5632d11 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:39.580425 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5d9ce627-3bc4-445e-9aa1-9c3ba5632d11 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:39.580852 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5d9ce627-3bc4-445e-9aa1-9c3ba5632d11 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:39.665361 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5d9ce627-3bc4-445e-9aa1-9c3ba5632d11 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.097381 Dec 15 13:00:39.666022 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1055/2128] 10.222.0.76 () {60 vars in 1315 bytes} [Wed Dec 15 13:00:39 2021] GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:00:40.956306 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fca05dcf-5789-4099-b5d5-a6be49f061ee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:00:40.957329 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fca05dcf-5789-4099-b5d5-a6be49f061ee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:40.959004 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [req-18bec4e4-8fc6-4a67-b3a0-0a9e64cd6c9a req-e9532b9f-a285-4d15-b261-d2c20760d98c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25f24920-c5f0-4998-abf1-1f4619400206", "tag": "30bcb6fc-8770-4d42-9db7-cc5543321b77"}]} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:00:40.961044 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:00:40.961044 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: warnings.warn(msg) Dec 15 13:00:40.964111 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fca05dcf-5789-4099-b5d5-a6be49f061ee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:40.964822 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fca05dcf-5789-4099-b5d5-a6be49f061ee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:40.965725 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fca05dcf-5789-4099-b5d5-a6be49f061ee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:40.966160 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fca05dcf-5789-4099-b5d5-a6be49f061ee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:40.969090 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-18bec4e4-8fc6-4a67-b3a0-0a9e64cd6c9a req-e9532b9f-a285-4d15-b261-d2c20760d98c service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:40.969556 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-18bec4e4-8fc6-4a67-b3a0-0a9e64cd6c9a req-e9532b9f-a285-4d15-b261-d2c20760d98c service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:40.980684 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.compute.server_external_events [req-18bec4e4-8fc6-4a67-b3a0-0a9e64cd6c9a req-e9532b9f-a285-4d15-b261-d2c20760d98c service nova] Creating event network-changed:30bcb6fc-8770-4d42-9db7-cc5543321b77 for instance 25f24920-c5f0-4998-abf1-1f4619400206 on hv-cinder-81322 Dec 15 13:00:40.986397 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [req-18bec4e4-8fc6-4a67-b3a0-0a9e64cd6c9a req-e9532b9f-a285-4d15-b261-d2c20760d98c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031368 Dec 15 13:00:40.987345 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1056/2129] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:00:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:00:41.035906 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fca05dcf-5789-4099-b5d5-a6be49f061ee tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 14 microversion: 2.20 time: 0.083840 Dec 15 13:00:41.036939 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1074/2130] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:00:40 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:00:42.049920 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-28bf770f-db67-4f01-aab1-73bec8afd4b3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:00:42.051211 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-28bf770f-db67-4f01-aab1-73bec8afd4b3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:42.057415 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-28bf770f-db67-4f01-aab1-73bec8afd4b3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:42.057977 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-28bf770f-db67-4f01-aab1-73bec8afd4b3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:42.058870 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-28bf770f-db67-4f01-aab1-73bec8afd4b3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:42.059277 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-28bf770f-db67-4f01-aab1-73bec8afd4b3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:42.121279 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-28bf770f-db67-4f01-aab1-73bec8afd4b3 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 14 microversion: 2.20 time: 0.076969 Dec 15 13:00:42.122103 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1057/2131] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:00:42 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:00:43.133199 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-95b90d21-edb1-4edf-a093-a3b54ab4fd9b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:00:43.134256 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-95b90d21-edb1-4edf-a093-a3b54ab4fd9b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:43.141970 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-95b90d21-edb1-4edf-a093-a3b54ab4fd9b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:43.142417 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-95b90d21-edb1-4edf-a093-a3b54ab4fd9b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:43.143197 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-95b90d21-edb1-4edf-a093-a3b54ab4fd9b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:43.143620 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-95b90d21-edb1-4edf-a093-a3b54ab4fd9b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:43.203880 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-95b90d21-edb1-4edf-a093-a3b54ab4fd9b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 14 microversion: 2.20 time: 0.074876 Dec 15 13:00:43.204521 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1075/2132] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:00:43 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:00:44.215430 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-120ee417-0ad6-4e42-b9e4-02950a1a519d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:00:44.216331 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-120ee417-0ad6-4e42-b9e4-02950a1a519d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:44.224171 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-120ee417-0ad6-4e42-b9e4-02950a1a519d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:44.224674 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-120ee417-0ad6-4e42-b9e4-02950a1a519d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:44.225429 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-120ee417-0ad6-4e42-b9e4-02950a1a519d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:44.225900 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-120ee417-0ad6-4e42-b9e4-02950a1a519d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:44.293807 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-120ee417-0ad6-4e42-b9e4-02950a1a519d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 14 microversion: 2.20 time: 0.082332 Dec 15 13:00:44.294445 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1058/2133] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:00:44 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:00:45.304842 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-670285b8-df52-4ef6-98d9-cd0380ebe4e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:00:45.305969 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-670285b8-df52-4ef6-98d9-cd0380ebe4e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:45.315067 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-670285b8-df52-4ef6-98d9-cd0380ebe4e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:45.315714 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-670285b8-df52-4ef6-98d9-cd0380ebe4e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:45.316861 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-670285b8-df52-4ef6-98d9-cd0380ebe4e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:45.317500 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-670285b8-df52-4ef6-98d9-cd0380ebe4e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:45.390766 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-670285b8-df52-4ef6-98d9-cd0380ebe4e2 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 14 microversion: 2.20 time: 0.089868 Dec 15 13:00:45.391561 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1076/2134] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:00:45 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:00:46.401485 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-57aaeb80-c2d0-4df9-b252-d15906d5ca24 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:00:46.402515 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-57aaeb80-c2d0-4df9-b252-d15906d5ca24 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:46.410019 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-57aaeb80-c2d0-4df9-b252-d15906d5ca24 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:46.410463 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-57aaeb80-c2d0-4df9-b252-d15906d5ca24 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:46.411260 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-57aaeb80-c2d0-4df9-b252-d15906d5ca24 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:46.411695 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-57aaeb80-c2d0-4df9-b252-d15906d5ca24 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:46.477382 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-57aaeb80-c2d0-4df9-b252-d15906d5ca24 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 14 microversion: 2.20 time: 0.079720 Dec 15 13:00:46.478169 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1059/2135] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:00:46 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:00:47.488563 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c1c79f0c-7447-41fd-afc7-9d6ea7ddc972 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:00:47.489626 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c1c79f0c-7447-41fd-afc7-9d6ea7ddc972 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:47.496478 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c1c79f0c-7447-41fd-afc7-9d6ea7ddc972 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:47.496934 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c1c79f0c-7447-41fd-afc7-9d6ea7ddc972 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:47.497746 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c1c79f0c-7447-41fd-afc7-9d6ea7ddc972 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:47.498191 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c1c79f0c-7447-41fd-afc7-9d6ea7ddc972 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:47.562237 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c1c79f0c-7447-41fd-afc7-9d6ea7ddc972 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 14 microversion: 2.20 time: 0.077443 Dec 15 13:00:47.562900 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1077/2136] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:00:47 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:00:48.572877 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-09d0a8dd-79b6-4dbd-b147-53c8cd19f72c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:00:48.573929 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-09d0a8dd-79b6-4dbd-b147-53c8cd19f72c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:48.580890 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-09d0a8dd-79b6-4dbd-b147-53c8cd19f72c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:48.581346 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-09d0a8dd-79b6-4dbd-b147-53c8cd19f72c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:48.582164 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-09d0a8dd-79b6-4dbd-b147-53c8cd19f72c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:48.582595 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-09d0a8dd-79b6-4dbd-b147-53c8cd19f72c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:48.646081 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-09d0a8dd-79b6-4dbd-b147-53c8cd19f72c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 14 microversion: 2.20 time: 0.077076 Dec 15 13:00:48.646720 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1060/2137] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:00:48 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:00:49.658149 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-db47604f-4070-49d3-922b-1abc98f979c4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:00:49.659134 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-db47604f-4070-49d3-922b-1abc98f979c4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:49.666172 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-db47604f-4070-49d3-922b-1abc98f979c4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:49.666624 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-db47604f-4070-49d3-922b-1abc98f979c4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:49.667441 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-db47604f-4070-49d3-922b-1abc98f979c4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:49.667876 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-db47604f-4070-49d3-922b-1abc98f979c4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:49.738193 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-db47604f-4070-49d3-922b-1abc98f979c4 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 14 microversion: 2.20 time: 0.083686 Dec 15 13:00:49.739133 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1078/2138] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:00:49 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:00:50.750489 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1da8ff0e-fcfb-43d0-8a1c-91033d912d0b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:00:50.751470 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1da8ff0e-fcfb-43d0-8a1c-91033d912d0b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:50.758242 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1da8ff0e-fcfb-43d0-8a1c-91033d912d0b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:50.758680 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1da8ff0e-fcfb-43d0-8a1c-91033d912d0b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:50.759448 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1da8ff0e-fcfb-43d0-8a1c-91033d912d0b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:50.760162 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1da8ff0e-fcfb-43d0-8a1c-91033d912d0b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:50.826491 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1da8ff0e-fcfb-43d0-8a1c-91033d912d0b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 14 microversion: 2.20 time: 0.080458 Dec 15 13:00:50.827341 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1061/2139] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:00:50 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:00:51.838245 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6b49a2d5-297b-406e-b15c-7947ced347b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:00:51.839326 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6b49a2d5-297b-406e-b15c-7947ced347b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:51.846625 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6b49a2d5-297b-406e-b15c-7947ced347b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:51.847081 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6b49a2d5-297b-406e-b15c-7947ced347b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:51.847876 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6b49a2d5-297b-406e-b15c-7947ced347b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:51.848312 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6b49a2d5-297b-406e-b15c-7947ced347b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:51.928494 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6b49a2d5-297b-406e-b15c-7947ced347b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 9302 microversion: 2.20 time: 0.094396 Dec 15 13:00:51.929168 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1079/2140] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:00:51 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 9302 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:00:52.940333 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-adde6cb9-5d4f-49d8-bc64-2bee1d4253ea tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:00:52.941319 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-adde6cb9-5d4f-49d8-bc64-2bee1d4253ea tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:52.948104 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-adde6cb9-5d4f-49d8-bc64-2bee1d4253ea tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:52.948547 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-adde6cb9-5d4f-49d8-bc64-2bee1d4253ea tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:52.949311 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-adde6cb9-5d4f-49d8-bc64-2bee1d4253ea tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:52.949766 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-adde6cb9-5d4f-49d8-bc64-2bee1d4253ea tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:53.025313 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-adde6cb9-5d4f-49d8-bc64-2bee1d4253ea tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 16280 microversion: 2.20 time: 0.088937 Dec 15 13:00:53.029002 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1062/2141] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:00:52 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 16280 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:00:54.037245 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9c06f547-227a-4891-8758-3b0a7fc126ba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:00:54.038272 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9c06f547-227a-4891-8758-3b0a7fc126ba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:54.046645 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9c06f547-227a-4891-8758-3b0a7fc126ba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:54.047111 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9c06f547-227a-4891-8758-3b0a7fc126ba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:54.047906 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9c06f547-227a-4891-8758-3b0a7fc126ba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:54.048346 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9c06f547-227a-4891-8758-3b0a7fc126ba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:54.123678 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9c06f547-227a-4891-8758-3b0a7fc126ba tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 18356 microversion: 2.20 time: 0.090148 Dec 15 13:00:54.125500 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1080/2142] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:00:54 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 18356 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:00:55.135959 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-cc85fee0-ab0b-4933-a784-31537c61765a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:00:55.136948 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-cc85fee0-ab0b-4933-a784-31537c61765a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:55.145470 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc85fee0-ab0b-4933-a784-31537c61765a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:55.145952 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc85fee0-ab0b-4933-a784-31537c61765a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:55.146739 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc85fee0-ab0b-4933-a784-31537c61765a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:55.147181 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc85fee0-ab0b-4933-a784-31537c61765a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:55.229163 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cc85fee0-ab0b-4933-a784-31537c61765a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 20173 microversion: 2.20 time: 0.097290 Dec 15 13:00:55.229976 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1063/2143] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:00:55 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 20173 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:00:56.240877 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-70453981-1b2e-4ac0-b370-6f1488854b3a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:00:56.241898 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-70453981-1b2e-4ac0-b370-6f1488854b3a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:56.248678 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-70453981-1b2e-4ac0-b370-6f1488854b3a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:56.249126 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-70453981-1b2e-4ac0-b370-6f1488854b3a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:56.249937 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-70453981-1b2e-4ac0-b370-6f1488854b3a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:56.250367 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-70453981-1b2e-4ac0-b370-6f1488854b3a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:56.334808 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-70453981-1b2e-4ac0-b370-6f1488854b3a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 22540 microversion: 2.20 time: 0.097176 Dec 15 13:00:56.335412 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1081/2144] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:00:56 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 22540 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:00:57.347028 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e0139598-6703-40df-8624-cfcafec98700 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:00:57.348030 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e0139598-6703-40df-8624-cfcafec98700 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:57.355083 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0139598-6703-40df-8624-cfcafec98700 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:57.355533 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0139598-6703-40df-8624-cfcafec98700 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:57.356312 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0139598-6703-40df-8624-cfcafec98700 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:57.356746 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0139598-6703-40df-8624-cfcafec98700 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:57.437612 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e0139598-6703-40df-8624-cfcafec98700 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 23798 microversion: 2.20 time: 0.094303 Dec 15 13:00:57.438266 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1064/2145] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:00:57 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 23798 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:00:58.449742 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a6ca2278-23bb-4529-a1cb-ad6bf968c725 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:00:58.450731 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a6ca2278-23bb-4529-a1cb-ad6bf968c725 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:58.458811 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a6ca2278-23bb-4529-a1cb-ad6bf968c725 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:58.459254 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a6ca2278-23bb-4529-a1cb-ad6bf968c725 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:58.460041 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a6ca2278-23bb-4529-a1cb-ad6bf968c725 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:58.460471 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a6ca2278-23bb-4529-a1cb-ad6bf968c725 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:58.541073 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a6ca2278-23bb-4529-a1cb-ad6bf968c725 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 25001 microversion: 2.20 time: 0.095278 Dec 15 13:00:58.542049 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1082/2146] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:00:58 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 25001 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:00:59.553352 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8d94a8c3-fbc4-4aea-b321-045be8f431ae tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:00:59.554326 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8d94a8c3-fbc4-4aea-b321-045be8f431ae tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:00:59.561440 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8d94a8c3-fbc4-4aea-b321-045be8f431ae tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:59.561923 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8d94a8c3-fbc4-4aea-b321-045be8f431ae tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:59.562715 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8d94a8c3-fbc4-4aea-b321-045be8f431ae tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:00:59.563172 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8d94a8c3-fbc4-4aea-b321-045be8f431ae tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:00:59.643985 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8d94a8c3-fbc4-4aea-b321-045be8f431ae tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 26481 microversion: 2.20 time: 0.094682 Dec 15 13:00:59.644905 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1065/2147] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:00:59 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 26481 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:01:00.656775 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-10a1dcb6-9f24-4a44-b4bb-26cfaf12e42e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:01:00.657713 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-10a1dcb6-9f24-4a44-b4bb-26cfaf12e42e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:01:00.664764 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-10a1dcb6-9f24-4a44-b4bb-26cfaf12e42e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:00.665214 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-10a1dcb6-9f24-4a44-b4bb-26cfaf12e42e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:00.666114 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-10a1dcb6-9f24-4a44-b4bb-26cfaf12e42e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:00.666481 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-10a1dcb6-9f24-4a44-b4bb-26cfaf12e42e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:00.757646 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-10a1dcb6-9f24-4a44-b4bb-26cfaf12e42e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 27601 microversion: 2.20 time: 0.105344 Dec 15 13:01:00.758343 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1083/2148] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:01:00 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 27601 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:01:01.769969 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e6aceefb-8ad2-44c5-973a-563b44081439 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:01:01.770963 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e6aceefb-8ad2-44c5-973a-563b44081439 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:01:01.777951 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e6aceefb-8ad2-44c5-973a-563b44081439 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:01.778405 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e6aceefb-8ad2-44c5-973a-563b44081439 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:01.779208 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e6aceefb-8ad2-44c5-973a-563b44081439 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:01.779802 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e6aceefb-8ad2-44c5-973a-563b44081439 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:01.869645 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e6aceefb-8ad2-44c5-973a-563b44081439 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 28016 microversion: 2.20 time: 0.103430 Dec 15 13:01:01.870386 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1066/2149] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:01:01 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 28016 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:01:02.882175 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-33a1420d-17f7-4f22-9695-619a5ca8998b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:01:02.883225 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-33a1420d-17f7-4f22-9695-619a5ca8998b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:01:02.890961 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-33a1420d-17f7-4f22-9695-619a5ca8998b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:02.891418 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-33a1420d-17f7-4f22-9695-619a5ca8998b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:02.893470 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-33a1420d-17f7-4f22-9695-619a5ca8998b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:02.894580 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-33a1420d-17f7-4f22-9695-619a5ca8998b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:02.983529 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-33a1420d-17f7-4f22-9695-619a5ca8998b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 28205 microversion: 2.20 time: 0.104602 Dec 15 13:01:02.987491 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1084/2150] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:01:02 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 28205 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:01:03.995830 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0f3234e6-f220-47c3-bb09-99a6a01bb18c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:01:03.996829 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0f3234e6-f220-47c3-bb09-99a6a01bb18c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:01:04.004523 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0f3234e6-f220-47c3-bb09-99a6a01bb18c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:04.004968 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0f3234e6-f220-47c3-bb09-99a6a01bb18c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:04.005778 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0f3234e6-f220-47c3-bb09-99a6a01bb18c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:04.006214 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0f3234e6-f220-47c3-bb09-99a6a01bb18c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:04.086034 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0f3234e6-f220-47c3-bb09-99a6a01bb18c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 28205 microversion: 2.20 time: 0.094081 Dec 15 13:01:04.086722 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1067/2151] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:01:03 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 28205 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:01:05.097816 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d839fa8a-98ea-455e-a504-30834e15877d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:01:05.098808 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d839fa8a-98ea-455e-a504-30834e15877d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:01:05.105620 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d839fa8a-98ea-455e-a504-30834e15877d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:05.106067 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d839fa8a-98ea-455e-a504-30834e15877d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:05.106832 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d839fa8a-98ea-455e-a504-30834e15877d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:05.107261 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d839fa8a-98ea-455e-a504-30834e15877d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:05.184928 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d839fa8a-98ea-455e-a504-30834e15877d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 28496 microversion: 2.20 time: 0.090832 Dec 15 13:01:05.186084 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1085/2152] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:01:05 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 28496 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:01:06.197260 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-85ad474f-f987-454e-8234-4e968816b2ff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:01:06.198189 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-85ad474f-f987-454e-8234-4e968816b2ff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:01:06.205101 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-85ad474f-f987-454e-8234-4e968816b2ff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:06.205602 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-85ad474f-f987-454e-8234-4e968816b2ff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:06.206381 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-85ad474f-f987-454e-8234-4e968816b2ff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:06.206819 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-85ad474f-f987-454e-8234-4e968816b2ff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:06.297013 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-85ad474f-f987-454e-8234-4e968816b2ff tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 28663 microversion: 2.20 time: 0.103786 Dec 15 13:01:06.297689 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1068/2153] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:01:06 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 28663 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:01:07.308735 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0e74c026-56d9-4fb8-ad93-cb61c3e8ab4b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:01:07.309770 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0e74c026-56d9-4fb8-ad93-cb61c3e8ab4b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:01:07.317145 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0e74c026-56d9-4fb8-ad93-cb61c3e8ab4b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:07.317625 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0e74c026-56d9-4fb8-ad93-cb61c3e8ab4b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:07.318400 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0e74c026-56d9-4fb8-ad93-cb61c3e8ab4b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:07.318837 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0e74c026-56d9-4fb8-ad93-cb61c3e8ab4b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:07.390485 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0e74c026-56d9-4fb8-ad93-cb61c3e8ab4b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 28663 microversion: 2.20 time: 0.085588 Dec 15 13:01:07.391993 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1086/2154] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:01:07 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 28663 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:01:08.403741 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-cc92e43d-1cb3-4222-8b34-93bce39a40a0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:01:08.404974 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-cc92e43d-1cb3-4222-8b34-93bce39a40a0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:01:08.411968 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc92e43d-1cb3-4222-8b34-93bce39a40a0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:08.412408 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc92e43d-1cb3-4222-8b34-93bce39a40a0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:08.413179 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc92e43d-1cb3-4222-8b34-93bce39a40a0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:08.413625 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc92e43d-1cb3-4222-8b34-93bce39a40a0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:08.481055 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cc92e43d-1cb3-4222-8b34-93bce39a40a0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 28663 microversion: 2.20 time: 0.081263 Dec 15 13:01:08.481890 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1069/2155] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:01:08 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 28663 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:01:09.493174 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-aed3b7f5-1389-4db6-bda2-81dcc546bdbf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:01:09.494210 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-aed3b7f5-1389-4db6-bda2-81dcc546bdbf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:01:09.501916 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aed3b7f5-1389-4db6-bda2-81dcc546bdbf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:09.502368 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aed3b7f5-1389-4db6-bda2-81dcc546bdbf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:09.503148 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aed3b7f5-1389-4db6-bda2-81dcc546bdbf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:09.503588 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aed3b7f5-1389-4db6-bda2-81dcc546bdbf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:09.587867 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-aed3b7f5-1389-4db6-bda2-81dcc546bdbf tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 28663 microversion: 2.20 time: 0.098590 Dec 15 13:01:09.588537 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1087/2156] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:01:09 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 28663 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:01:10.600219 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-69d6f836-00a4-4cbd-affb-c9116cbca92c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:01:10.601117 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-69d6f836-00a4-4cbd-affb-c9116cbca92c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:01:10.609226 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-69d6f836-00a4-4cbd-affb-c9116cbca92c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:10.609760 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-69d6f836-00a4-4cbd-affb-c9116cbca92c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:10.610509 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-69d6f836-00a4-4cbd-affb-c9116cbca92c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:10.610943 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-69d6f836-00a4-4cbd-affb-c9116cbca92c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:10.695269 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-69d6f836-00a4-4cbd-affb-c9116cbca92c tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 28866 microversion: 2.20 time: 0.098999 Dec 15 13:01:10.696200 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1070/2157] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:01:10 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 28866 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:01:11.707507 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-37f577c7-cc1d-4ee4-8886-ac43a7de9aea tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:01:11.708524 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-37f577c7-cc1d-4ee4-8886-ac43a7de9aea tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:01:11.715496 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-37f577c7-cc1d-4ee4-8886-ac43a7de9aea tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:11.715975 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-37f577c7-cc1d-4ee4-8886-ac43a7de9aea tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:11.716838 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-37f577c7-cc1d-4ee4-8886-ac43a7de9aea tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:11.717481 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-37f577c7-cc1d-4ee4-8886-ac43a7de9aea tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:11.800974 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-37f577c7-cc1d-4ee4-8886-ac43a7de9aea tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 30745 microversion: 2.20 time: 0.098242 Dec 15 13:01:11.801929 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1088/2158] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:01:11 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 30745 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:01:12.814866 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4328f691-8045-4f66-a50c-f82f0b22d7fe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:01:12.815865 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4328f691-8045-4f66-a50c-f82f0b22d7fe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:01:12.822719 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4328f691-8045-4f66-a50c-f82f0b22d7fe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:12.823167 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4328f691-8045-4f66-a50c-f82f0b22d7fe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:12.823944 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4328f691-8045-4f66-a50c-f82f0b22d7fe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:12.824382 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4328f691-8045-4f66-a50c-f82f0b22d7fe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:12.901525 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4328f691-8045-4f66-a50c-f82f0b22d7fe tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 32578 microversion: 2.20 time: 0.091999 Dec 15 13:01:12.902213 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1071/2159] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:01:12 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 32578 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:01:13.913595 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f080ac1d-ff9f-4a3a-bbf6-bf57ba806eec tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:01:13.914590 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f080ac1d-ff9f-4a3a-bbf6-bf57ba806eec tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:01:13.922027 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f080ac1d-ff9f-4a3a-bbf6-bf57ba806eec tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:13.922479 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f080ac1d-ff9f-4a3a-bbf6-bf57ba806eec tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:13.923268 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f080ac1d-ff9f-4a3a-bbf6-bf57ba806eec tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:13.923705 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f080ac1d-ff9f-4a3a-bbf6-bf57ba806eec tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:14.004242 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f080ac1d-ff9f-4a3a-bbf6-bf57ba806eec tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 33508 microversion: 2.20 time: 0.094548 Dec 15 13:01:14.004900 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1089/2160] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:01:13 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 33508 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:01:15.017476 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2ac3ddb8-f01a-4a24-a5da-c206beff98d1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:01:15.018500 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2ac3ddb8-f01a-4a24-a5da-c206beff98d1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:01:15.025298 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2ac3ddb8-f01a-4a24-a5da-c206beff98d1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:15.025774 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2ac3ddb8-f01a-4a24-a5da-c206beff98d1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:15.026544 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2ac3ddb8-f01a-4a24-a5da-c206beff98d1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:15.026972 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2ac3ddb8-f01a-4a24-a5da-c206beff98d1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:15.109616 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2ac3ddb8-f01a-4a24-a5da-c206beff98d1 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 34315 microversion: 2.20 time: 0.096624 Dec 15 13:01:15.110625 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1072/2161] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:01:15 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 34315 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:01:16.122355 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b04ab5d3-f41f-4dde-aeaf-0c76d2b60cb0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:01:16.129936 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b04ab5d3-f41f-4dde-aeaf-0c76d2b60cb0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:01:16.130813 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b04ab5d3-f41f-4dde-aeaf-0c76d2b60cb0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:16.131262 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b04ab5d3-f41f-4dde-aeaf-0c76d2b60cb0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:16.132053 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b04ab5d3-f41f-4dde-aeaf-0c76d2b60cb0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:16.132489 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b04ab5d3-f41f-4dde-aeaf-0c76d2b60cb0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:16.217879 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b04ab5d3-f41f-4dde-aeaf-0c76d2b60cb0 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 35335 microversion: 2.20 time: 0.098695 Dec 15 13:01:16.218516 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1090/2162] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:01:16 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 35335 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:01:17.233776 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fd898a0c-343e-4eae-b052-d2ac155fe018 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:01:17.234811 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fd898a0c-343e-4eae-b052-d2ac155fe018 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:01:17.241702 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fd898a0c-343e-4eae-b052-d2ac155fe018 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:17.242158 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fd898a0c-343e-4eae-b052-d2ac155fe018 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:17.242936 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fd898a0c-343e-4eae-b052-d2ac155fe018 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:17.243373 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fd898a0c-343e-4eae-b052-d2ac155fe018 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:17.330464 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fd898a0c-343e-4eae-b052-d2ac155fe018 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 36718 microversion: 2.20 time: 0.101017 Dec 15 13:01:17.331385 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1073/2163] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:01:17 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 36718 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:01:18.344315 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-418500dc-5025-4bae-adf9-a909ad2ff533 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:01:18.345232 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-418500dc-5025-4bae-adf9-a909ad2ff533 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:01:18.352193 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-418500dc-5025-4bae-adf9-a909ad2ff533 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:18.352640 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-418500dc-5025-4bae-adf9-a909ad2ff533 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:18.353430 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-418500dc-5025-4bae-adf9-a909ad2ff533 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:18.353898 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-418500dc-5025-4bae-adf9-a909ad2ff533 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:18.432025 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-418500dc-5025-4bae-adf9-a909ad2ff533 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 37981 microversion: 2.20 time: 0.092527 Dec 15 13:01:18.432969 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1091/2164] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:01:18 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 37981 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:01:18.477032 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:01:18.477307 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 13:01:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:01:19.444887 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ac1f2b73-6b4b-4ddd-be73-0ddc8bd4003e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:01:19.445911 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ac1f2b73-6b4b-4ddd-be73-0ddc8bd4003e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:01:19.452932 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ac1f2b73-6b4b-4ddd-be73-0ddc8bd4003e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:19.453379 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ac1f2b73-6b4b-4ddd-be73-0ddc8bd4003e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:19.454192 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ac1f2b73-6b4b-4ddd-be73-0ddc8bd4003e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:19.454635 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ac1f2b73-6b4b-4ddd-be73-0ddc8bd4003e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:19.538610 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ac1f2b73-6b4b-4ddd-be73-0ddc8bd4003e tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 38214 microversion: 2.20 time: 0.097506 Dec 15 13:01:19.539188 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1074/2165] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:01:19 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 38214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:01:20.551614 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7c71e825-97f6-4530-9858-150754716655 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:01:20.552709 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7c71e825-97f6-4530-9858-150754716655 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:01:20.561105 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7c71e825-97f6-4530-9858-150754716655 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:20.561582 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7c71e825-97f6-4530-9858-150754716655 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:20.562370 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7c71e825-97f6-4530-9858-150754716655 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:20.562802 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7c71e825-97f6-4530-9858-150754716655 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:20.637056 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7c71e825-97f6-4530-9858-150754716655 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 38214 microversion: 2.20 time: 0.089356 Dec 15 13:01:20.641266 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1092/2166] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:01:20 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 38214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:01:21.649321 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4563f4d2-bcb4-463e-8065-7c24bd4b9531 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:01:21.650376 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4563f4d2-bcb4-463e-8065-7c24bd4b9531 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:01:21.658241 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4563f4d2-bcb4-463e-8065-7c24bd4b9531 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:21.658683 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4563f4d2-bcb4-463e-8065-7c24bd4b9531 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:21.659457 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4563f4d2-bcb4-463e-8065-7c24bd4b9531 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:21.659886 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4563f4d2-bcb4-463e-8065-7c24bd4b9531 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:21.738442 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4563f4d2-bcb4-463e-8065-7c24bd4b9531 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 38214 microversion: 2.20 time: 0.093189 Dec 15 13:01:21.739100 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1075/2167] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:01:21 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 38214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:01:22.752033 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ce496c03-00bc-4060-bcd4-1990d5554f9d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:01:22.753040 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ce496c03-00bc-4060-bcd4-1990d5554f9d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:01:22.759948 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce496c03-00bc-4060-bcd4-1990d5554f9d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:22.760656 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce496c03-00bc-4060-bcd4-1990d5554f9d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:22.761443 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce496c03-00bc-4060-bcd4-1990d5554f9d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:22.761906 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce496c03-00bc-4060-bcd4-1990d5554f9d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:22.850797 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ce496c03-00bc-4060-bcd4-1990d5554f9d tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action" status: 200 len: 38357 microversion: 2.20 time: 0.103565 Dec 15 13:01:22.851517 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1093/2168] 10.222.0.76 () {62 vars in 1318 bytes} [Wed Dec 15 13:01:22 2021] POST /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/action => generated 38357 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:01:22.862217 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-15e082ac-c59c-4217-8dfb-b970104eba02 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:01:22.862780 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-15e082ac-c59c-4217-8dfb-b970104eba02 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:01:22.869600 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-15e082ac-c59c-4217-8dfb-b970104eba02 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:22.870048 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-15e082ac-c59c-4217-8dfb-b970104eba02 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:22.870826 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-15e082ac-c59c-4217-8dfb-b970104eba02 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:01:22.871261 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-15e082ac-c59c-4217-8dfb-b970104eba02 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:01:22.902935 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-15e082ac-c59c-4217-8dfb-b970104eba02 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/ips" status: 200 len: 152 microversion: 2.20 time: 0.044564 Dec 15 13:01:22.904003 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1076/2169] 10.222.0.76 () {60 vars in 1288 bytes} [Wed Dec 15 13:01:22 2021] GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206/ips => generated 152 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:02:14.502057 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-63362516-86b5-40a1-82f5-cc3c790f9d6d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:14.502733 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-63362516-86b5-40a1-82f5-cc3c790f9d6d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:14.510252 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-63362516-86b5-40a1-82f5-cc3c790f9d6d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:14.510953 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-63362516-86b5-40a1-82f5-cc3c790f9d6d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:14.511732 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-63362516-86b5-40a1-82f5-cc3c790f9d6d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:14.512267 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-63362516-86b5-40a1-82f5-cc3c790f9d6d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:14.539520 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-63362516-86b5-40a1-82f5-cc3c790f9d6d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Going to try to terminate instance {{(pid=122614) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:02:14.619870 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-63362516-86b5-40a1-82f5-cc3c790f9d6d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "DELETE /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 204 len: 0 microversion: 2.1 time: 0.121284 Dec 15 13:02:14.620715 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1094/2170] 10.222.0.76 () {58 vars in 1238 bytes} [Wed Dec 15 13:02:14 2021] DELETE /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:02:14.629326 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a03c146e-b995-4f8b-8154-8b867900fc88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:14.630054 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a03c146e-b995-4f8b-8154-8b867900fc88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:14.636917 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a03c146e-b995-4f8b-8154-8b867900fc88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:14.637369 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a03c146e-b995-4f8b-8154-8b867900fc88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:14.638239 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a03c146e-b995-4f8b-8154-8b867900fc88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:14.638675 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a03c146e-b995-4f8b-8154-8b867900fc88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:14.773869 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a03c146e-b995-4f8b-8154-8b867900fc88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:14.781877 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a03c146e-b995-4f8b-8154-8b867900fc88 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.156731 Dec 15 13:02:14.782473 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1077/2171] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:14 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:15.799627 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b8cbceb3-0ac8-4221-a861-495140a1f3a9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:15.800288 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b8cbceb3-0ac8-4221-a861-495140a1f3a9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:15.806792 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b8cbceb3-0ac8-4221-a861-495140a1f3a9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:15.807249 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b8cbceb3-0ac8-4221-a861-495140a1f3a9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:15.808031 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b8cbceb3-0ac8-4221-a861-495140a1f3a9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:15.808472 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b8cbceb3-0ac8-4221-a861-495140a1f3a9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:15.951620 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b8cbceb3-0ac8-4221-a861-495140a1f3a9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:15.959384 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b8cbceb3-0ac8-4221-a861-495140a1f3a9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.163872 Dec 15 13:02:15.959956 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1095/2172] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:15 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:16.977457 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b7a5f8ac-37b2-412a-91f1-42808ba80810 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:16.978110 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b7a5f8ac-37b2-412a-91f1-42808ba80810 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:16.984525 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b7a5f8ac-37b2-412a-91f1-42808ba80810 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:16.984987 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b7a5f8ac-37b2-412a-91f1-42808ba80810 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:16.985782 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b7a5f8ac-37b2-412a-91f1-42808ba80810 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:16.986221 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b7a5f8ac-37b2-412a-91f1-42808ba80810 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:17.123496 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b7a5f8ac-37b2-412a-91f1-42808ba80810 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:17.131927 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b7a5f8ac-37b2-412a-91f1-42808ba80810 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.158828 Dec 15 13:02:17.132554 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1078/2173] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:16 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:18.148856 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8943f8ac-b89f-4f03-bd5d-2527e4cea9e5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:18.149468 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8943f8ac-b89f-4f03-bd5d-2527e4cea9e5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:18.156148 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8943f8ac-b89f-4f03-bd5d-2527e4cea9e5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:18.156597 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8943f8ac-b89f-4f03-bd5d-2527e4cea9e5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:18.157365 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8943f8ac-b89f-4f03-bd5d-2527e4cea9e5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:18.157827 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8943f8ac-b89f-4f03-bd5d-2527e4cea9e5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:18.294511 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-8943f8ac-b89f-4f03-bd5d-2527e4cea9e5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:18.302977 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8943f8ac-b89f-4f03-bd5d-2527e4cea9e5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.158361 Dec 15 13:02:18.303562 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1096/2174] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:18 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:19.320330 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e8da4f65-cbf9-45a3-85fb-3d60578dbe58 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:19.321072 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e8da4f65-cbf9-45a3-85fb-3d60578dbe58 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:19.327933 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e8da4f65-cbf9-45a3-85fb-3d60578dbe58 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:19.328375 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e8da4f65-cbf9-45a3-85fb-3d60578dbe58 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:19.329260 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e8da4f65-cbf9-45a3-85fb-3d60578dbe58 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:19.329724 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e8da4f65-cbf9-45a3-85fb-3d60578dbe58 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:19.461721 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e8da4f65-cbf9-45a3-85fb-3d60578dbe58 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:19.471472 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e8da4f65-cbf9-45a3-85fb-3d60578dbe58 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.154763 Dec 15 13:02:19.472354 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1079/2175] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:19 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:20.489683 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-697721c7-7a26-43ec-a892-a10764f29d5f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:20.490335 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-697721c7-7a26-43ec-a892-a10764f29d5f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:20.497429 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-697721c7-7a26-43ec-a892-a10764f29d5f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:20.497898 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-697721c7-7a26-43ec-a892-a10764f29d5f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:20.498665 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-697721c7-7a26-43ec-a892-a10764f29d5f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:20.499096 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-697721c7-7a26-43ec-a892-a10764f29d5f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:20.631022 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-697721c7-7a26-43ec-a892-a10764f29d5f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:20.639259 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-697721c7-7a26-43ec-a892-a10764f29d5f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.153325 Dec 15 13:02:20.639829 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1097/2176] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:20 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:21.657444 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0065a24d-eb40-4e31-bec2-3159a681bb60 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:21.658393 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0065a24d-eb40-4e31-bec2-3159a681bb60 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:21.667331 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0065a24d-eb40-4e31-bec2-3159a681bb60 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:21.667787 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0065a24d-eb40-4e31-bec2-3159a681bb60 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:21.668584 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0065a24d-eb40-4e31-bec2-3159a681bb60 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:21.669055 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0065a24d-eb40-4e31-bec2-3159a681bb60 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:21.813718 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0065a24d-eb40-4e31-bec2-3159a681bb60 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:21.822248 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0065a24d-eb40-4e31-bec2-3159a681bb60 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.169411 Dec 15 13:02:21.823330 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1080/2177] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:21 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:22.839737 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4524bd23-50ee-4bee-a70f-250f88746ea4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:22.840295 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4524bd23-50ee-4bee-a70f-250f88746ea4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:22.846629 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4524bd23-50ee-4bee-a70f-250f88746ea4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:22.847072 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4524bd23-50ee-4bee-a70f-250f88746ea4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:22.847840 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4524bd23-50ee-4bee-a70f-250f88746ea4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:22.848269 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4524bd23-50ee-4bee-a70f-250f88746ea4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:22.985582 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4524bd23-50ee-4bee-a70f-250f88746ea4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:22.993446 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4524bd23-50ee-4bee-a70f-250f88746ea4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.157581 Dec 15 13:02:22.994074 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1098/2178] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:22 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:24.012016 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c4c24c37-1d15-47cc-abc7-6d794d64dee7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:24.012664 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c4c24c37-1d15-47cc-abc7-6d794d64dee7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:24.019152 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c4c24c37-1d15-47cc-abc7-6d794d64dee7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:24.019603 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c4c24c37-1d15-47cc-abc7-6d794d64dee7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:24.020387 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c4c24c37-1d15-47cc-abc7-6d794d64dee7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:24.020824 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c4c24c37-1d15-47cc-abc7-6d794d64dee7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:24.162204 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c4c24c37-1d15-47cc-abc7-6d794d64dee7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:24.171311 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c4c24c37-1d15-47cc-abc7-6d794d64dee7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.163752 Dec 15 13:02:24.171886 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1081/2179] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:24 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:25.188754 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a3f0f434-0f1f-48d1-bcaa-56ac016e7157 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:25.189369 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a3f0f434-0f1f-48d1-bcaa-56ac016e7157 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:25.195995 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a3f0f434-0f1f-48d1-bcaa-56ac016e7157 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:25.196479 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a3f0f434-0f1f-48d1-bcaa-56ac016e7157 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:25.197324 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a3f0f434-0f1f-48d1-bcaa-56ac016e7157 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:25.197918 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a3f0f434-0f1f-48d1-bcaa-56ac016e7157 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:25.343660 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a3f0f434-0f1f-48d1-bcaa-56ac016e7157 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:25.356399 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a3f0f434-0f1f-48d1-bcaa-56ac016e7157 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.171048 Dec 15 13:02:25.357345 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1099/2180] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:25 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:26.381848 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e05a73d6-d0b1-4657-97bc-8ccf403eb960 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:26.382455 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e05a73d6-d0b1-4657-97bc-8ccf403eb960 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:26.389612 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e05a73d6-d0b1-4657-97bc-8ccf403eb960 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:26.390072 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e05a73d6-d0b1-4657-97bc-8ccf403eb960 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:26.390863 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e05a73d6-d0b1-4657-97bc-8ccf403eb960 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:26.391298 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e05a73d6-d0b1-4657-97bc-8ccf403eb960 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:26.528777 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e05a73d6-d0b1-4657-97bc-8ccf403eb960 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:26.536694 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e05a73d6-d0b1-4657-97bc-8ccf403eb960 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.158509 Dec 15 13:02:26.537278 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1082/2181] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:26 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:27.554299 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b7ea0098-cf89-4cc5-8edc-cba576df143c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:27.554916 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b7ea0098-cf89-4cc5-8edc-cba576df143c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:27.562224 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b7ea0098-cf89-4cc5-8edc-cba576df143c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:27.562669 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b7ea0098-cf89-4cc5-8edc-cba576df143c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:27.563444 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b7ea0098-cf89-4cc5-8edc-cba576df143c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:27.563871 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b7ea0098-cf89-4cc5-8edc-cba576df143c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:27.699172 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b7ea0098-cf89-4cc5-8edc-cba576df143c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:27.707131 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b7ea0098-cf89-4cc5-8edc-cba576df143c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.156470 Dec 15 13:02:27.707752 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1100/2182] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:27 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:28.725702 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b0184f38-9566-47f7-a35c-f622097a2460 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:28.726661 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b0184f38-9566-47f7-a35c-f622097a2460 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:28.736650 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b0184f38-9566-47f7-a35c-f622097a2460 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:28.737336 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b0184f38-9566-47f7-a35c-f622097a2460 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:28.738582 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b0184f38-9566-47f7-a35c-f622097a2460 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:28.739256 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b0184f38-9566-47f7-a35c-f622097a2460 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:28.894779 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b0184f38-9566-47f7-a35c-f622097a2460 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:28.903724 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b0184f38-9566-47f7-a35c-f622097a2460 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.183327 Dec 15 13:02:28.904309 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1083/2183] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:28 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:29.921069 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7654b7a2-60b7-491c-9b85-55d1d13a9ef1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:29.921811 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7654b7a2-60b7-491c-9b85-55d1d13a9ef1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:29.928491 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7654b7a2-60b7-491c-9b85-55d1d13a9ef1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:29.929051 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7654b7a2-60b7-491c-9b85-55d1d13a9ef1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:29.929977 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7654b7a2-60b7-491c-9b85-55d1d13a9ef1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:29.930476 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7654b7a2-60b7-491c-9b85-55d1d13a9ef1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:30.071106 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7654b7a2-60b7-491c-9b85-55d1d13a9ef1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:30.079686 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7654b7a2-60b7-491c-9b85-55d1d13a9ef1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.163385 Dec 15 13:02:30.080281 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1101/2184] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:29 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:31.097368 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-02152524-9b07-4821-9e8d-8faa4b91bff7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:31.098052 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-02152524-9b07-4821-9e8d-8faa4b91bff7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:31.104696 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-02152524-9b07-4821-9e8d-8faa4b91bff7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:31.105471 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-02152524-9b07-4821-9e8d-8faa4b91bff7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:31.106334 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-02152524-9b07-4821-9e8d-8faa4b91bff7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:31.106759 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-02152524-9b07-4821-9e8d-8faa4b91bff7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:31.242839 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-02152524-9b07-4821-9e8d-8faa4b91bff7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:31.251804 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-02152524-9b07-4821-9e8d-8faa4b91bff7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.158463 Dec 15 13:02:31.252412 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1084/2185] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:31 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:32.269579 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b300a09b-4b9e-4509-af17-1bfa91e8afa0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:32.270147 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b300a09b-4b9e-4509-af17-1bfa91e8afa0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:32.277589 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b300a09b-4b9e-4509-af17-1bfa91e8afa0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:32.278068 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b300a09b-4b9e-4509-af17-1bfa91e8afa0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:32.278864 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b300a09b-4b9e-4509-af17-1bfa91e8afa0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:32.279304 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b300a09b-4b9e-4509-af17-1bfa91e8afa0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:32.415303 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b300a09b-4b9e-4509-af17-1bfa91e8afa0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:32.423112 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b300a09b-4b9e-4509-af17-1bfa91e8afa0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.157615 Dec 15 13:02:32.423719 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1102/2186] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:32 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:33.440445 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c4234182-3501-4e92-91c5-4aae9b83a4f6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:33.441158 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c4234182-3501-4e92-91c5-4aae9b83a4f6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:33.447490 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c4234182-3501-4e92-91c5-4aae9b83a4f6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:33.447811 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c4234182-3501-4e92-91c5-4aae9b83a4f6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:33.448577 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c4234182-3501-4e92-91c5-4aae9b83a4f6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:33.449009 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c4234182-3501-4e92-91c5-4aae9b83a4f6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:33.589042 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c4234182-3501-4e92-91c5-4aae9b83a4f6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:33.597072 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c4234182-3501-4e92-91c5-4aae9b83a4f6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.160263 Dec 15 13:02:33.597660 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1085/2187] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:33 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:34.615175 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0709ed04-175e-4b19-97b8-1c46fa3bb8b6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:34.615799 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0709ed04-175e-4b19-97b8-1c46fa3bb8b6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:34.623348 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0709ed04-175e-4b19-97b8-1c46fa3bb8b6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:34.623798 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0709ed04-175e-4b19-97b8-1c46fa3bb8b6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:34.624607 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0709ed04-175e-4b19-97b8-1c46fa3bb8b6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:34.625042 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0709ed04-175e-4b19-97b8-1c46fa3bb8b6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:34.760367 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0709ed04-175e-4b19-97b8-1c46fa3bb8b6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:34.779988 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0709ed04-175e-4b19-97b8-1c46fa3bb8b6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.169081 Dec 15 13:02:34.780562 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1103/2188] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:34 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:35.796153 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f045f4fe-7156-4298-a589-7817a6a4bb3f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:35.796719 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f045f4fe-7156-4298-a589-7817a6a4bb3f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:35.802912 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f045f4fe-7156-4298-a589-7817a6a4bb3f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:35.803356 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f045f4fe-7156-4298-a589-7817a6a4bb3f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:35.804123 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f045f4fe-7156-4298-a589-7817a6a4bb3f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:35.804554 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f045f4fe-7156-4298-a589-7817a6a4bb3f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:35.943029 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-f045f4fe-7156-4298-a589-7817a6a4bb3f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:35.950797 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f045f4fe-7156-4298-a589-7817a6a4bb3f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.158402 Dec 15 13:02:35.951365 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1086/2189] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:35 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:02:36.967982 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-40914c55-d0fa-4b88-886a-79604fad529b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:36.968593 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-40914c55-d0fa-4b88-886a-79604fad529b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:36.974862 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-40914c55-d0fa-4b88-886a-79604fad529b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:36.975305 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-40914c55-d0fa-4b88-886a-79604fad529b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:36.976100 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-40914c55-d0fa-4b88-886a-79604fad529b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:36.976534 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-40914c55-d0fa-4b88-886a-79604fad529b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:37.112952 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-40914c55-d0fa-4b88-886a-79604fad529b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:37.121858 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-40914c55-d0fa-4b88-886a-79604fad529b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.157110 Dec 15 13:02:37.122615 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1104/2190] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:36 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:38.139624 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-515da580-3032-49c7-b90c-af0648a701df tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:38.140228 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-515da580-3032-49c7-b90c-af0648a701df tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:38.146482 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-515da580-3032-49c7-b90c-af0648a701df tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:38.146928 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-515da580-3032-49c7-b90c-af0648a701df tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:38.147697 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-515da580-3032-49c7-b90c-af0648a701df tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:38.148119 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-515da580-3032-49c7-b90c-af0648a701df tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:38.289780 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-515da580-3032-49c7-b90c-af0648a701df tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:38.297828 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-515da580-3032-49c7-b90c-af0648a701df tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.162612 Dec 15 13:02:38.298414 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1087/2191] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:38 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:39.314562 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-70079158-1d1f-4a58-9f58-0b67be5d62a3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:39.315271 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-70079158-1d1f-4a58-9f58-0b67be5d62a3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:39.321926 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-70079158-1d1f-4a58-9f58-0b67be5d62a3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:39.322380 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-70079158-1d1f-4a58-9f58-0b67be5d62a3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:39.323156 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-70079158-1d1f-4a58-9f58-0b67be5d62a3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:39.323635 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-70079158-1d1f-4a58-9f58-0b67be5d62a3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:39.456148 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-70079158-1d1f-4a58-9f58-0b67be5d62a3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:39.464350 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-70079158-1d1f-4a58-9f58-0b67be5d62a3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.153392 Dec 15 13:02:39.465468 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1105/2192] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:39 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:40.482353 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-490f189f-03c6-4782-9c38-0d00236b69aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:40.482967 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-490f189f-03c6-4782-9c38-0d00236b69aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:40.489171 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-490f189f-03c6-4782-9c38-0d00236b69aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:40.489646 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-490f189f-03c6-4782-9c38-0d00236b69aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:40.490417 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-490f189f-03c6-4782-9c38-0d00236b69aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:40.490849 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-490f189f-03c6-4782-9c38-0d00236b69aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:40.626615 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-490f189f-03c6-4782-9c38-0d00236b69aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:40.634325 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-490f189f-03c6-4782-9c38-0d00236b69aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.156202 Dec 15 13:02:40.634896 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1088/2193] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:40 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:41.651732 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-de70244b-998a-4383-912f-a4cfc29a7eb6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:41.652301 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-de70244b-998a-4383-912f-a4cfc29a7eb6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:41.659083 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-de70244b-998a-4383-912f-a4cfc29a7eb6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:41.659534 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-de70244b-998a-4383-912f-a4cfc29a7eb6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:41.660328 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-de70244b-998a-4383-912f-a4cfc29a7eb6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:41.660766 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-de70244b-998a-4383-912f-a4cfc29a7eb6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:41.802506 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-de70244b-998a-4383-912f-a4cfc29a7eb6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:41.811628 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-de70244b-998a-4383-912f-a4cfc29a7eb6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.163752 Dec 15 13:02:41.812251 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1106/2194] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:41 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:42.830572 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c99b0373-3a96-43cb-9d0d-3f83df584605 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:42.831189 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c99b0373-3a96-43cb-9d0d-3f83df584605 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:42.837588 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c99b0373-3a96-43cb-9d0d-3f83df584605 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:42.838036 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c99b0373-3a96-43cb-9d0d-3f83df584605 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:42.838821 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c99b0373-3a96-43cb-9d0d-3f83df584605 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:42.839648 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c99b0373-3a96-43cb-9d0d-3f83df584605 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:42.976598 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c99b0373-3a96-43cb-9d0d-3f83df584605 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:42.984467 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c99b0373-3a96-43cb-9d0d-3f83df584605 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.157704 Dec 15 13:02:42.985039 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1089/2195] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:42 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:44.001397 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d26bbbbf-f3e7-4d29-9145-ee99468f73b7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:44.002029 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d26bbbbf-f3e7-4d29-9145-ee99468f73b7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:44.008416 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d26bbbbf-f3e7-4d29-9145-ee99468f73b7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:44.008871 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d26bbbbf-f3e7-4d29-9145-ee99468f73b7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:44.009697 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d26bbbbf-f3e7-4d29-9145-ee99468f73b7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:44.010135 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d26bbbbf-f3e7-4d29-9145-ee99468f73b7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:44.162133 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d26bbbbf-f3e7-4d29-9145-ee99468f73b7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:44.170487 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d26bbbbf-f3e7-4d29-9145-ee99468f73b7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.172696 Dec 15 13:02:44.171067 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1107/2196] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:43 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:45.187976 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-01dbf5f5-e84e-4bb5-a0a0-641f77008262 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:45.188509 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-01dbf5f5-e84e-4bb5-a0a0-641f77008262 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:45.195123 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-01dbf5f5-e84e-4bb5-a0a0-641f77008262 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:45.195573 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-01dbf5f5-e84e-4bb5-a0a0-641f77008262 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:45.196390 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-01dbf5f5-e84e-4bb5-a0a0-641f77008262 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:45.196830 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-01dbf5f5-e84e-4bb5-a0a0-641f77008262 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:45.331765 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-01dbf5f5-e84e-4bb5-a0a0-641f77008262 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:45.339587 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-01dbf5f5-e84e-4bb5-a0a0-641f77008262 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.155881 Dec 15 13:02:45.340303 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1090/2197] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:45 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:46.356897 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6399e112-9c08-46d5-b134-5cb0dd15615c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:46.357729 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6399e112-9c08-46d5-b134-5cb0dd15615c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:46.364038 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6399e112-9c08-46d5-b134-5cb0dd15615c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:46.364469 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6399e112-9c08-46d5-b134-5cb0dd15615c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:46.365255 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6399e112-9c08-46d5-b134-5cb0dd15615c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:46.365725 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6399e112-9c08-46d5-b134-5cb0dd15615c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:46.500205 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6399e112-9c08-46d5-b134-5cb0dd15615c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:46.508296 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6399e112-9c08-46d5-b134-5cb0dd15615c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.155883 Dec 15 13:02:46.508874 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1108/2198] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:46 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:47.525872 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-512b1227-c028-48b0-99e6-fb2e580ec849 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:47.526468 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-512b1227-c028-48b0-99e6-fb2e580ec849 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:47.532851 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-512b1227-c028-48b0-99e6-fb2e580ec849 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:47.533297 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-512b1227-c028-48b0-99e6-fb2e580ec849 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:47.534097 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-512b1227-c028-48b0-99e6-fb2e580ec849 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:47.534535 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-512b1227-c028-48b0-99e6-fb2e580ec849 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:47.671511 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-512b1227-c028-48b0-99e6-fb2e580ec849 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:47.679358 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-512b1227-c028-48b0-99e6-fb2e580ec849 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.157100 Dec 15 13:02:47.684980 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1091/2199] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:47 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:48.696157 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ffc4bfbf-ec62-4cc8-8e1e-406df7607494 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:48.696734 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ffc4bfbf-ec62-4cc8-8e1e-406df7607494 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:48.703673 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ffc4bfbf-ec62-4cc8-8e1e-406df7607494 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:48.704124 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ffc4bfbf-ec62-4cc8-8e1e-406df7607494 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:48.704904 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ffc4bfbf-ec62-4cc8-8e1e-406df7607494 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:48.705340 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ffc4bfbf-ec62-4cc8-8e1e-406df7607494 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:48.776522 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:02:48.778092 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 13:02:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:02:48.844461 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ffc4bfbf-ec62-4cc8-8e1e-406df7607494 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:48.853309 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ffc4bfbf-ec62-4cc8-8e1e-406df7607494 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.161082 Dec 15 13:02:48.853931 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1109/2200] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:48 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:02:49.870990 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a1c380fc-5a83-4f57-914b-7e38b6d6666d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:49.871623 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a1c380fc-5a83-4f57-914b-7e38b6d6666d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:49.878002 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1c380fc-5a83-4f57-914b-7e38b6d6666d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:49.878453 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1c380fc-5a83-4f57-914b-7e38b6d6666d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:49.879232 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1c380fc-5a83-4f57-914b-7e38b6d6666d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:49.879669 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1c380fc-5a83-4f57-914b-7e38b6d6666d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:50.021897 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a1c380fc-5a83-4f57-914b-7e38b6d6666d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:50.030178 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a1c380fc-5a83-4f57-914b-7e38b6d6666d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.162902 Dec 15 13:02:50.030737 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1092/2201] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:49 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:51.047553 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6d0de7c9-9591-430f-8b64-96aa15820206 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:51.048168 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6d0de7c9-9591-430f-8b64-96aa15820206 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:51.054436 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6d0de7c9-9591-430f-8b64-96aa15820206 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:51.054889 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6d0de7c9-9591-430f-8b64-96aa15820206 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:51.055665 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6d0de7c9-9591-430f-8b64-96aa15820206 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:51.056114 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6d0de7c9-9591-430f-8b64-96aa15820206 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:51.188576 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6d0de7c9-9591-430f-8b64-96aa15820206 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:51.200465 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6d0de7c9-9591-430f-8b64-96aa15820206 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.156487 Dec 15 13:02:51.201105 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1110/2202] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:51 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:52.217255 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fe3579cb-a662-4242-bbac-383dd62022b1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:52.217876 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fe3579cb-a662-4242-bbac-383dd62022b1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:52.224343 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fe3579cb-a662-4242-bbac-383dd62022b1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:52.224790 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fe3579cb-a662-4242-bbac-383dd62022b1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:52.225595 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fe3579cb-a662-4242-bbac-383dd62022b1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:52.226039 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fe3579cb-a662-4242-bbac-383dd62022b1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:52.371379 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fe3579cb-a662-4242-bbac-383dd62022b1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:52.379642 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fe3579cb-a662-4242-bbac-383dd62022b1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.166035 Dec 15 13:02:52.380195 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1093/2203] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:52 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:53.131246 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-083dd412-c4ae-4c17-83b8-57d89431b960 tempest-TestVolumeBootPattern-275054490 tempest-TestVolumeBootPattern-275054490-project] Calling method '.version_select at 0x7f3c68ace040>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:53.134721 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: ERROR oslo.messaging._drivers.impl_rabbit [None req-083dd412-c4ae-4c17-83b8-57d89431b960 tempest-TestVolumeBootPattern-275054490 tempest-TestVolumeBootPattern-275054490-project] [b1305b51-3fdc-4020-aa09-42cdfafde9f4] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 15 13:02:53.396064 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bef88260-28bd-4315-b744-0598073e71c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:53.396661 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bef88260-28bd-4315-b744-0598073e71c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:53.403532 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bef88260-28bd-4315-b744-0598073e71c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:53.403981 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bef88260-28bd-4315-b744-0598073e71c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:53.404758 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bef88260-28bd-4315-b744-0598073e71c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:53.405193 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bef88260-28bd-4315-b744-0598073e71c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:53.541289 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bef88260-28bd-4315-b744-0598073e71c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:53.549758 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bef88260-28bd-4315-b744-0598073e71c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.157398 Dec 15 13:02:53.550321 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1094/2204] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:53 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:02:54.154358 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [None req-083dd412-c4ae-4c17-83b8-57d89431b960 tempest-TestVolumeBootPattern-275054490 tempest-TestVolumeBootPattern-275054490-project] [b1305b51-3fdc-4020-aa09-42cdfafde9f4] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 35098. Dec 15 13:02:54.175127 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-083dd412-c4ae-4c17-83b8-57d89431b960 tempest-TestVolumeBootPattern-275054490 tempest-TestVolumeBootPattern-275054490-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-639945576" status: 202 len: 0 microversion: 2.1 time: 1.047505 Dec 15 13:02:54.175697 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1111/2205] 10.222.0.76 () {58 vars in 1259 bytes} [Wed Dec 15 13:02:53 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-639945576 => generated 0 bytes in 1049 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:02:54.566639 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f1fb0767-877a-4046-b2e8-6a19f75d9409 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:54.567220 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f1fb0767-877a-4046-b2e8-6a19f75d9409 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:54.574557 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f1fb0767-877a-4046-b2e8-6a19f75d9409 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:54.574990 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f1fb0767-877a-4046-b2e8-6a19f75d9409 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:54.575804 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f1fb0767-877a-4046-b2e8-6a19f75d9409 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:54.576246 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f1fb0767-877a-4046-b2e8-6a19f75d9409 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:54.711123 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-f1fb0767-877a-4046-b2e8-6a19f75d9409 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:54.720124 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f1fb0767-877a-4046-b2e8-6a19f75d9409 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.157093 Dec 15 13:02:54.720805 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1095/2206] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:54 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:55.736024 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-30fa0a46-8f91-44df-9522-00641da809e8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:55.736582 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-30fa0a46-8f91-44df-9522-00641da809e8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:55.743277 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-30fa0a46-8f91-44df-9522-00641da809e8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:55.743734 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-30fa0a46-8f91-44df-9522-00641da809e8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:55.744523 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-30fa0a46-8f91-44df-9522-00641da809e8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:55.744942 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-30fa0a46-8f91-44df-9522-00641da809e8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:55.882573 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-30fa0a46-8f91-44df-9522-00641da809e8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:55.892495 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-30fa0a46-8f91-44df-9522-00641da809e8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.160143 Dec 15 13:02:55.893083 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1112/2207] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:55 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:56.921657 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-85177e5b-70d6-4df7-b0c1-64be2eebd6ea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:56.922280 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-85177e5b-70d6-4df7-b0c1-64be2eebd6ea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:56.928711 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-85177e5b-70d6-4df7-b0c1-64be2eebd6ea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:56.929158 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-85177e5b-70d6-4df7-b0c1-64be2eebd6ea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:56.929984 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-85177e5b-70d6-4df7-b0c1-64be2eebd6ea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:56.930418 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-85177e5b-70d6-4df7-b0c1-64be2eebd6ea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:57.117313 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-85177e5b-70d6-4df7-b0c1-64be2eebd6ea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:57.126598 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-85177e5b-70d6-4df7-b0c1-64be2eebd6ea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.209081 Dec 15 13:02:57.127283 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1096/2208] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:56 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:58.144019 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a635f3d9-de41-44de-9f01-8d794f47ee98 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:58.145370 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a635f3d9-de41-44de-9f01-8d794f47ee98 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:58.152107 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a635f3d9-de41-44de-9f01-8d794f47ee98 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:58.152656 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a635f3d9-de41-44de-9f01-8d794f47ee98 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:58.153732 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a635f3d9-de41-44de-9f01-8d794f47ee98 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:58.154977 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a635f3d9-de41-44de-9f01-8d794f47ee98 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:58.381168 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:02:58.381763 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 13:02:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:02:58.398319 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a635f3d9-de41-44de-9f01-8d794f47ee98 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:58.407665 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a635f3d9-de41-44de-9f01-8d794f47ee98 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.266948 Dec 15 13:02:58.408392 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1113/2209] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:58 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:02:59.424803 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d151ee98-3f44-4f68-835a-fdd428d72c1f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:02:59.425413 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d151ee98-3f44-4f68-835a-fdd428d72c1f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:02:59.439407 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d151ee98-3f44-4f68-835a-fdd428d72c1f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:59.439851 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d151ee98-3f44-4f68-835a-fdd428d72c1f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:59.440638 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d151ee98-3f44-4f68-835a-fdd428d72c1f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:02:59.441071 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d151ee98-3f44-4f68-835a-fdd428d72c1f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:02:59.666198 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d151ee98-3f44-4f68-835a-fdd428d72c1f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:02:59.674197 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d151ee98-3f44-4f68-835a-fdd428d72c1f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.253123 Dec 15 13:02:59.674772 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1097/2210] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:02:59 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:00.695834 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1ff05d56-d604-4900-aa5e-327d02f2a014 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:00.695834 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1ff05d56-d604-4900-aa5e-327d02f2a014 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:00.707336 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ff05d56-d604-4900-aa5e-327d02f2a014 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:00.707915 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ff05d56-d604-4900-aa5e-327d02f2a014 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:00.708882 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ff05d56-d604-4900-aa5e-327d02f2a014 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:00.709420 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ff05d56-d604-4900-aa5e-327d02f2a014 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:00.863248 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1ff05d56-d604-4900-aa5e-327d02f2a014 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:00.873047 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1ff05d56-d604-4900-aa5e-327d02f2a014 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.184373 Dec 15 13:03:00.874158 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1114/2211] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:00 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:01.892057 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a23ac3f0-e6b0-4787-a2bd-046dd2b22abf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:01.892853 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a23ac3f0-e6b0-4787-a2bd-046dd2b22abf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:01.901012 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a23ac3f0-e6b0-4787-a2bd-046dd2b22abf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:01.901133 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a23ac3f0-e6b0-4787-a2bd-046dd2b22abf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:01.902763 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a23ac3f0-e6b0-4787-a2bd-046dd2b22abf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:01.902908 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a23ac3f0-e6b0-4787-a2bd-046dd2b22abf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:02.040389 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a23ac3f0-e6b0-4787-a2bd-046dd2b22abf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:02.050415 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a23ac3f0-e6b0-4787-a2bd-046dd2b22abf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.162354 Dec 15 13:03:02.051579 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1098/2212] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:01 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:03.068414 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-42caf6ff-12e3-4034-a314-7a8edbc87573 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:03.069020 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-42caf6ff-12e3-4034-a314-7a8edbc87573 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:03.076282 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-42caf6ff-12e3-4034-a314-7a8edbc87573 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:03.076749 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-42caf6ff-12e3-4034-a314-7a8edbc87573 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:03.077558 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-42caf6ff-12e3-4034-a314-7a8edbc87573 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:03.078005 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-42caf6ff-12e3-4034-a314-7a8edbc87573 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:03.219173 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-42caf6ff-12e3-4034-a314-7a8edbc87573 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:03.226979 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-42caf6ff-12e3-4034-a314-7a8edbc87573 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.162678 Dec 15 13:03:03.227578 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1115/2213] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:03 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:04.244267 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c44d60df-9dd1-40a6-b9f8-bdaed4f6825c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:04.244870 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c44d60df-9dd1-40a6-b9f8-bdaed4f6825c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:04.251792 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c44d60df-9dd1-40a6-b9f8-bdaed4f6825c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:04.252231 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c44d60df-9dd1-40a6-b9f8-bdaed4f6825c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:04.253003 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c44d60df-9dd1-40a6-b9f8-bdaed4f6825c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:04.253427 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c44d60df-9dd1-40a6-b9f8-bdaed4f6825c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:04.387143 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c44d60df-9dd1-40a6-b9f8-bdaed4f6825c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:04.395461 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c44d60df-9dd1-40a6-b9f8-bdaed4f6825c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.154786 Dec 15 13:03:04.396054 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1099/2214] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:04 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:05.413268 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-298439ce-c29f-4cd3-8603-c8ef3a68b904 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:05.413938 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-298439ce-c29f-4cd3-8603-c8ef3a68b904 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:05.420896 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-298439ce-c29f-4cd3-8603-c8ef3a68b904 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:05.421346 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-298439ce-c29f-4cd3-8603-c8ef3a68b904 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:05.422152 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-298439ce-c29f-4cd3-8603-c8ef3a68b904 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:05.422588 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-298439ce-c29f-4cd3-8603-c8ef3a68b904 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:05.563444 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-298439ce-c29f-4cd3-8603-c8ef3a68b904 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:05.571133 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-298439ce-c29f-4cd3-8603-c8ef3a68b904 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.161540 Dec 15 13:03:05.571697 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1116/2215] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:05 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:06.588154 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8b0b0c8b-d6b2-4a8d-b649-bd74fadb12bf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:06.588717 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8b0b0c8b-d6b2-4a8d-b649-bd74fadb12bf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:06.595593 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8b0b0c8b-d6b2-4a8d-b649-bd74fadb12bf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:06.596047 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8b0b0c8b-d6b2-4a8d-b649-bd74fadb12bf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:06.596859 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8b0b0c8b-d6b2-4a8d-b649-bd74fadb12bf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:06.597326 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8b0b0c8b-d6b2-4a8d-b649-bd74fadb12bf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:06.739003 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8b0b0c8b-d6b2-4a8d-b649-bd74fadb12bf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:06.747837 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8b0b0c8b-d6b2-4a8d-b649-bd74fadb12bf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.163410 Dec 15 13:03:06.748406 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1100/2216] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:06 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:07.765115 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b6ccebc7-b462-44d3-9b9b-f58e8968abe7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:07.765732 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b6ccebc7-b462-44d3-9b9b-f58e8968abe7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:07.771974 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b6ccebc7-b462-44d3-9b9b-f58e8968abe7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:07.772417 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b6ccebc7-b462-44d3-9b9b-f58e8968abe7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:07.773182 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b6ccebc7-b462-44d3-9b9b-f58e8968abe7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:07.773643 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b6ccebc7-b462-44d3-9b9b-f58e8968abe7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:07.907272 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b6ccebc7-b462-44d3-9b9b-f58e8968abe7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:07.915057 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b6ccebc7-b462-44d3-9b9b-f58e8968abe7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.154771 Dec 15 13:03:07.915618 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1117/2217] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:07 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:08.932031 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3a0c2fe8-d520-4a6a-874a-c9fb14c5c3ac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:08.932694 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3a0c2fe8-d520-4a6a-874a-c9fb14c5c3ac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:08.939057 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3a0c2fe8-d520-4a6a-874a-c9fb14c5c3ac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:08.939505 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3a0c2fe8-d520-4a6a-874a-c9fb14c5c3ac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:08.940283 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3a0c2fe8-d520-4a6a-874a-c9fb14c5c3ac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:08.940713 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3a0c2fe8-d520-4a6a-874a-c9fb14c5c3ac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:09.076914 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3a0c2fe8-d520-4a6a-874a-c9fb14c5c3ac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:09.087762 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3a0c2fe8-d520-4a6a-874a-c9fb14c5c3ac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.157409 Dec 15 13:03:09.099031 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1101/2218] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:08 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:10.106010 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2ebd5045-dfea-4b05-95a3-778b22bb6acb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:10.106605 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2ebd5045-dfea-4b05-95a3-778b22bb6acb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:10.113450 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2ebd5045-dfea-4b05-95a3-778b22bb6acb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:10.113926 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2ebd5045-dfea-4b05-95a3-778b22bb6acb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:10.114698 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2ebd5045-dfea-4b05-95a3-778b22bb6acb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:10.115124 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2ebd5045-dfea-4b05-95a3-778b22bb6acb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:10.273012 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2ebd5045-dfea-4b05-95a3-778b22bb6acb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:10.281425 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2ebd5045-dfea-4b05-95a3-778b22bb6acb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.179083 Dec 15 13:03:10.282041 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1118/2219] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:10 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:11.298817 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1e38a27f-7159-447f-b361-be796dd12ffc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:11.299429 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1e38a27f-7159-447f-b361-be796dd12ffc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:11.305807 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1e38a27f-7159-447f-b361-be796dd12ffc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:11.306250 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1e38a27f-7159-447f-b361-be796dd12ffc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:11.307016 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1e38a27f-7159-447f-b361-be796dd12ffc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:11.307444 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1e38a27f-7159-447f-b361-be796dd12ffc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:11.438694 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1e38a27f-7159-447f-b361-be796dd12ffc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:11.446767 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1e38a27f-7159-447f-b361-be796dd12ffc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.151824 Dec 15 13:03:11.447335 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1102/2220] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:11 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:12.464743 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-24b72f08-3822-4340-b3a2-1bb6d7b61279 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:12.465490 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-24b72f08-3822-4340-b3a2-1bb6d7b61279 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:12.471974 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-24b72f08-3822-4340-b3a2-1bb6d7b61279 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:12.472420 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-24b72f08-3822-4340-b3a2-1bb6d7b61279 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:12.473212 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-24b72f08-3822-4340-b3a2-1bb6d7b61279 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:12.473675 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-24b72f08-3822-4340-b3a2-1bb6d7b61279 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:12.615933 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-24b72f08-3822-4340-b3a2-1bb6d7b61279 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:12.625155 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-24b72f08-3822-4340-b3a2-1bb6d7b61279 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.164515 Dec 15 13:03:12.625778 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1119/2221] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:12 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:13.642335 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4cf1b71a-7a25-4dba-9e9e-791d4bb4355d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:13.643079 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4cf1b71a-7a25-4dba-9e9e-791d4bb4355d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:13.649395 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4cf1b71a-7a25-4dba-9e9e-791d4bb4355d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:13.649869 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4cf1b71a-7a25-4dba-9e9e-791d4bb4355d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:13.650647 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4cf1b71a-7a25-4dba-9e9e-791d4bb4355d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:13.651076 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4cf1b71a-7a25-4dba-9e9e-791d4bb4355d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:13.789566 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4cf1b71a-7a25-4dba-9e9e-791d4bb4355d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:13.797931 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4cf1b71a-7a25-4dba-9e9e-791d4bb4355d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.159259 Dec 15 13:03:13.798488 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1103/2222] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:13 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:14.815452 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-46eb5aa2-50c6-4930-941f-f5b4e7598312 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:14.816375 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-46eb5aa2-50c6-4930-941f-f5b4e7598312 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:14.824174 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-46eb5aa2-50c6-4930-941f-f5b4e7598312 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:14.824632 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-46eb5aa2-50c6-4930-941f-f5b4e7598312 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:14.825421 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-46eb5aa2-50c6-4930-941f-f5b4e7598312 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:14.825898 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-46eb5aa2-50c6-4930-941f-f5b4e7598312 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:14.961160 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-46eb5aa2-50c6-4930-941f-f5b4e7598312 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:14.976010 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-46eb5aa2-50c6-4930-941f-f5b4e7598312 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.164648 Dec 15 13:03:14.976602 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1120/2223] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:14 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:15.993661 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c735c5c4-fd8f-4309-ac9d-f8ece54402b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:15.994205 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c735c5c4-fd8f-4309-ac9d-f8ece54402b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:16.001020 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c735c5c4-fd8f-4309-ac9d-f8ece54402b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:16.001469 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c735c5c4-fd8f-4309-ac9d-f8ece54402b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:16.002307 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c735c5c4-fd8f-4309-ac9d-f8ece54402b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:16.002743 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c735c5c4-fd8f-4309-ac9d-f8ece54402b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:16.144830 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c735c5c4-fd8f-4309-ac9d-f8ece54402b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:16.152902 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c735c5c4-fd8f-4309-ac9d-f8ece54402b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.162961 Dec 15 13:03:16.153448 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1104/2224] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:15 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:17.169876 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-256a1b64-ac7b-472d-84cf-f9276a702e1e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:17.170727 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-256a1b64-ac7b-472d-84cf-f9276a702e1e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:17.177421 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-256a1b64-ac7b-472d-84cf-f9276a702e1e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:17.177914 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-256a1b64-ac7b-472d-84cf-f9276a702e1e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:17.178682 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-256a1b64-ac7b-472d-84cf-f9276a702e1e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:17.179105 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-256a1b64-ac7b-472d-84cf-f9276a702e1e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:17.309182 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-256a1b64-ac7b-472d-84cf-f9276a702e1e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:17.317644 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-256a1b64-ac7b-472d-84cf-f9276a702e1e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.151377 Dec 15 13:03:17.318250 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1121/2225] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:17 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:18.335402 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e34bd5a1-c7d2-44af-92a7-aa86b9bb7fad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:18.336001 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e34bd5a1-c7d2-44af-92a7-aa86b9bb7fad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:18.342890 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e34bd5a1-c7d2-44af-92a7-aa86b9bb7fad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:18.343335 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e34bd5a1-c7d2-44af-92a7-aa86b9bb7fad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:18.344098 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e34bd5a1-c7d2-44af-92a7-aa86b9bb7fad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:18.344525 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e34bd5a1-c7d2-44af-92a7-aa86b9bb7fad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:18.480214 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e34bd5a1-c7d2-44af-92a7-aa86b9bb7fad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:18.488003 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e34bd5a1-c7d2-44af-92a7-aa86b9bb7fad tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.156305 Dec 15 13:03:18.488604 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1105/2226] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:18 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:19.505085 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ac13feb5-2e30-44a6-8001-a83be7caef65 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:19.505905 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ac13feb5-2e30-44a6-8001-a83be7caef65 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:19.513042 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ac13feb5-2e30-44a6-8001-a83be7caef65 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:19.513524 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ac13feb5-2e30-44a6-8001-a83be7caef65 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:19.514335 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ac13feb5-2e30-44a6-8001-a83be7caef65 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:19.514771 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ac13feb5-2e30-44a6-8001-a83be7caef65 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:19.648600 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ac13feb5-2e30-44a6-8001-a83be7caef65 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:19.656739 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ac13feb5-2e30-44a6-8001-a83be7caef65 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.155426 Dec 15 13:03:19.657314 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1122/2227] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:19 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:20.674478 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a11e5b7c-9172-4398-b40c-5041b7ca381e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:20.675210 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a11e5b7c-9172-4398-b40c-5041b7ca381e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:20.680989 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a11e5b7c-9172-4398-b40c-5041b7ca381e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:20.681437 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a11e5b7c-9172-4398-b40c-5041b7ca381e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:20.682239 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a11e5b7c-9172-4398-b40c-5041b7ca381e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:20.682674 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a11e5b7c-9172-4398-b40c-5041b7ca381e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:20.828741 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a11e5b7c-9172-4398-b40c-5041b7ca381e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:20.836435 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a11e5b7c-9172-4398-b40c-5041b7ca381e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.166068 Dec 15 13:03:20.836996 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1106/2228] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:20 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:21.853030 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-041e2143-cb71-48c0-a5c4-178de974e70c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:21.853662 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-041e2143-cb71-48c0-a5c4-178de974e70c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:21.860955 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-041e2143-cb71-48c0-a5c4-178de974e70c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:21.861395 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-041e2143-cb71-48c0-a5c4-178de974e70c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:21.862361 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-041e2143-cb71-48c0-a5c4-178de974e70c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:21.862654 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-041e2143-cb71-48c0-a5c4-178de974e70c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:21.994946 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-041e2143-cb71-48c0-a5c4-178de974e70c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:22.002604 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-041e2143-cb71-48c0-a5c4-178de974e70c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.153156 Dec 15 13:03:22.003173 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1123/2229] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:21 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:23.020142 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e58debe1-12f9-4d0b-8ed4-8cbd4d931eea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:23.020708 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e58debe1-12f9-4d0b-8ed4-8cbd4d931eea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:23.027439 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e58debe1-12f9-4d0b-8ed4-8cbd4d931eea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:23.027887 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e58debe1-12f9-4d0b-8ed4-8cbd4d931eea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:23.028662 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e58debe1-12f9-4d0b-8ed4-8cbd4d931eea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:23.029098 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e58debe1-12f9-4d0b-8ed4-8cbd4d931eea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:23.170285 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e58debe1-12f9-4d0b-8ed4-8cbd4d931eea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:23.178062 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e58debe1-12f9-4d0b-8ed4-8cbd4d931eea tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.161757 Dec 15 13:03:23.178658 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1107/2230] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:23 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:24.195526 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3dd05a64-52d4-456b-bf70-1be52dc7b294 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:24.196188 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3dd05a64-52d4-456b-bf70-1be52dc7b294 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:24.203852 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3dd05a64-52d4-456b-bf70-1be52dc7b294 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:24.204295 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3dd05a64-52d4-456b-bf70-1be52dc7b294 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:24.205079 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3dd05a64-52d4-456b-bf70-1be52dc7b294 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:24.205529 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3dd05a64-52d4-456b-bf70-1be52dc7b294 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:24.343532 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3dd05a64-52d4-456b-bf70-1be52dc7b294 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:24.351448 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3dd05a64-52d4-456b-bf70-1be52dc7b294 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.159631 Dec 15 13:03:24.352053 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1124/2231] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:24 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:25.368520 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5726f714-da5f-44c7-a9a3-be52f2b87b45 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:25.369132 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5726f714-da5f-44c7-a9a3-be52f2b87b45 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:25.375614 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5726f714-da5f-44c7-a9a3-be52f2b87b45 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:25.376065 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5726f714-da5f-44c7-a9a3-be52f2b87b45 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:25.376842 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5726f714-da5f-44c7-a9a3-be52f2b87b45 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:25.377280 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5726f714-da5f-44c7-a9a3-be52f2b87b45 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:25.510329 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5726f714-da5f-44c7-a9a3-be52f2b87b45 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:25.519677 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5726f714-da5f-44c7-a9a3-be52f2b87b45 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.154856 Dec 15 13:03:25.520328 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1108/2232] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:25 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:26.537834 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-029cf86c-a534-4c8c-b25b-d22068fc1a6c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:26.538433 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-029cf86c-a534-4c8c-b25b-d22068fc1a6c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:26.545552 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-029cf86c-a534-4c8c-b25b-d22068fc1a6c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:26.546006 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-029cf86c-a534-4c8c-b25b-d22068fc1a6c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:26.546784 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-029cf86c-a534-4c8c-b25b-d22068fc1a6c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:26.547218 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-029cf86c-a534-4c8c-b25b-d22068fc1a6c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:26.689302 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-029cf86c-a534-4c8c-b25b-d22068fc1a6c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:26.697355 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-029cf86c-a534-4c8c-b25b-d22068fc1a6c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.163082 Dec 15 13:03:26.697951 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1125/2233] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:26 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:27.713753 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-43457aa0-989b-40d8-8045-d631d9b24b8a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:27.714392 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-43457aa0-989b-40d8-8045-d631d9b24b8a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:27.720095 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-43457aa0-989b-40d8-8045-d631d9b24b8a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:27.720540 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-43457aa0-989b-40d8-8045-d631d9b24b8a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:27.721312 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-43457aa0-989b-40d8-8045-d631d9b24b8a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:27.721746 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-43457aa0-989b-40d8-8045-d631d9b24b8a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:27.859194 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-43457aa0-989b-40d8-8045-d631d9b24b8a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:27.867003 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-43457aa0-989b-40d8-8045-d631d9b24b8a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.156987 Dec 15 13:03:27.867570 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1109/2234] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:27 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:28.884671 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-dab70d15-a013-4a56-84d2-2585a1c159f9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:28.885632 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-dab70d15-a013-4a56-84d2-2585a1c159f9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:28.896396 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dab70d15-a013-4a56-84d2-2585a1c159f9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:28.896850 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dab70d15-a013-4a56-84d2-2585a1c159f9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:28.897678 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dab70d15-a013-4a56-84d2-2585a1c159f9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:28.898123 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dab70d15-a013-4a56-84d2-2585a1c159f9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:29.035627 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-dab70d15-a013-4a56-84d2-2585a1c159f9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:29.044015 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-dab70d15-a013-4a56-84d2-2585a1c159f9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.163607 Dec 15 13:03:29.044587 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1126/2235] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:28 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:30.061472 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7e732c48-0b29-4fac-9b84-8865ad153877 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:30.062238 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7e732c48-0b29-4fac-9b84-8865ad153877 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:30.068638 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7e732c48-0b29-4fac-9b84-8865ad153877 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:30.069088 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7e732c48-0b29-4fac-9b84-8865ad153877 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:30.069903 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7e732c48-0b29-4fac-9b84-8865ad153877 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:30.070340 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7e732c48-0b29-4fac-9b84-8865ad153877 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:30.219860 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7e732c48-0b29-4fac-9b84-8865ad153877 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:30.227625 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7e732c48-0b29-4fac-9b84-8865ad153877 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.169886 Dec 15 13:03:30.228186 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1110/2236] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:30 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:31.244594 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-19d7f88f-e1f5-41b4-a2a1-f3db4da9aa8c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:31.245197 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-19d7f88f-e1f5-41b4-a2a1-f3db4da9aa8c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:31.252017 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-19d7f88f-e1f5-41b4-a2a1-f3db4da9aa8c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:31.252469 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-19d7f88f-e1f5-41b4-a2a1-f3db4da9aa8c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:31.253266 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-19d7f88f-e1f5-41b4-a2a1-f3db4da9aa8c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:31.253736 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-19d7f88f-e1f5-41b4-a2a1-f3db4da9aa8c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:31.394343 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-19d7f88f-e1f5-41b4-a2a1-f3db4da9aa8c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:31.403122 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-19d7f88f-e1f5-41b4-a2a1-f3db4da9aa8c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.162292 Dec 15 13:03:31.403703 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1127/2237] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:31 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:32.420383 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3419be8a-4fc3-4797-b547-bfdeee495eb9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:32.420971 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3419be8a-4fc3-4797-b547-bfdeee495eb9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:32.427185 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3419be8a-4fc3-4797-b547-bfdeee495eb9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:32.427653 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3419be8a-4fc3-4797-b547-bfdeee495eb9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:32.428454 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3419be8a-4fc3-4797-b547-bfdeee495eb9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:32.428844 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3419be8a-4fc3-4797-b547-bfdeee495eb9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:32.574906 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3419be8a-4fc3-4797-b547-bfdeee495eb9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:32.582956 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3419be8a-4fc3-4797-b547-bfdeee495eb9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.166642 Dec 15 13:03:32.583519 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1111/2238] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:32 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:33.599995 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0f6ccbf8-1e23-46de-b109-5522c9518294 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:33.600639 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0f6ccbf8-1e23-46de-b109-5522c9518294 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:33.607305 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0f6ccbf8-1e23-46de-b109-5522c9518294 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:33.607762 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0f6ccbf8-1e23-46de-b109-5522c9518294 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:33.608542 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0f6ccbf8-1e23-46de-b109-5522c9518294 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:33.608979 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0f6ccbf8-1e23-46de-b109-5522c9518294 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:33.741390 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0f6ccbf8-1e23-46de-b109-5522c9518294 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:33.750565 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0f6ccbf8-1e23-46de-b109-5522c9518294 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.154143 Dec 15 13:03:33.751156 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1128/2239] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:33 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:34.768231 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f107eb44-0eb3-4ebb-ad4a-05f98df384e9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:34.768856 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f107eb44-0eb3-4ebb-ad4a-05f98df384e9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:34.775163 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f107eb44-0eb3-4ebb-ad4a-05f98df384e9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:34.775610 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f107eb44-0eb3-4ebb-ad4a-05f98df384e9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:34.776380 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f107eb44-0eb3-4ebb-ad4a-05f98df384e9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:34.776813 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f107eb44-0eb3-4ebb-ad4a-05f98df384e9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:34.920220 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-f107eb44-0eb3-4ebb-ad4a-05f98df384e9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:34.927855 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f107eb44-0eb3-4ebb-ad4a-05f98df384e9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.163392 Dec 15 13:03:34.928409 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1112/2240] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:34 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:03:35.945283 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-04360d9b-4739-4e28-b9e9-f925c13ba9b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:35.945949 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-04360d9b-4739-4e28-b9e9-f925c13ba9b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:35.953093 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-04360d9b-4739-4e28-b9e9-f925c13ba9b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:35.953568 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-04360d9b-4739-4e28-b9e9-f925c13ba9b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:35.954347 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-04360d9b-4739-4e28-b9e9-f925c13ba9b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:35.954784 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-04360d9b-4739-4e28-b9e9-f925c13ba9b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:36.093322 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-04360d9b-4739-4e28-b9e9-f925c13ba9b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:36.101273 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-04360d9b-4739-4e28-b9e9-f925c13ba9b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.159663 Dec 15 13:03:36.101874 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1129/2241] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:35 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:37.118470 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8c05bb85-e286-47ca-9efc-fdff4dc213f1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:37.119032 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8c05bb85-e286-47ca-9efc-fdff4dc213f1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:37.125266 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c05bb85-e286-47ca-9efc-fdff4dc213f1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:37.125749 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c05bb85-e286-47ca-9efc-fdff4dc213f1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:37.126528 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c05bb85-e286-47ca-9efc-fdff4dc213f1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:37.127182 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8c05bb85-e286-47ca-9efc-fdff4dc213f1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:37.265755 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8c05bb85-e286-47ca-9efc-fdff4dc213f1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:37.273560 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8c05bb85-e286-47ca-9efc-fdff4dc213f1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.158821 Dec 15 13:03:37.274133 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1113/2242] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:37 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:38.290037 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1c5b22f2-b974-4ed8-a16a-451c7424b73c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:38.290650 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1c5b22f2-b974-4ed8-a16a-451c7424b73c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:38.297305 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1c5b22f2-b974-4ed8-a16a-451c7424b73c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:38.297793 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1c5b22f2-b974-4ed8-a16a-451c7424b73c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:38.298747 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1c5b22f2-b974-4ed8-a16a-451c7424b73c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:38.299051 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1c5b22f2-b974-4ed8-a16a-451c7424b73c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:38.430328 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1c5b22f2-b974-4ed8-a16a-451c7424b73c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:38.446120 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1c5b22f2-b974-4ed8-a16a-451c7424b73c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.159525 Dec 15 13:03:38.446905 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1130/2243] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:38 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:39.463876 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-16a84620-ab8b-4b9c-b6cc-9ae6d4ca3000 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:39.465165 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-16a84620-ab8b-4b9c-b6cc-9ae6d4ca3000 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:39.471757 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-16a84620-ab8b-4b9c-b6cc-9ae6d4ca3000 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:39.472212 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-16a84620-ab8b-4b9c-b6cc-9ae6d4ca3000 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:39.473128 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-16a84620-ab8b-4b9c-b6cc-9ae6d4ca3000 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:39.473594 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-16a84620-ab8b-4b9c-b6cc-9ae6d4ca3000 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:39.605097 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-16a84620-ab8b-4b9c-b6cc-9ae6d4ca3000 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:39.613247 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-16a84620-ab8b-4b9c-b6cc-9ae6d4ca3000 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.152969 Dec 15 13:03:39.613849 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1114/2244] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:39 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:40.631737 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-25ea0274-f4d7-4df3-8bf2-161c74bf14d7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:40.632335 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-25ea0274-f4d7-4df3-8bf2-161c74bf14d7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:40.639785 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-25ea0274-f4d7-4df3-8bf2-161c74bf14d7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:40.640235 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-25ea0274-f4d7-4df3-8bf2-161c74bf14d7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:40.641016 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-25ea0274-f4d7-4df3-8bf2-161c74bf14d7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:40.641454 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-25ea0274-f4d7-4df3-8bf2-161c74bf14d7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:40.779395 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-25ea0274-f4d7-4df3-8bf2-161c74bf14d7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:40.787537 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-25ea0274-f4d7-4df3-8bf2-161c74bf14d7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.159981 Dec 15 13:03:40.788123 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1131/2245] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:40 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:41.804107 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8572c0de-f68f-4a33-9c17-32cff288859e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:41.804716 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8572c0de-f68f-4a33-9c17-32cff288859e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:41.810976 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8572c0de-f68f-4a33-9c17-32cff288859e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:41.811418 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8572c0de-f68f-4a33-9c17-32cff288859e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:41.812191 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8572c0de-f68f-4a33-9c17-32cff288859e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:41.812626 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8572c0de-f68f-4a33-9c17-32cff288859e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:41.954943 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8572c0de-f68f-4a33-9c17-32cff288859e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:41.963231 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8572c0de-f68f-4a33-9c17-32cff288859e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.162684 Dec 15 13:03:41.963720 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1115/2246] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:41 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:42.983059 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ecd823e4-e7b6-48af-97ca-2acec39a846d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:42.983707 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ecd823e4-e7b6-48af-97ca-2acec39a846d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:42.990055 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ecd823e4-e7b6-48af-97ca-2acec39a846d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:42.990503 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ecd823e4-e7b6-48af-97ca-2acec39a846d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:42.991271 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ecd823e4-e7b6-48af-97ca-2acec39a846d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:42.991702 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ecd823e4-e7b6-48af-97ca-2acec39a846d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:43.127559 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ecd823e4-e7b6-48af-97ca-2acec39a846d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:43.135488 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ecd823e4-e7b6-48af-97ca-2acec39a846d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.158247 Dec 15 13:03:43.136339 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1132/2247] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:42 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:44.151753 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a9ad3c65-3d29-4ae6-ae5a-25614ac05fa5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:44.152476 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a9ad3c65-3d29-4ae6-ae5a-25614ac05fa5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:44.158934 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a9ad3c65-3d29-4ae6-ae5a-25614ac05fa5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:44.159403 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a9ad3c65-3d29-4ae6-ae5a-25614ac05fa5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:44.160240 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a9ad3c65-3d29-4ae6-ae5a-25614ac05fa5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:44.160674 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a9ad3c65-3d29-4ae6-ae5a-25614ac05fa5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:44.297361 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a9ad3c65-3d29-4ae6-ae5a-25614ac05fa5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:44.305734 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a9ad3c65-3d29-4ae6-ae5a-25614ac05fa5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.157510 Dec 15 13:03:44.306305 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1116/2248] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:44 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:45.323350 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d5adc836-e535-4822-9898-78ec72034ffa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:45.323988 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d5adc836-e535-4822-9898-78ec72034ffa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:45.330595 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d5adc836-e535-4822-9898-78ec72034ffa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:45.331150 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d5adc836-e535-4822-9898-78ec72034ffa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:45.331927 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d5adc836-e535-4822-9898-78ec72034ffa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:45.332353 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d5adc836-e535-4822-9898-78ec72034ffa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:45.461815 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d5adc836-e535-4822-9898-78ec72034ffa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:45.470957 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d5adc836-e535-4822-9898-78ec72034ffa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.151218 Dec 15 13:03:45.471547 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1133/2249] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:45 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:46.488393 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b8c81f7a-1c1e-48ad-90f2-554f2c262394 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:46.488965 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b8c81f7a-1c1e-48ad-90f2-554f2c262394 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:46.495435 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b8c81f7a-1c1e-48ad-90f2-554f2c262394 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:46.495876 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b8c81f7a-1c1e-48ad-90f2-554f2c262394 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:46.497359 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b8c81f7a-1c1e-48ad-90f2-554f2c262394 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:46.497825 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b8c81f7a-1c1e-48ad-90f2-554f2c262394 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:46.640887 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b8c81f7a-1c1e-48ad-90f2-554f2c262394 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:46.648674 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b8c81f7a-1c1e-48ad-90f2-554f2c262394 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.164051 Dec 15 13:03:46.649239 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1117/2250] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:46 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:03:47.666051 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-344190a2-acaa-4635-98cf-ccbd70656345 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:47.666703 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-344190a2-acaa-4635-98cf-ccbd70656345 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:47.673668 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-344190a2-acaa-4635-98cf-ccbd70656345 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:47.674124 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-344190a2-acaa-4635-98cf-ccbd70656345 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:47.674903 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-344190a2-acaa-4635-98cf-ccbd70656345 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:47.675339 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-344190a2-acaa-4635-98cf-ccbd70656345 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:47.810962 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-344190a2-acaa-4635-98cf-ccbd70656345 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:47.818901 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-344190a2-acaa-4635-98cf-ccbd70656345 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.156559 Dec 15 13:03:47.819467 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1134/2251] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:47 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:48.836412 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-04057754-7dc5-4798-9773-3d62b63dc3e0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:48.837033 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-04057754-7dc5-4798-9773-3d62b63dc3e0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:48.844125 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-04057754-7dc5-4798-9773-3d62b63dc3e0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:48.844562 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-04057754-7dc5-4798-9773-3d62b63dc3e0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:48.845345 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-04057754-7dc5-4798-9773-3d62b63dc3e0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:48.845803 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-04057754-7dc5-4798-9773-3d62b63dc3e0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:48.981986 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-04057754-7dc5-4798-9773-3d62b63dc3e0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:48.989783 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-04057754-7dc5-4798-9773-3d62b63dc3e0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.156914 Dec 15 13:03:48.990358 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1118/2252] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:48 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:50.006898 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-cafda94e-fa8b-4cc3-aa53-7a76ca6bfdc4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:50.007515 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-cafda94e-fa8b-4cc3-aa53-7a76ca6bfdc4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:50.014786 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cafda94e-fa8b-4cc3-aa53-7a76ca6bfdc4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:50.015238 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cafda94e-fa8b-4cc3-aa53-7a76ca6bfdc4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:50.016015 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cafda94e-fa8b-4cc3-aa53-7a76ca6bfdc4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:50.016459 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cafda94e-fa8b-4cc3-aa53-7a76ca6bfdc4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:50.149127 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-cafda94e-fa8b-4cc3-aa53-7a76ca6bfdc4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:50.157719 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-cafda94e-fa8b-4cc3-aa53-7a76ca6bfdc4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.154389 Dec 15 13:03:50.158290 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1135/2253] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:50 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:03:51.175039 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e0a2460c-469d-4825-8ad1-0a260b2e8779 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:51.175652 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e0a2460c-469d-4825-8ad1-0a260b2e8779 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:51.183436 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0a2460c-469d-4825-8ad1-0a260b2e8779 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:51.183985 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0a2460c-469d-4825-8ad1-0a260b2e8779 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:51.184876 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0a2460c-469d-4825-8ad1-0a260b2e8779 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:51.185314 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0a2460c-469d-4825-8ad1-0a260b2e8779 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:51.327981 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e0a2460c-469d-4825-8ad1-0a260b2e8779 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:51.336193 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e0a2460c-469d-4825-8ad1-0a260b2e8779 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.164874 Dec 15 13:03:51.337016 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1119/2254] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:51 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:52.354094 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b5292f23-f4ba-418c-bc80-ac14e48b3c84 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:52.354637 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b5292f23-f4ba-418c-bc80-ac14e48b3c84 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:52.360702 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5292f23-f4ba-418c-bc80-ac14e48b3c84 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:52.361149 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5292f23-f4ba-418c-bc80-ac14e48b3c84 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:52.361950 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5292f23-f4ba-418c-bc80-ac14e48b3c84 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:52.362384 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5292f23-f4ba-418c-bc80-ac14e48b3c84 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:52.505590 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b5292f23-f4ba-418c-bc80-ac14e48b3c84 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:52.513753 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b5292f23-f4ba-418c-bc80-ac14e48b3c84 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.163408 Dec 15 13:03:52.514311 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1136/2255] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:52 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:53.530715 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-96e1d81a-dbbe-482b-b4a5-836e699cf75a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:53.531981 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-96e1d81a-dbbe-482b-b4a5-836e699cf75a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:53.538574 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-96e1d81a-dbbe-482b-b4a5-836e699cf75a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:53.539030 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-96e1d81a-dbbe-482b-b4a5-836e699cf75a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:53.540039 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-96e1d81a-dbbe-482b-b4a5-836e699cf75a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:53.540328 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-96e1d81a-dbbe-482b-b4a5-836e699cf75a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:53.675467 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-96e1d81a-dbbe-482b-b4a5-836e699cf75a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:53.685844 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-96e1d81a-dbbe-482b-b4a5-836e699cf75a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.158901 Dec 15 13:03:53.686444 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1120/2256] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:53 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:54.703488 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-82a961a9-7091-4738-ac1d-3be1341817d9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:54.704099 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-82a961a9-7091-4738-ac1d-3be1341817d9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:54.710443 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-82a961a9-7091-4738-ac1d-3be1341817d9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:54.710898 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-82a961a9-7091-4738-ac1d-3be1341817d9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:54.711675 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-82a961a9-7091-4738-ac1d-3be1341817d9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:54.712115 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-82a961a9-7091-4738-ac1d-3be1341817d9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:54.856216 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-82a961a9-7091-4738-ac1d-3be1341817d9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:54.864715 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-82a961a9-7091-4738-ac1d-3be1341817d9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.165562 Dec 15 13:03:54.865282 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1137/2257] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:54 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:55.881870 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4adc345b-a334-4b1f-9193-4eb4c481019b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:55.882483 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4adc345b-a334-4b1f-9193-4eb4c481019b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:55.889782 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4adc345b-a334-4b1f-9193-4eb4c481019b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:55.890235 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4adc345b-a334-4b1f-9193-4eb4c481019b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:55.891006 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4adc345b-a334-4b1f-9193-4eb4c481019b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:55.891439 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4adc345b-a334-4b1f-9193-4eb4c481019b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:56.031310 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4adc345b-a334-4b1f-9193-4eb4c481019b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:56.035750 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4adc345b-a334-4b1f-9193-4eb4c481019b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.157423 Dec 15 13:03:56.036340 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1121/2258] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:55 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:57.053464 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b8f7b122-e279-44d0-81b6-cfde8c1943ab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:57.054051 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b8f7b122-e279-44d0-81b6-cfde8c1943ab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:57.060420 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b8f7b122-e279-44d0-81b6-cfde8c1943ab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:57.060894 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b8f7b122-e279-44d0-81b6-cfde8c1943ab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:57.061731 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b8f7b122-e279-44d0-81b6-cfde8c1943ab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:57.062173 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b8f7b122-e279-44d0-81b6-cfde8c1943ab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:57.206825 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b8f7b122-e279-44d0-81b6-cfde8c1943ab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:57.214565 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b8f7b122-e279-44d0-81b6-cfde8c1943ab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.164831 Dec 15 13:03:57.215128 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1138/2259] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:57 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:58.231821 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-69b910f0-a21d-46d7-9a12-9da6e8e20263 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:58.233003 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-69b910f0-a21d-46d7-9a12-9da6e8e20263 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:58.239490 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-69b910f0-a21d-46d7-9a12-9da6e8e20263 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:58.239976 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-69b910f0-a21d-46d7-9a12-9da6e8e20263 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:58.240770 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-69b910f0-a21d-46d7-9a12-9da6e8e20263 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:58.241205 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-69b910f0-a21d-46d7-9a12-9da6e8e20263 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:58.386976 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-69b910f0-a21d-46d7-9a12-9da6e8e20263 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:58.395861 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-69b910f0-a21d-46d7-9a12-9da6e8e20263 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.166651 Dec 15 13:03:58.396293 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1122/2260] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:58 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:03:59.411678 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-447a5e4a-e38c-4756-9321-dbc3b25ec694 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:03:59.412266 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-447a5e4a-e38c-4756-9321-dbc3b25ec694 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:03:59.418862 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-447a5e4a-e38c-4756-9321-dbc3b25ec694 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:59.419313 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-447a5e4a-e38c-4756-9321-dbc3b25ec694 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:59.420389 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-447a5e4a-e38c-4756-9321-dbc3b25ec694 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:03:59.420839 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-447a5e4a-e38c-4756-9321-dbc3b25ec694 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:03:59.557495 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-447a5e4a-e38c-4756-9321-dbc3b25ec694 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:03:59.565918 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-447a5e4a-e38c-4756-9321-dbc3b25ec694 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.157814 Dec 15 13:03:59.566726 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1139/2261] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:03:59 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:00.583963 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4de8155a-8f58-4b2f-8c37-c099442c2ae2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:00.584574 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4de8155a-8f58-4b2f-8c37-c099442c2ae2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:00.590826 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4de8155a-8f58-4b2f-8c37-c099442c2ae2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:00.591271 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4de8155a-8f58-4b2f-8c37-c099442c2ae2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:00.592752 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4de8155a-8f58-4b2f-8c37-c099442c2ae2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:00.593184 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4de8155a-8f58-4b2f-8c37-c099442c2ae2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:00.734349 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4de8155a-8f58-4b2f-8c37-c099442c2ae2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:00.742123 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4de8155a-8f58-4b2f-8c37-c099442c2ae2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.161802 Dec 15 13:04:00.742691 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1123/2262] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:00 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:04:01.759409 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7f931883-4bf3-43a4-b4f1-9d6ac9017c79 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:01.760397 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7f931883-4bf3-43a4-b4f1-9d6ac9017c79 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:01.771394 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7f931883-4bf3-43a4-b4f1-9d6ac9017c79 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:01.771906 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7f931883-4bf3-43a4-b4f1-9d6ac9017c79 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:01.772988 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7f931883-4bf3-43a4-b4f1-9d6ac9017c79 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:01.773533 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7f931883-4bf3-43a4-b4f1-9d6ac9017c79 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:01.906672 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7f931883-4bf3-43a4-b4f1-9d6ac9017c79 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:01.914446 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7f931883-4bf3-43a4-b4f1-9d6ac9017c79 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.158667 Dec 15 13:04:01.915029 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1140/2263] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:01 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:02.931992 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6d52b3c4-fa8b-458e-bfc7-060954113b7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:02.932589 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6d52b3c4-fa8b-458e-bfc7-060954113b7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:02.940303 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d52b3c4-fa8b-458e-bfc7-060954113b7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:02.940303 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d52b3c4-fa8b-458e-bfc7-060954113b7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:02.940782 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d52b3c4-fa8b-458e-bfc7-060954113b7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:02.941244 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d52b3c4-fa8b-458e-bfc7-060954113b7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:03.081060 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6d52b3c4-fa8b-458e-bfc7-060954113b7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:03.088800 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6d52b3c4-fa8b-458e-bfc7-060954113b7c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.160362 Dec 15 13:04:03.089371 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1124/2264] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:02 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:04.107762 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-01ee2c54-cbdf-43c2-a1cc-cac2faed70bc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:04.108605 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-01ee2c54-cbdf-43c2-a1cc-cac2faed70bc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:04.116590 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-01ee2c54-cbdf-43c2-a1cc-cac2faed70bc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:04.117165 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-01ee2c54-cbdf-43c2-a1cc-cac2faed70bc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:04.117995 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-01ee2c54-cbdf-43c2-a1cc-cac2faed70bc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:04.118433 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-01ee2c54-cbdf-43c2-a1cc-cac2faed70bc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:04.249116 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-01ee2c54-cbdf-43c2-a1cc-cac2faed70bc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:04.257027 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-01ee2c54-cbdf-43c2-a1cc-cac2faed70bc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.154770 Dec 15 13:04:04.257602 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1141/2265] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:04 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:05.274935 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2386a212-4674-463f-ae24-fc4672da1905 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:05.275555 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2386a212-4674-463f-ae24-fc4672da1905 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:05.282451 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2386a212-4674-463f-ae24-fc4672da1905 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:05.282894 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2386a212-4674-463f-ae24-fc4672da1905 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:05.283665 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2386a212-4674-463f-ae24-fc4672da1905 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:05.284091 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2386a212-4674-463f-ae24-fc4672da1905 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:05.416710 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2386a212-4674-463f-ae24-fc4672da1905 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:05.425042 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2386a212-4674-463f-ae24-fc4672da1905 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.153601 Dec 15 13:04:05.425655 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1125/2266] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:05 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:06.442260 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1ea6686e-3da1-4613-8066-3a0094f76076 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:06.442910 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1ea6686e-3da1-4613-8066-3a0094f76076 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:06.449093 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ea6686e-3da1-4613-8066-3a0094f76076 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:06.449571 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ea6686e-3da1-4613-8066-3a0094f76076 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:06.450353 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ea6686e-3da1-4613-8066-3a0094f76076 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:06.450795 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ea6686e-3da1-4613-8066-3a0094f76076 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:06.590840 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1ea6686e-3da1-4613-8066-3a0094f76076 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:06.599288 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1ea6686e-3da1-4613-8066-3a0094f76076 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.160702 Dec 15 13:04:06.599856 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1142/2267] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:06 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:07.616735 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bff62039-f474-457c-97a7-4af145616f31 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:07.617536 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bff62039-f474-457c-97a7-4af145616f31 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:07.623655 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bff62039-f474-457c-97a7-4af145616f31 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:07.624107 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bff62039-f474-457c-97a7-4af145616f31 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:07.624879 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bff62039-f474-457c-97a7-4af145616f31 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:07.625314 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bff62039-f474-457c-97a7-4af145616f31 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:07.761912 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bff62039-f474-457c-97a7-4af145616f31 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:07.770461 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bff62039-f474-457c-97a7-4af145616f31 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.157448 Dec 15 13:04:07.771039 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1126/2268] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:07 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:08.788159 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c1c64f49-c1fc-49bb-b60c-907b5cf5588a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:08.788721 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c1c64f49-c1fc-49bb-b60c-907b5cf5588a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:08.795898 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c1c64f49-c1fc-49bb-b60c-907b5cf5588a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:08.796375 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c1c64f49-c1fc-49bb-b60c-907b5cf5588a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:08.797220 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c1c64f49-c1fc-49bb-b60c-907b5cf5588a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:08.797692 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c1c64f49-c1fc-49bb-b60c-907b5cf5588a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:08.935171 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c1c64f49-c1fc-49bb-b60c-907b5cf5588a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:08.942971 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c1c64f49-c1fc-49bb-b60c-907b5cf5588a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.158560 Dec 15 13:04:08.943535 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1143/2269] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:08 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:09.960194 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3a03849a-6154-4199-8231-21081d49a348 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:09.960845 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3a03849a-6154-4199-8231-21081d49a348 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:09.967252 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3a03849a-6154-4199-8231-21081d49a348 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:09.967701 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3a03849a-6154-4199-8231-21081d49a348 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:09.968476 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3a03849a-6154-4199-8231-21081d49a348 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:09.968910 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3a03849a-6154-4199-8231-21081d49a348 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:10.106023 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3a03849a-6154-4199-8231-21081d49a348 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:10.114572 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3a03849a-6154-4199-8231-21081d49a348 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.158019 Dec 15 13:04:10.115138 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1127/2270] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:09 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:04:11.134952 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8879d911-5c50-459a-937a-98910a97f855 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:11.135577 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8879d911-5c50-459a-937a-98910a97f855 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:11.144015 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8879d911-5c50-459a-937a-98910a97f855 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:11.144455 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8879d911-5c50-459a-937a-98910a97f855 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:11.145241 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8879d911-5c50-459a-937a-98910a97f855 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:11.145715 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8879d911-5c50-459a-937a-98910a97f855 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:11.279463 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-8879d911-5c50-459a-937a-98910a97f855 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:11.287312 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8879d911-5c50-459a-937a-98910a97f855 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.155970 Dec 15 13:04:11.287890 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1144/2271] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:11 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:12.305493 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-37edd6d7-8879-4b2b-8206-39a84f6fba34 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:12.306129 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-37edd6d7-8879-4b2b-8206-39a84f6fba34 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:12.313059 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-37edd6d7-8879-4b2b-8206-39a84f6fba34 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:12.313526 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-37edd6d7-8879-4b2b-8206-39a84f6fba34 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:12.314294 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-37edd6d7-8879-4b2b-8206-39a84f6fba34 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:12.314829 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-37edd6d7-8879-4b2b-8206-39a84f6fba34 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:12.653350 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-37edd6d7-8879-4b2b-8206-39a84f6fba34 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:12.662202 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-37edd6d7-8879-4b2b-8206-39a84f6fba34 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.360277 Dec 15 13:04:12.662772 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1128/2272] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:12 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:13.679973 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1f00c2fd-54bf-4afb-8174-219eca08614b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:13.680887 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1f00c2fd-54bf-4afb-8174-219eca08614b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:13.689605 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1f00c2fd-54bf-4afb-8174-219eca08614b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:13.690251 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1f00c2fd-54bf-4afb-8174-219eca08614b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:13.691394 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1f00c2fd-54bf-4afb-8174-219eca08614b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:13.692024 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1f00c2fd-54bf-4afb-8174-219eca08614b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:13.833400 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1f00c2fd-54bf-4afb-8174-219eca08614b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:13.842169 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1f00c2fd-54bf-4afb-8174-219eca08614b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.165410 Dec 15 13:04:13.842750 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1145/2273] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:13 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:14.866477 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4c5d7602-726f-4240-82bc-57611a13788e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:14.867038 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4c5d7602-726f-4240-82bc-57611a13788e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:14.873371 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4c5d7602-726f-4240-82bc-57611a13788e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:14.873816 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4c5d7602-726f-4240-82bc-57611a13788e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:14.874587 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4c5d7602-726f-4240-82bc-57611a13788e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:14.875011 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4c5d7602-726f-4240-82bc-57611a13788e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:15.025286 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4c5d7602-726f-4240-82bc-57611a13788e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:15.034991 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4c5d7602-726f-4240-82bc-57611a13788e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.172313 Dec 15 13:04:15.035561 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1129/2274] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:14 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:16.051930 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3d99e326-4fe4-49a2-83ea-723d9ae98a90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:16.052537 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3d99e326-4fe4-49a2-83ea-723d9ae98a90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:16.058957 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3d99e326-4fe4-49a2-83ea-723d9ae98a90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:16.059406 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3d99e326-4fe4-49a2-83ea-723d9ae98a90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:16.060834 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3d99e326-4fe4-49a2-83ea-723d9ae98a90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:16.061266 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3d99e326-4fe4-49a2-83ea-723d9ae98a90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:16.193306 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3d99e326-4fe4-49a2-83ea-723d9ae98a90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:16.201756 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3d99e326-4fe4-49a2-83ea-723d9ae98a90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.153230 Dec 15 13:04:16.202358 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1146/2275] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:16 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:17.219655 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-dbec8229-30fa-4c2e-9657-f47c6c608faa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:17.220262 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-dbec8229-30fa-4c2e-9657-f47c6c608faa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:17.226439 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dbec8229-30fa-4c2e-9657-f47c6c608faa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:17.226879 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dbec8229-30fa-4c2e-9657-f47c6c608faa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:17.227634 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dbec8229-30fa-4c2e-9657-f47c6c608faa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:17.228058 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dbec8229-30fa-4c2e-9657-f47c6c608faa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:17.376882 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-dbec8229-30fa-4c2e-9657-f47c6c608faa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:17.384528 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-dbec8229-30fa-4c2e-9657-f47c6c608faa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.169085 Dec 15 13:04:17.385088 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1130/2276] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:17 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:18.402244 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c1d92ec2-8293-4f07-b517-67e0260374ee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:18.402806 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c1d92ec2-8293-4f07-b517-67e0260374ee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:18.409157 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c1d92ec2-8293-4f07-b517-67e0260374ee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:18.409639 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c1d92ec2-8293-4f07-b517-67e0260374ee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:18.410416 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c1d92ec2-8293-4f07-b517-67e0260374ee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:18.410851 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c1d92ec2-8293-4f07-b517-67e0260374ee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:18.540446 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c1d92ec2-8293-4f07-b517-67e0260374ee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:18.549396 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c1d92ec2-8293-4f07-b517-67e0260374ee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.150751 Dec 15 13:04:18.550019 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1147/2277] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:18 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:19.566054 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-181eddc6-4f90-4573-9335-425013192928 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:19.566733 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-181eddc6-4f90-4573-9335-425013192928 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:19.572940 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-181eddc6-4f90-4573-9335-425013192928 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:19.573390 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-181eddc6-4f90-4573-9335-425013192928 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:19.574194 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-181eddc6-4f90-4573-9335-425013192928 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:19.574629 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-181eddc6-4f90-4573-9335-425013192928 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:19.718127 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-181eddc6-4f90-4573-9335-425013192928 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:19.726167 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-181eddc6-4f90-4573-9335-425013192928 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.163431 Dec 15 13:04:19.726490 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1131/2278] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:19 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:20.743731 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-451532d3-23f9-445d-b4bb-5ffc571935e2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:20.744299 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-451532d3-23f9-445d-b4bb-5ffc571935e2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:20.751461 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-451532d3-23f9-445d-b4bb-5ffc571935e2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:20.751908 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-451532d3-23f9-445d-b4bb-5ffc571935e2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:20.752741 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-451532d3-23f9-445d-b4bb-5ffc571935e2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:20.753195 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-451532d3-23f9-445d-b4bb-5ffc571935e2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:20.892165 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-451532d3-23f9-445d-b4bb-5ffc571935e2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:20.900665 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-451532d3-23f9-445d-b4bb-5ffc571935e2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.160552 Dec 15 13:04:20.901268 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1148/2279] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:20 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:21.917775 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b166ddde-4c41-4b66-8847-f0c2af7b3b90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:21.918418 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b166ddde-4c41-4b66-8847-f0c2af7b3b90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:21.924839 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b166ddde-4c41-4b66-8847-f0c2af7b3b90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:21.925288 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b166ddde-4c41-4b66-8847-f0c2af7b3b90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:21.926094 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b166ddde-4c41-4b66-8847-f0c2af7b3b90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:21.926535 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b166ddde-4c41-4b66-8847-f0c2af7b3b90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:22.058253 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b166ddde-4c41-4b66-8847-f0c2af7b3b90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:22.066250 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b166ddde-4c41-4b66-8847-f0c2af7b3b90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.152318 Dec 15 13:04:22.066824 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1132/2280] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:21 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:23.083817 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-01a2b2c8-e408-40a6-920b-dabdb0bd0780 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:23.084555 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-01a2b2c8-e408-40a6-920b-dabdb0bd0780 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:23.091765 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-01a2b2c8-e408-40a6-920b-dabdb0bd0780 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:23.092220 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-01a2b2c8-e408-40a6-920b-dabdb0bd0780 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:23.093047 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-01a2b2c8-e408-40a6-920b-dabdb0bd0780 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:23.093489 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-01a2b2c8-e408-40a6-920b-dabdb0bd0780 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:23.226977 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-01a2b2c8-e408-40a6-920b-dabdb0bd0780 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:23.236984 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-01a2b2c8-e408-40a6-920b-dabdb0bd0780 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.156825 Dec 15 13:04:23.237682 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1149/2281] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:23 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:24.254498 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-13f5f3fd-9ab2-4a41-b21d-2562d2461c9f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:24.255095 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-13f5f3fd-9ab2-4a41-b21d-2562d2461c9f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:24.261709 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-13f5f3fd-9ab2-4a41-b21d-2562d2461c9f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:24.262158 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-13f5f3fd-9ab2-4a41-b21d-2562d2461c9f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:24.262979 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-13f5f3fd-9ab2-4a41-b21d-2562d2461c9f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:24.263450 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-13f5f3fd-9ab2-4a41-b21d-2562d2461c9f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:24.395194 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-13f5f3fd-9ab2-4a41-b21d-2562d2461c9f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:24.403249 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-13f5f3fd-9ab2-4a41-b21d-2562d2461c9f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.152359 Dec 15 13:04:24.403959 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1133/2282] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:24 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:04:25.420766 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-96466c63-c1bf-46af-94fb-aeb387bf0f0c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:25.421370 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-96466c63-c1bf-46af-94fb-aeb387bf0f0c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:25.428172 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-96466c63-c1bf-46af-94fb-aeb387bf0f0c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:25.428623 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-96466c63-c1bf-46af-94fb-aeb387bf0f0c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:25.429434 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-96466c63-c1bf-46af-94fb-aeb387bf0f0c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:25.429911 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-96466c63-c1bf-46af-94fb-aeb387bf0f0c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:25.570118 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-96466c63-c1bf-46af-94fb-aeb387bf0f0c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:25.578303 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-96466c63-c1bf-46af-94fb-aeb387bf0f0c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.161846 Dec 15 13:04:25.578887 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1150/2283] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:25 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:26.596185 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-cf1b7eec-7a7c-4b40-a47c-6ac62a78b9f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:26.596806 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-cf1b7eec-7a7c-4b40-a47c-6ac62a78b9f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:26.603057 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cf1b7eec-7a7c-4b40-a47c-6ac62a78b9f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:26.603496 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cf1b7eec-7a7c-4b40-a47c-6ac62a78b9f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:26.604285 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cf1b7eec-7a7c-4b40-a47c-6ac62a78b9f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:26.604689 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cf1b7eec-7a7c-4b40-a47c-6ac62a78b9f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:26.775965 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-cf1b7eec-7a7c-4b40-a47c-6ac62a78b9f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:26.785245 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cf1b7eec-7a7c-4b40-a47c-6ac62a78b9f8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.193358 Dec 15 13:04:26.785904 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1134/2284] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:26 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:27.805341 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-57e37ed2-c59e-4858-b419-e68893e2e8cf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:27.805965 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-57e37ed2-c59e-4858-b419-e68893e2e8cf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:27.812819 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-57e37ed2-c59e-4858-b419-e68893e2e8cf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:27.813274 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-57e37ed2-c59e-4858-b419-e68893e2e8cf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:27.814088 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-57e37ed2-c59e-4858-b419-e68893e2e8cf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:27.814528 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-57e37ed2-c59e-4858-b419-e68893e2e8cf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:28.009725 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-57e37ed2-c59e-4858-b419-e68893e2e8cf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:28.017891 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-57e37ed2-c59e-4858-b419-e68893e2e8cf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.216145 Dec 15 13:04:28.018457 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1151/2285] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:27 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:29.035352 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3ee85da5-bae9-4584-b675-4299dd2fc5fd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:29.035970 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3ee85da5-bae9-4584-b675-4299dd2fc5fd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:29.042068 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3ee85da5-bae9-4584-b675-4299dd2fc5fd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:29.042483 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3ee85da5-bae9-4584-b675-4299dd2fc5fd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:29.043245 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3ee85da5-bae9-4584-b675-4299dd2fc5fd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:29.043682 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3ee85da5-bae9-4584-b675-4299dd2fc5fd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:29.192267 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3ee85da5-bae9-4584-b675-4299dd2fc5fd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:29.201928 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3ee85da5-bae9-4584-b675-4299dd2fc5fd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.170244 Dec 15 13:04:29.202576 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1135/2286] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:29 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:04:30.218938 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fd7f32b0-8a39-4930-aa4e-c4a007fe1682 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:30.219619 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fd7f32b0-8a39-4930-aa4e-c4a007fe1682 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:30.226234 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fd7f32b0-8a39-4930-aa4e-c4a007fe1682 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:30.226692 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fd7f32b0-8a39-4930-aa4e-c4a007fe1682 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:30.227496 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fd7f32b0-8a39-4930-aa4e-c4a007fe1682 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:30.227930 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fd7f32b0-8a39-4930-aa4e-c4a007fe1682 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:30.369372 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-fd7f32b0-8a39-4930-aa4e-c4a007fe1682 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:30.384330 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fd7f32b0-8a39-4930-aa4e-c4a007fe1682 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.169501 Dec 15 13:04:30.385222 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1152/2287] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:30 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:31.407421 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-330a6cd9-4ecd-4a85-8231-bd0ae13d439b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:31.408039 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-330a6cd9-4ecd-4a85-8231-bd0ae13d439b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:31.414472 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-330a6cd9-4ecd-4a85-8231-bd0ae13d439b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:31.414985 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-330a6cd9-4ecd-4a85-8231-bd0ae13d439b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:31.415768 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-330a6cd9-4ecd-4a85-8231-bd0ae13d439b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:31.416194 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-330a6cd9-4ecd-4a85-8231-bd0ae13d439b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:31.555451 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-330a6cd9-4ecd-4a85-8231-bd0ae13d439b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:31.564397 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-330a6cd9-4ecd-4a85-8231-bd0ae13d439b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.160773 Dec 15 13:04:31.565040 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1136/2288] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:31 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:32.585542 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-72744e1e-6737-45ea-bd25-cdd370027fb0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:32.586564 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-72744e1e-6737-45ea-bd25-cdd370027fb0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:32.594588 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-72744e1e-6737-45ea-bd25-cdd370027fb0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:32.595034 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-72744e1e-6737-45ea-bd25-cdd370027fb0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:32.595808 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-72744e1e-6737-45ea-bd25-cdd370027fb0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:32.596243 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-72744e1e-6737-45ea-bd25-cdd370027fb0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:32.742474 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-72744e1e-6737-45ea-bd25-cdd370027fb0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:32.751279 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-72744e1e-6737-45ea-bd25-cdd370027fb0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.172523 Dec 15 13:04:32.751848 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1153/2289] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:32 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:33.769389 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-aca57f5a-0f1b-40fb-a9a5-6e2fadafc661 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:33.770042 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-aca57f5a-0f1b-40fb-a9a5-6e2fadafc661 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:33.777047 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aca57f5a-0f1b-40fb-a9a5-6e2fadafc661 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:33.777633 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aca57f5a-0f1b-40fb-a9a5-6e2fadafc661 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:33.778698 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aca57f5a-0f1b-40fb-a9a5-6e2fadafc661 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:33.779361 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aca57f5a-0f1b-40fb-a9a5-6e2fadafc661 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:33.919943 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-aca57f5a-0f1b-40fb-a9a5-6e2fadafc661 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:33.927946 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-aca57f5a-0f1b-40fb-a9a5-6e2fadafc661 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.162733 Dec 15 13:04:33.928510 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1137/2290] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:33 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:34.944852 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7b857341-8dba-4d0d-8c7a-327135c97fb8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:34.945455 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7b857341-8dba-4d0d-8c7a-327135c97fb8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:34.952064 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b857341-8dba-4d0d-8c7a-327135c97fb8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:34.953255 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b857341-8dba-4d0d-8c7a-327135c97fb8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:34.954133 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b857341-8dba-4d0d-8c7a-327135c97fb8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:34.954592 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b857341-8dba-4d0d-8c7a-327135c97fb8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:35.095308 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7b857341-8dba-4d0d-8c7a-327135c97fb8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:35.102978 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7b857341-8dba-4d0d-8c7a-327135c97fb8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.161808 Dec 15 13:04:35.103543 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1154/2291] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:34 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:36.239075 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-731b2ae2-e729-4f73-b7a7-a6230c6d728d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:36.239698 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-731b2ae2-e729-4f73-b7a7-a6230c6d728d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:36.245490 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-731b2ae2-e729-4f73-b7a7-a6230c6d728d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:36.245971 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-731b2ae2-e729-4f73-b7a7-a6230c6d728d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:36.246753 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-731b2ae2-e729-4f73-b7a7-a6230c6d728d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:36.247184 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-731b2ae2-e729-4f73-b7a7-a6230c6d728d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:36.392987 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-731b2ae2-e729-4f73-b7a7-a6230c6d728d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:36.401307 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-731b2ae2-e729-4f73-b7a7-a6230c6d728d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.282881 Dec 15 13:04:36.401907 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1138/2292] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:36 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:37.417718 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-73211987-6ae9-43d9-9da9-7c541f0caff6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:37.418333 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-73211987-6ae9-43d9-9da9-7c541f0caff6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:37.424770 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-73211987-6ae9-43d9-9da9-7c541f0caff6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:37.425217 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-73211987-6ae9-43d9-9da9-7c541f0caff6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:37.426014 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-73211987-6ae9-43d9-9da9-7c541f0caff6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:37.426446 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-73211987-6ae9-43d9-9da9-7c541f0caff6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:37.570462 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-73211987-6ae9-43d9-9da9-7c541f0caff6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:37.579424 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-73211987-6ae9-43d9-9da9-7c541f0caff6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.165317 Dec 15 13:04:37.580128 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1155/2293] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:37 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:38.494682 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:04:38.495379 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 13:04:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:04:38.595871 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bd59a435-eec2-41a6-8a86-f8073ef96117 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:38.596492 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bd59a435-eec2-41a6-8a86-f8073ef96117 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:38.603164 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd59a435-eec2-41a6-8a86-f8073ef96117 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:38.603614 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd59a435-eec2-41a6-8a86-f8073ef96117 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:38.604405 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd59a435-eec2-41a6-8a86-f8073ef96117 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:38.604835 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd59a435-eec2-41a6-8a86-f8073ef96117 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:38.740811 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bd59a435-eec2-41a6-8a86-f8073ef96117 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:38.748510 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bd59a435-eec2-41a6-8a86-f8073ef96117 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.156307 Dec 15 13:04:38.749076 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1139/2294] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:38 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:39.766312 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-460d50d4-20db-4d07-9c8a-111db4f8cfed tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:39.766931 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-460d50d4-20db-4d07-9c8a-111db4f8cfed tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:39.773195 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-460d50d4-20db-4d07-9c8a-111db4f8cfed tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:39.773680 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-460d50d4-20db-4d07-9c8a-111db4f8cfed tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:39.774458 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-460d50d4-20db-4d07-9c8a-111db4f8cfed tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:39.774895 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-460d50d4-20db-4d07-9c8a-111db4f8cfed tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:39.908420 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-460d50d4-20db-4d07-9c8a-111db4f8cfed tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:39.916576 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-460d50d4-20db-4d07-9c8a-111db4f8cfed tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.154171 Dec 15 13:04:39.917150 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1156/2295] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:39 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:40.933452 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-09a50462-da69-4c44-874c-d3bfc76d0843 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:40.934052 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-09a50462-da69-4c44-874c-d3bfc76d0843 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:40.940796 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-09a50462-da69-4c44-874c-d3bfc76d0843 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:40.941233 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-09a50462-da69-4c44-874c-d3bfc76d0843 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:40.942043 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-09a50462-da69-4c44-874c-d3bfc76d0843 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:40.942481 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-09a50462-da69-4c44-874c-d3bfc76d0843 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:41.074509 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-09a50462-da69-4c44-874c-d3bfc76d0843 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:41.082157 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-09a50462-da69-4c44-874c-d3bfc76d0843 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.152432 Dec 15 13:04:41.082721 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1140/2296] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:40 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:42.098877 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ef66cea5-0b01-4533-8cce-2e674b72b673 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:42.099436 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ef66cea5-0b01-4533-8cce-2e674b72b673 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:42.105715 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ef66cea5-0b01-4533-8cce-2e674b72b673 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:42.106173 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ef66cea5-0b01-4533-8cce-2e674b72b673 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:42.106960 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ef66cea5-0b01-4533-8cce-2e674b72b673 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:42.107399 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ef66cea5-0b01-4533-8cce-2e674b72b673 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:42.259077 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ef66cea5-0b01-4533-8cce-2e674b72b673 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:42.267721 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ef66cea5-0b01-4533-8cce-2e674b72b673 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.172616 Dec 15 13:04:42.268281 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1157/2297] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:42 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:43.284384 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ec346d61-c035-426a-837a-5799528dacf6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:43.285053 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ec346d61-c035-426a-837a-5799528dacf6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:43.292500 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ec346d61-c035-426a-837a-5799528dacf6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:43.292945 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ec346d61-c035-426a-837a-5799528dacf6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:43.293786 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ec346d61-c035-426a-837a-5799528dacf6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:43.294219 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ec346d61-c035-426a-837a-5799528dacf6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:43.431711 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ec346d61-c035-426a-837a-5799528dacf6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:43.439921 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ec346d61-c035-426a-837a-5799528dacf6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.159122 Dec 15 13:04:43.440770 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1141/2298] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:43 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:44.460435 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6e710ea6-0c20-4b84-aff5-7c9c9b6a66ff tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:44.461101 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6e710ea6-0c20-4b84-aff5-7c9c9b6a66ff tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:44.467819 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e710ea6-0c20-4b84-aff5-7c9c9b6a66ff tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:44.468914 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e710ea6-0c20-4b84-aff5-7c9c9b6a66ff tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:44.469745 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e710ea6-0c20-4b84-aff5-7c9c9b6a66ff tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:44.470189 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e710ea6-0c20-4b84-aff5-7c9c9b6a66ff tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:44.602063 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6e710ea6-0c20-4b84-aff5-7c9c9b6a66ff tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:44.609843 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6e710ea6-0c20-4b84-aff5-7c9c9b6a66ff tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.153370 Dec 15 13:04:44.610417 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1158/2299] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:44 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:45.625953 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-aba191c5-7c88-4de8-adc7-a68a4f861ca1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:45.626545 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-aba191c5-7c88-4de8-adc7-a68a4f861ca1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:45.635239 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aba191c5-7c88-4de8-adc7-a68a4f861ca1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:45.635695 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aba191c5-7c88-4de8-adc7-a68a4f861ca1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:45.636766 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aba191c5-7c88-4de8-adc7-a68a4f861ca1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:45.637210 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aba191c5-7c88-4de8-adc7-a68a4f861ca1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:45.779742 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-aba191c5-7c88-4de8-adc7-a68a4f861ca1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:45.788885 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-aba191c5-7c88-4de8-adc7-a68a4f861ca1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.166678 Dec 15 13:04:45.789468 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1142/2300] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:45 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:46.806968 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d8f45d1b-8b85-4b6d-bf50-2404011c663f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:46.807618 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d8f45d1b-8b85-4b6d-bf50-2404011c663f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:46.814491 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d8f45d1b-8b85-4b6d-bf50-2404011c663f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:46.814947 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d8f45d1b-8b85-4b6d-bf50-2404011c663f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:46.815734 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d8f45d1b-8b85-4b6d-bf50-2404011c663f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:46.816174 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d8f45d1b-8b85-4b6d-bf50-2404011c663f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:46.959791 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d8f45d1b-8b85-4b6d-bf50-2404011c663f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:46.967627 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d8f45d1b-8b85-4b6d-bf50-2404011c663f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.164215 Dec 15 13:04:46.968949 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1159/2301] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:46 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:47.986052 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9b442336-77dc-426f-9807-ad97868dedd4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:47.986672 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9b442336-77dc-426f-9807-ad97868dedd4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:47.993099 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9b442336-77dc-426f-9807-ad97868dedd4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:47.993583 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9b442336-77dc-426f-9807-ad97868dedd4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:47.994367 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9b442336-77dc-426f-9807-ad97868dedd4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:47.994810 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9b442336-77dc-426f-9807-ad97868dedd4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:48.146977 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9b442336-77dc-426f-9807-ad97868dedd4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:48.156583 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9b442336-77dc-426f-9807-ad97868dedd4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.174828 Dec 15 13:04:48.157260 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1143/2302] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:47 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:49.174906 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f0b28b23-5526-4871-a16a-5983e074591a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:49.175499 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f0b28b23-5526-4871-a16a-5983e074591a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:49.182099 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f0b28b23-5526-4871-a16a-5983e074591a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:49.182592 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f0b28b23-5526-4871-a16a-5983e074591a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:49.183333 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f0b28b23-5526-4871-a16a-5983e074591a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:49.183758 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f0b28b23-5526-4871-a16a-5983e074591a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:49.329786 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f0b28b23-5526-4871-a16a-5983e074591a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:49.338830 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f0b28b23-5526-4871-a16a-5983e074591a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.167745 Dec 15 13:04:49.339423 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1160/2303] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:49 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:50.355899 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-cb8ee70b-75d5-47a7-b534-01b312d65bde tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:50.356515 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-cb8ee70b-75d5-47a7-b534-01b312d65bde tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:50.363506 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cb8ee70b-75d5-47a7-b534-01b312d65bde tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:50.363953 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cb8ee70b-75d5-47a7-b534-01b312d65bde tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:50.364731 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cb8ee70b-75d5-47a7-b534-01b312d65bde tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:50.365168 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cb8ee70b-75d5-47a7-b534-01b312d65bde tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:50.498098 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-cb8ee70b-75d5-47a7-b534-01b312d65bde tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:50.506575 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cb8ee70b-75d5-47a7-b534-01b312d65bde tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.154329 Dec 15 13:04:50.507145 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1144/2304] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:50 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:51.523911 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bb978500-3519-4ca5-b9a3-1f9650871750 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:51.524501 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bb978500-3519-4ca5-b9a3-1f9650871750 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:51.531794 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bb978500-3519-4ca5-b9a3-1f9650871750 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:51.532176 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bb978500-3519-4ca5-b9a3-1f9650871750 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:51.532955 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bb978500-3519-4ca5-b9a3-1f9650871750 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:51.533389 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bb978500-3519-4ca5-b9a3-1f9650871750 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:51.904569 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-bb978500-3519-4ca5-b9a3-1f9650871750 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:51.913465 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bb978500-3519-4ca5-b9a3-1f9650871750 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.393206 Dec 15 13:04:51.914068 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1161/2305] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:51 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:52.930142 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5b380d10-546b-4396-82be-57bac1b6418a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:52.930743 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5b380d10-546b-4396-82be-57bac1b6418a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:52.937807 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5b380d10-546b-4396-82be-57bac1b6418a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:52.938266 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5b380d10-546b-4396-82be-57bac1b6418a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:52.939044 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5b380d10-546b-4396-82be-57bac1b6418a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:52.939482 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5b380d10-546b-4396-82be-57bac1b6418a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:53.073336 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5b380d10-546b-4396-82be-57bac1b6418a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:53.081785 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5b380d10-546b-4396-82be-57bac1b6418a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.155148 Dec 15 13:04:53.082380 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1145/2306] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:52 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:54.098550 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1ec4a10a-d6a9-4d4d-abd3-1950c4451e41 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:54.099158 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1ec4a10a-d6a9-4d4d-abd3-1950c4451e41 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:54.105615 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ec4a10a-d6a9-4d4d-abd3-1950c4451e41 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:54.106063 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ec4a10a-d6a9-4d4d-abd3-1950c4451e41 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:54.106832 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ec4a10a-d6a9-4d4d-abd3-1950c4451e41 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:54.107262 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ec4a10a-d6a9-4d4d-abd3-1950c4451e41 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:54.243222 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1ec4a10a-d6a9-4d4d-abd3-1950c4451e41 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:54.252864 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1ec4a10a-d6a9-4d4d-abd3-1950c4451e41 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.157860 Dec 15 13:04:54.253605 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1162/2307] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:54 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:55.271341 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1511fc76-9f5b-4bdf-aba9-39e09957e348 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:55.271923 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1511fc76-9f5b-4bdf-aba9-39e09957e348 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:55.278196 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1511fc76-9f5b-4bdf-aba9-39e09957e348 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:55.278635 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1511fc76-9f5b-4bdf-aba9-39e09957e348 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:55.279419 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1511fc76-9f5b-4bdf-aba9-39e09957e348 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:55.279846 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1511fc76-9f5b-4bdf-aba9-39e09957e348 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:55.413078 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1511fc76-9f5b-4bdf-aba9-39e09957e348 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:55.426329 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1511fc76-9f5b-4bdf-aba9-39e09957e348 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.158475 Dec 15 13:04:55.426928 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1146/2308] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:55 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:56.443374 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4191e0ec-bdb1-4763-9d8a-f73f592d6abc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:56.443947 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4191e0ec-bdb1-4763-9d8a-f73f592d6abc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:56.450067 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4191e0ec-bdb1-4763-9d8a-f73f592d6abc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:56.450510 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4191e0ec-bdb1-4763-9d8a-f73f592d6abc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:56.451268 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4191e0ec-bdb1-4763-9d8a-f73f592d6abc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:56.451698 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4191e0ec-bdb1-4763-9d8a-f73f592d6abc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:56.593154 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4191e0ec-bdb1-4763-9d8a-f73f592d6abc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:56.601758 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4191e0ec-bdb1-4763-9d8a-f73f592d6abc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.162025 Dec 15 13:04:56.602322 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1163/2309] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:56 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:57.173928 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:04:57.174212 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 13:04:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:04:57.618210 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ada7dd2b-724f-4b2d-996a-19a449c2ec80 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:57.618824 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ada7dd2b-724f-4b2d-996a-19a449c2ec80 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:57.624601 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ada7dd2b-724f-4b2d-996a-19a449c2ec80 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:57.625057 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ada7dd2b-724f-4b2d-996a-19a449c2ec80 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:57.625867 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ada7dd2b-724f-4b2d-996a-19a449c2ec80 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:57.626306 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ada7dd2b-724f-4b2d-996a-19a449c2ec80 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:57.766129 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ada7dd2b-724f-4b2d-996a-19a449c2ec80 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:57.774167 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ada7dd2b-724f-4b2d-996a-19a449c2ec80 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.159711 Dec 15 13:04:57.774732 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1147/2310] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:57 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:58.791043 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ce926ca0-0492-4c2e-817e-30f5df8b6ac3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:58.791689 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ce926ca0-0492-4c2e-817e-30f5df8b6ac3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:58.798038 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce926ca0-0492-4c2e-817e-30f5df8b6ac3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:58.798488 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce926ca0-0492-4c2e-817e-30f5df8b6ac3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:58.799446 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce926ca0-0492-4c2e-817e-30f5df8b6ac3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:58.799766 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce926ca0-0492-4c2e-817e-30f5df8b6ac3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:58.947898 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ce926ca0-0492-4c2e-817e-30f5df8b6ac3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:04:58.957218 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ce926ca0-0492-4c2e-817e-30f5df8b6ac3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1560 microversion: 2.1 time: 0.169519 Dec 15 13:04:58.958092 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1164/2311] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:58 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:04:59.975157 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-da1c4688-5b9d-416d-8540-e405be142199 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:04:59.975833 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-da1c4688-5b9d-416d-8540-e405be142199 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:04:59.982441 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-da1c4688-5b9d-416d-8540-e405be142199 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:59.982891 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-da1c4688-5b9d-416d-8540-e405be142199 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:04:59.983673 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-da1c4688-5b9d-416d-8540-e405be142199 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:04:59.984151 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-da1c4688-5b9d-416d-8540-e405be142199 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:00.063774 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-da1c4688-5b9d-416d-8540-e405be142199 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:00.073047 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-da1c4688-5b9d-416d-8540-e405be142199 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1518 microversion: 2.1 time: 0.102111 Dec 15 13:05:00.073992 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1148/2312] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:04:59 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1518 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:00.099957 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-99b2d8c2-a59a-400b-98da-20dd6d32e75b req-d1f3c614-99b6-4810-8ed9-60d0b5e5d32e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af14627f-65d9-46ce-9fea-d9c7c74c0ef3", "name": "network-vif-deleted", "tag": "bae2a0c5-6d9c-4f3c-b012-5872c7deaeb1"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:05:00.102378 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:05:00.102378 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 13:05:00.111965 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-99b2d8c2-a59a-400b-98da-20dd6d32e75b req-d1f3c614-99b6-4810-8ed9-60d0b5e5d32e service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:00.112455 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-99b2d8c2-a59a-400b-98da-20dd6d32e75b req-d1f3c614-99b6-4810-8ed9-60d0b5e5d32e service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:00.125578 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-99b2d8c2-a59a-400b-98da-20dd6d32e75b req-d1f3c614-99b6-4810-8ed9-60d0b5e5d32e service nova] Creating event network-vif-deleted:bae2a0c5-6d9c-4f3c-b012-5872c7deaeb1 for instance af14627f-65d9-46ce-9fea-d9c7c74c0ef3 on hv-cinder-81322 Dec 15 13:05:00.133718 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-99b2d8c2-a59a-400b-98da-20dd6d32e75b req-d1f3c614-99b6-4810-8ed9-60d0b5e5d32e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037202 Dec 15 13:05:00.133718 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1165/2313] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:05:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:05:01.090246 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7a7e5bc9-5930-45ee-b1c7-2b8eb8f2d269 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:01.090933 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7a7e5bc9-5930-45ee-b1c7-2b8eb8f2d269 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:01.097798 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7a7e5bc9-5930-45ee-b1c7-2b8eb8f2d269 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:01.098248 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7a7e5bc9-5930-45ee-b1c7-2b8eb8f2d269 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:01.099049 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7a7e5bc9-5930-45ee-b1c7-2b8eb8f2d269 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:01.099490 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7a7e5bc9-5930-45ee-b1c7-2b8eb8f2d269 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:01.162524 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7a7e5bc9-5930-45ee-b1c7-2b8eb8f2d269 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:01.170399 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7a7e5bc9-5930-45ee-b1c7-2b8eb8f2d269 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.083909 Dec 15 13:05:01.170964 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1149/2314] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:01 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:02.190089 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1d7930ef-b6c3-4c6a-b565-020690a90ac6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:02.190796 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1d7930ef-b6c3-4c6a-b565-020690a90ac6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:02.197260 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1d7930ef-b6c3-4c6a-b565-020690a90ac6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:02.197746 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1d7930ef-b6c3-4c6a-b565-020690a90ac6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:02.198527 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1d7930ef-b6c3-4c6a-b565-020690a90ac6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:02.198964 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1d7930ef-b6c3-4c6a-b565-020690a90ac6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:02.264799 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1d7930ef-b6c3-4c6a-b565-020690a90ac6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:02.273423 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1d7930ef-b6c3-4c6a-b565-020690a90ac6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.088413 Dec 15 13:05:02.274018 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1166/2315] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:02 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:03.290827 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b173b68a-9478-492d-94eb-36658521e6d4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:03.291634 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b173b68a-9478-492d-94eb-36658521e6d4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:03.299074 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b173b68a-9478-492d-94eb-36658521e6d4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:03.299521 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b173b68a-9478-492d-94eb-36658521e6d4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:03.300597 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b173b68a-9478-492d-94eb-36658521e6d4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:03.301034 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b173b68a-9478-492d-94eb-36658521e6d4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:03.364279 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b173b68a-9478-492d-94eb-36658521e6d4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:03.372032 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b173b68a-9478-492d-94eb-36658521e6d4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.085004 Dec 15 13:05:03.372793 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1150/2316] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:03 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:04.388868 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f136a6ab-c317-4883-8e8f-44684bef5109 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:04.389480 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f136a6ab-c317-4883-8e8f-44684bef5109 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:04.396492 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f136a6ab-c317-4883-8e8f-44684bef5109 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:04.397027 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f136a6ab-c317-4883-8e8f-44684bef5109 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:04.397758 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f136a6ab-c317-4883-8e8f-44684bef5109 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:04.398203 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f136a6ab-c317-4883-8e8f-44684bef5109 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:04.457655 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f136a6ab-c317-4883-8e8f-44684bef5109 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:04.465409 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f136a6ab-c317-4883-8e8f-44684bef5109 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.080458 Dec 15 13:05:04.466008 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1167/2317] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:04 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:05.482145 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-898857b1-b9fe-41bc-bf8e-d576f10bf89a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:05.482825 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-898857b1-b9fe-41bc-bf8e-d576f10bf89a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:05.489740 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-898857b1-b9fe-41bc-bf8e-d576f10bf89a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:05.490192 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-898857b1-b9fe-41bc-bf8e-d576f10bf89a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:05.490969 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-898857b1-b9fe-41bc-bf8e-d576f10bf89a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:05.491402 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-898857b1-b9fe-41bc-bf8e-d576f10bf89a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:05.557927 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-898857b1-b9fe-41bc-bf8e-d576f10bf89a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:05.566404 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-898857b1-b9fe-41bc-bf8e-d576f10bf89a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.087915 Dec 15 13:05:05.566984 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1151/2318] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:05 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:06.583325 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-232a4728-840c-402e-b13b-9fe1cdd31d85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:06.583929 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-232a4728-840c-402e-b13b-9fe1cdd31d85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:06.590192 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-232a4728-840c-402e-b13b-9fe1cdd31d85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:06.590640 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-232a4728-840c-402e-b13b-9fe1cdd31d85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:06.591412 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-232a4728-840c-402e-b13b-9fe1cdd31d85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:06.591848 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-232a4728-840c-402e-b13b-9fe1cdd31d85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:06.652232 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-232a4728-840c-402e-b13b-9fe1cdd31d85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:06.668138 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-232a4728-840c-402e-b13b-9fe1cdd31d85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.088465 Dec 15 13:05:06.668732 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1168/2319] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:06 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:07.687738 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1fb24e1a-3a76-401a-9eb6-783858467439 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:07.688417 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1fb24e1a-3a76-401a-9eb6-783858467439 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:07.695381 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1fb24e1a-3a76-401a-9eb6-783858467439 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:07.695825 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1fb24e1a-3a76-401a-9eb6-783858467439 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:07.696603 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1fb24e1a-3a76-401a-9eb6-783858467439 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:07.697035 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1fb24e1a-3a76-401a-9eb6-783858467439 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:07.766826 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1fb24e1a-3a76-401a-9eb6-783858467439 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:07.774701 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1fb24e1a-3a76-401a-9eb6-783858467439 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.090826 Dec 15 13:05:07.775274 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1152/2320] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:07 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:05:08.791538 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f7d569ea-51ad-4c87-bfbe-c23ae68793b1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:08.792112 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f7d569ea-51ad-4c87-bfbe-c23ae68793b1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:08.798496 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f7d569ea-51ad-4c87-bfbe-c23ae68793b1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:08.799729 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f7d569ea-51ad-4c87-bfbe-c23ae68793b1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:08.800751 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f7d569ea-51ad-4c87-bfbe-c23ae68793b1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:08.801200 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f7d569ea-51ad-4c87-bfbe-c23ae68793b1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:08.860756 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f7d569ea-51ad-4c87-bfbe-c23ae68793b1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:08.869365 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f7d569ea-51ad-4c87-bfbe-c23ae68793b1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081542 Dec 15 13:05:08.869949 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1169/2321] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:08 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:09.886169 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-35103788-3ade-41b4-b32a-6ab0475cad21 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:09.887031 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-35103788-3ade-41b4-b32a-6ab0475cad21 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:09.894255 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-35103788-3ade-41b4-b32a-6ab0475cad21 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:09.894706 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-35103788-3ade-41b4-b32a-6ab0475cad21 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:09.895505 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-35103788-3ade-41b4-b32a-6ab0475cad21 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:09.895951 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-35103788-3ade-41b4-b32a-6ab0475cad21 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:09.956183 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-35103788-3ade-41b4-b32a-6ab0475cad21 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:09.964012 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-35103788-3ade-41b4-b32a-6ab0475cad21 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081623 Dec 15 13:05:09.964585 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1153/2322] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:09 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:10.981389 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-331c72e1-a762-4a32-973c-2ceb0b8d103b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:10.982043 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-331c72e1-a762-4a32-973c-2ceb0b8d103b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:10.989711 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-331c72e1-a762-4a32-973c-2ceb0b8d103b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:10.990169 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-331c72e1-a762-4a32-973c-2ceb0b8d103b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:10.990983 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-331c72e1-a762-4a32-973c-2ceb0b8d103b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:10.991425 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-331c72e1-a762-4a32-973c-2ceb0b8d103b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:11.051462 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-331c72e1-a762-4a32-973c-2ceb0b8d103b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:11.059441 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-331c72e1-a762-4a32-973c-2ceb0b8d103b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081728 Dec 15 13:05:11.060005 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1170/2323] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:10 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:12.077911 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5f9e5a7a-3eeb-49b6-a132-0d527e7e5f30 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:12.078529 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5f9e5a7a-3eeb-49b6-a132-0d527e7e5f30 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:12.084797 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5f9e5a7a-3eeb-49b6-a132-0d527e7e5f30 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:12.085246 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5f9e5a7a-3eeb-49b6-a132-0d527e7e5f30 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:12.086063 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5f9e5a7a-3eeb-49b6-a132-0d527e7e5f30 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:12.086500 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5f9e5a7a-3eeb-49b6-a132-0d527e7e5f30 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:12.147977 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5f9e5a7a-3eeb-49b6-a132-0d527e7e5f30 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:12.155796 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5f9e5a7a-3eeb-49b6-a132-0d527e7e5f30 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081881 Dec 15 13:05:12.156364 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1154/2324] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:12 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:13.172664 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d6ec49e0-7818-40ab-8edd-ffafee30b53d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:13.173382 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d6ec49e0-7818-40ab-8edd-ffafee30b53d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:13.180001 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d6ec49e0-7818-40ab-8edd-ffafee30b53d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:13.180446 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d6ec49e0-7818-40ab-8edd-ffafee30b53d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:13.181233 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d6ec49e0-7818-40ab-8edd-ffafee30b53d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:13.181700 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d6ec49e0-7818-40ab-8edd-ffafee30b53d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:13.243662 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d6ec49e0-7818-40ab-8edd-ffafee30b53d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:13.252649 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d6ec49e0-7818-40ab-8edd-ffafee30b53d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.083069 Dec 15 13:05:13.253236 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1171/2325] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:13 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:14.271185 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0fa14332-e288-488d-871e-5b1adad7e0ef tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:14.271870 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0fa14332-e288-488d-871e-5b1adad7e0ef tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:14.278700 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0fa14332-e288-488d-871e-5b1adad7e0ef tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:14.279147 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0fa14332-e288-488d-871e-5b1adad7e0ef tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:14.279939 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0fa14332-e288-488d-871e-5b1adad7e0ef tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:14.280382 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0fa14332-e288-488d-871e-5b1adad7e0ef tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:14.343941 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0fa14332-e288-488d-871e-5b1adad7e0ef tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:14.352547 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0fa14332-e288-488d-871e-5b1adad7e0ef tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.085497 Dec 15 13:05:14.353117 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1155/2326] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:14 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:15.369108 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3fe5ea66-f9d8-4ae4-a7ff-d627ef651c7d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:15.369790 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3fe5ea66-f9d8-4ae4-a7ff-d627ef651c7d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:15.376536 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3fe5ea66-f9d8-4ae4-a7ff-d627ef651c7d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:15.378004 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3fe5ea66-f9d8-4ae4-a7ff-d627ef651c7d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:15.378816 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3fe5ea66-f9d8-4ae4-a7ff-d627ef651c7d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:15.379259 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3fe5ea66-f9d8-4ae4-a7ff-d627ef651c7d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:15.439347 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3fe5ea66-f9d8-4ae4-a7ff-d627ef651c7d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:15.447782 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3fe5ea66-f9d8-4ae4-a7ff-d627ef651c7d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.082511 Dec 15 13:05:15.448350 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1172/2327] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:15 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:16.464942 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a056a1d2-cae1-486a-b34e-d5b82ae75e2d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:16.465547 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a056a1d2-cae1-486a-b34e-d5b82ae75e2d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:16.472376 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a056a1d2-cae1-486a-b34e-d5b82ae75e2d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:16.472830 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a056a1d2-cae1-486a-b34e-d5b82ae75e2d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:16.473668 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a056a1d2-cae1-486a-b34e-d5b82ae75e2d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:16.474100 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a056a1d2-cae1-486a-b34e-d5b82ae75e2d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:16.533114 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a056a1d2-cae1-486a-b34e-d5b82ae75e2d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:16.541121 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a056a1d2-cae1-486a-b34e-d5b82ae75e2d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.080027 Dec 15 13:05:16.541712 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1156/2328] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:16 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:17.558344 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1ca1e756-7788-4536-86be-a0bc1b5055ee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:17.558904 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1ca1e756-7788-4536-86be-a0bc1b5055ee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:17.565197 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ca1e756-7788-4536-86be-a0bc1b5055ee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:17.565682 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ca1e756-7788-4536-86be-a0bc1b5055ee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:17.566467 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ca1e756-7788-4536-86be-a0bc1b5055ee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:17.566905 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ca1e756-7788-4536-86be-a0bc1b5055ee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:17.625653 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1ca1e756-7788-4536-86be-a0bc1b5055ee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:17.633951 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1ca1e756-7788-4536-86be-a0bc1b5055ee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.079320 Dec 15 13:05:17.634513 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1173/2329] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:17 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:18.651501 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b61ba533-1992-4590-82c9-75084a63e252 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:18.652128 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b61ba533-1992-4590-82c9-75084a63e252 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:18.658816 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b61ba533-1992-4590-82c9-75084a63e252 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:18.659371 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b61ba533-1992-4590-82c9-75084a63e252 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:18.660237 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b61ba533-1992-4590-82c9-75084a63e252 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:18.660703 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b61ba533-1992-4590-82c9-75084a63e252 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:18.723071 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b61ba533-1992-4590-82c9-75084a63e252 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:18.730874 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b61ba533-1992-4590-82c9-75084a63e252 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.083157 Dec 15 13:05:18.731440 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1157/2330] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:18 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:19.748329 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6e60ba51-b2a6-48ae-8ce9-61e3f45f3006 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:19.748949 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6e60ba51-b2a6-48ae-8ce9-61e3f45f3006 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:19.755153 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e60ba51-b2a6-48ae-8ce9-61e3f45f3006 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:19.755635 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e60ba51-b2a6-48ae-8ce9-61e3f45f3006 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:19.756399 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e60ba51-b2a6-48ae-8ce9-61e3f45f3006 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:19.756829 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e60ba51-b2a6-48ae-8ce9-61e3f45f3006 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:19.816008 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6e60ba51-b2a6-48ae-8ce9-61e3f45f3006 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:19.823850 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6e60ba51-b2a6-48ae-8ce9-61e3f45f3006 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.079320 Dec 15 13:05:19.824416 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1174/2331] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:19 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:20.840486 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-82f4676d-19aa-419a-a92c-8e8a72015e74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:20.841128 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-82f4676d-19aa-419a-a92c-8e8a72015e74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:20.847662 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-82f4676d-19aa-419a-a92c-8e8a72015e74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:20.848108 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-82f4676d-19aa-419a-a92c-8e8a72015e74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:20.848878 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-82f4676d-19aa-419a-a92c-8e8a72015e74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:20.849304 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-82f4676d-19aa-419a-a92c-8e8a72015e74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:20.912382 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-82f4676d-19aa-419a-a92c-8e8a72015e74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:20.920055 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-82f4676d-19aa-419a-a92c-8e8a72015e74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.083253 Dec 15 13:05:20.920638 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1158/2332] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:20 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:21.936205 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4d61c73b-953f-4616-a0ba-1f3ea31d9c49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:21.936998 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4d61c73b-953f-4616-a0ba-1f3ea31d9c49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:21.943145 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4d61c73b-953f-4616-a0ba-1f3ea31d9c49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:21.943598 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4d61c73b-953f-4616-a0ba-1f3ea31d9c49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:21.944378 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4d61c73b-953f-4616-a0ba-1f3ea31d9c49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:21.944816 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4d61c73b-953f-4616-a0ba-1f3ea31d9c49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:22.004453 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4d61c73b-953f-4616-a0ba-1f3ea31d9c49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:22.012497 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4d61c73b-953f-4616-a0ba-1f3ea31d9c49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.080146 Dec 15 13:05:22.013060 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1175/2333] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:21 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:23.029868 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0ca409e3-e5e1-4f26-8642-3aab371efeb7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:23.030481 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0ca409e3-e5e1-4f26-8642-3aab371efeb7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:23.037472 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0ca409e3-e5e1-4f26-8642-3aab371efeb7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:23.038017 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0ca409e3-e5e1-4f26-8642-3aab371efeb7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:23.038813 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0ca409e3-e5e1-4f26-8642-3aab371efeb7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:23.039246 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0ca409e3-e5e1-4f26-8642-3aab371efeb7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:23.100454 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0ca409e3-e5e1-4f26-8642-3aab371efeb7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:23.108283 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0ca409e3-e5e1-4f26-8642-3aab371efeb7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081999 Dec 15 13:05:23.108846 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1159/2334] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:23 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:24.125888 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b7cdbd65-4ad8-42c0-8b06-f531e5f57857 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:24.126489 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b7cdbd65-4ad8-42c0-8b06-f531e5f57857 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:24.132769 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b7cdbd65-4ad8-42c0-8b06-f531e5f57857 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:24.133228 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b7cdbd65-4ad8-42c0-8b06-f531e5f57857 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:24.134040 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b7cdbd65-4ad8-42c0-8b06-f531e5f57857 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:24.134474 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b7cdbd65-4ad8-42c0-8b06-f531e5f57857 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:24.194140 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b7cdbd65-4ad8-42c0-8b06-f531e5f57857 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:24.201814 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b7cdbd65-4ad8-42c0-8b06-f531e5f57857 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.079590 Dec 15 13:05:24.202368 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1176/2335] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:24 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:25.219279 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b6589981-02b1-458d-aedf-e2df7cccd2fc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:25.220907 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b6589981-02b1-458d-aedf-e2df7cccd2fc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:25.227453 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b6589981-02b1-458d-aedf-e2df7cccd2fc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:25.227904 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b6589981-02b1-458d-aedf-e2df7cccd2fc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:25.228742 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b6589981-02b1-458d-aedf-e2df7cccd2fc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:25.229180 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b6589981-02b1-458d-aedf-e2df7cccd2fc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:25.288833 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b6589981-02b1-458d-aedf-e2df7cccd2fc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:25.296668 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b6589981-02b1-458d-aedf-e2df7cccd2fc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081180 Dec 15 13:05:25.297242 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1160/2336] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:25 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:26.312938 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5643312c-843f-48e1-91c9-37a6a1f4a721 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:26.313578 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5643312c-843f-48e1-91c9-37a6a1f4a721 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:26.321052 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5643312c-843f-48e1-91c9-37a6a1f4a721 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:26.321495 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5643312c-843f-48e1-91c9-37a6a1f4a721 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:26.322317 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5643312c-843f-48e1-91c9-37a6a1f4a721 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:26.322747 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5643312c-843f-48e1-91c9-37a6a1f4a721 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:26.390872 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5643312c-843f-48e1-91c9-37a6a1f4a721 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:26.399324 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5643312c-843f-48e1-91c9-37a6a1f4a721 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.089906 Dec 15 13:05:26.399912 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1177/2337] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:26 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:27.416346 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-249d8a49-a181-4d5e-b8bc-d2cab26f9333 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:27.416963 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-249d8a49-a181-4d5e-b8bc-d2cab26f9333 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:27.423229 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-249d8a49-a181-4d5e-b8bc-d2cab26f9333 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:27.424492 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-249d8a49-a181-4d5e-b8bc-d2cab26f9333 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:27.425134 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-249d8a49-a181-4d5e-b8bc-d2cab26f9333 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:27.425586 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-249d8a49-a181-4d5e-b8bc-d2cab26f9333 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:27.488832 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-249d8a49-a181-4d5e-b8bc-d2cab26f9333 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:27.496641 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-249d8a49-a181-4d5e-b8bc-d2cab26f9333 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.084185 Dec 15 13:05:27.497194 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1161/2338] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:27 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:28.513968 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-237e2077-c3c0-48ed-988c-9a022c87b5c7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:28.514585 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-237e2077-c3c0-48ed-988c-9a022c87b5c7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:28.521044 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-237e2077-c3c0-48ed-988c-9a022c87b5c7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:28.521518 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-237e2077-c3c0-48ed-988c-9a022c87b5c7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:28.522318 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-237e2077-c3c0-48ed-988c-9a022c87b5c7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:28.522758 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-237e2077-c3c0-48ed-988c-9a022c87b5c7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:28.589555 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-237e2077-c3c0-48ed-988c-9a022c87b5c7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:28.597527 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-237e2077-c3c0-48ed-988c-9a022c87b5c7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.087674 Dec 15 13:05:28.598087 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1178/2339] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:28 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:29.615475 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-71e65cd4-bfa2-4166-8453-dd932bc251c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:29.616078 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-71e65cd4-bfa2-4166-8453-dd932bc251c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:29.622325 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-71e65cd4-bfa2-4166-8453-dd932bc251c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:29.622768 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-71e65cd4-bfa2-4166-8453-dd932bc251c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:29.623536 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-71e65cd4-bfa2-4166-8453-dd932bc251c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:29.623959 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-71e65cd4-bfa2-4166-8453-dd932bc251c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:29.687620 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-71e65cd4-bfa2-4166-8453-dd932bc251c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:29.696003 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-71e65cd4-bfa2-4166-8453-dd932bc251c8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.085134 Dec 15 13:05:29.696573 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1162/2340] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:29 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:30.716350 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-df061f3d-f318-4542-967e-131fe2927b05 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:30.716994 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-df061f3d-f318-4542-967e-131fe2927b05 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:30.723213 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df061f3d-f318-4542-967e-131fe2927b05 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:30.723655 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df061f3d-f318-4542-967e-131fe2927b05 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:30.724424 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df061f3d-f318-4542-967e-131fe2927b05 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:30.724858 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df061f3d-f318-4542-967e-131fe2927b05 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:30.785124 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-df061f3d-f318-4542-967e-131fe2927b05 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:30.792931 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-df061f3d-f318-4542-967e-131fe2927b05 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.080485 Dec 15 13:05:30.793500 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1179/2341] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:30 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:31.810070 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0703dad9-2a7e-4b01-b111-1c4cbcf07d47 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:31.810691 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0703dad9-2a7e-4b01-b111-1c4cbcf07d47 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:31.818221 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0703dad9-2a7e-4b01-b111-1c4cbcf07d47 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:31.818667 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0703dad9-2a7e-4b01-b111-1c4cbcf07d47 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:31.819486 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0703dad9-2a7e-4b01-b111-1c4cbcf07d47 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:31.819920 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0703dad9-2a7e-4b01-b111-1c4cbcf07d47 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:32.040800 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0703dad9-2a7e-4b01-b111-1c4cbcf07d47 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:32.051643 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0703dad9-2a7e-4b01-b111-1c4cbcf07d47 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.244795 Dec 15 13:05:32.052665 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1163/2342] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:31 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:33.069406 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fdcb17f7-a2a6-4e41-a8e3-dfc0f9e2f9cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:33.070054 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fdcb17f7-a2a6-4e41-a8e3-dfc0f9e2f9cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:33.076524 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fdcb17f7-a2a6-4e41-a8e3-dfc0f9e2f9cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:33.076978 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fdcb17f7-a2a6-4e41-a8e3-dfc0f9e2f9cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:33.077793 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fdcb17f7-a2a6-4e41-a8e3-dfc0f9e2f9cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:33.078236 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fdcb17f7-a2a6-4e41-a8e3-dfc0f9e2f9cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:33.137918 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-fdcb17f7-a2a6-4e41-a8e3-dfc0f9e2f9cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:33.146291 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fdcb17f7-a2a6-4e41-a8e3-dfc0f9e2f9cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.080534 Dec 15 13:05:33.146904 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1180/2343] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:33 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:34.168555 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5817206a-e7ec-4a1a-81e5-f1022eae4e58 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:34.169166 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5817206a-e7ec-4a1a-81e5-f1022eae4e58 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:34.175886 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5817206a-e7ec-4a1a-81e5-f1022eae4e58 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:34.176333 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5817206a-e7ec-4a1a-81e5-f1022eae4e58 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:34.177648 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5817206a-e7ec-4a1a-81e5-f1022eae4e58 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:34.178080 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5817206a-e7ec-4a1a-81e5-f1022eae4e58 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:34.251813 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5817206a-e7ec-4a1a-81e5-f1022eae4e58 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:34.262939 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5817206a-e7ec-4a1a-81e5-f1022eae4e58 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.101590 Dec 15 13:05:34.263501 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1164/2344] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:34 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:35.279742 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-71e23ca9-6150-4569-9f09-7dbe3b9008cd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:35.280347 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-71e23ca9-6150-4569-9f09-7dbe3b9008cd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:35.287007 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-71e23ca9-6150-4569-9f09-7dbe3b9008cd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:35.287587 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-71e23ca9-6150-4569-9f09-7dbe3b9008cd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:35.288861 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-71e23ca9-6150-4569-9f09-7dbe3b9008cd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:35.288861 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-71e23ca9-6150-4569-9f09-7dbe3b9008cd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:35.350267 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-71e23ca9-6150-4569-9f09-7dbe3b9008cd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:35.358216 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-71e23ca9-6150-4569-9f09-7dbe3b9008cd tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.082129 Dec 15 13:05:35.358790 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1181/2345] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:35 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:36.375817 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7c63c20a-53e8-4caf-b2d0-357900674b7f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:36.376959 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7c63c20a-53e8-4caf-b2d0-357900674b7f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:36.383724 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7c63c20a-53e8-4caf-b2d0-357900674b7f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:36.384161 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7c63c20a-53e8-4caf-b2d0-357900674b7f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:36.384940 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7c63c20a-53e8-4caf-b2d0-357900674b7f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:36.385367 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7c63c20a-53e8-4caf-b2d0-357900674b7f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:36.444857 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7c63c20a-53e8-4caf-b2d0-357900674b7f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:36.452591 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7c63c20a-53e8-4caf-b2d0-357900674b7f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.080552 Dec 15 13:05:36.453133 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1165/2346] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:36 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:37.469691 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ae94095a-2ee5-4750-86a7-f7169260a54d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:37.470598 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ae94095a-2ee5-4750-86a7-f7169260a54d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:37.477866 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ae94095a-2ee5-4750-86a7-f7169260a54d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:37.478317 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ae94095a-2ee5-4750-86a7-f7169260a54d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:37.479106 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ae94095a-2ee5-4750-86a7-f7169260a54d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:37.479542 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ae94095a-2ee5-4750-86a7-f7169260a54d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:37.539813 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ae94095a-2ee5-4750-86a7-f7169260a54d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:37.548133 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ae94095a-2ee5-4750-86a7-f7169260a54d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.082287 Dec 15 13:05:37.549263 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1182/2347] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:37 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:38.566203 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c5842e1a-f1d5-4462-9665-58d949486355 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:38.566863 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c5842e1a-f1d5-4462-9665-58d949486355 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:38.573525 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c5842e1a-f1d5-4462-9665-58d949486355 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:38.573974 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c5842e1a-f1d5-4462-9665-58d949486355 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:38.574777 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c5842e1a-f1d5-4462-9665-58d949486355 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:38.575219 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c5842e1a-f1d5-4462-9665-58d949486355 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:38.634786 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c5842e1a-f1d5-4462-9665-58d949486355 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:38.642936 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c5842e1a-f1d5-4462-9665-58d949486355 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081331 Dec 15 13:05:38.643534 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1166/2348] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:38 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:39.660847 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-71b91ebc-77f5-41cd-829b-f06136cc7ce2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:39.661541 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-71b91ebc-77f5-41cd-829b-f06136cc7ce2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:39.668243 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-71b91ebc-77f5-41cd-829b-f06136cc7ce2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:39.668689 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-71b91ebc-77f5-41cd-829b-f06136cc7ce2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:39.669481 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-71b91ebc-77f5-41cd-829b-f06136cc7ce2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:39.669939 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-71b91ebc-77f5-41cd-829b-f06136cc7ce2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:39.730231 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-71b91ebc-77f5-41cd-829b-f06136cc7ce2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:39.738493 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-71b91ebc-77f5-41cd-829b-f06136cc7ce2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.082230 Dec 15 13:05:39.739048 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1183/2349] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:39 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:40.754035 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3ecf675b-a301-428f-877b-2817bda52c0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:40.754664 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3ecf675b-a301-428f-877b-2817bda52c0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:40.760978 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3ecf675b-a301-428f-877b-2817bda52c0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:40.761459 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3ecf675b-a301-428f-877b-2817bda52c0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:40.762635 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3ecf675b-a301-428f-877b-2817bda52c0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:40.763052 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3ecf675b-a301-428f-877b-2817bda52c0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:40.826938 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3ecf675b-a301-428f-877b-2817bda52c0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:40.836318 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3ecf675b-a301-428f-877b-2817bda52c0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.085953 Dec 15 13:05:40.836903 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1167/2350] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:40 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:41.854853 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-45cd115d-2920-449f-a8b3-c2ab38c86a90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:41.855499 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-45cd115d-2920-449f-a8b3-c2ab38c86a90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:41.862515 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-45cd115d-2920-449f-a8b3-c2ab38c86a90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:41.862975 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-45cd115d-2920-449f-a8b3-c2ab38c86a90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:41.863817 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-45cd115d-2920-449f-a8b3-c2ab38c86a90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:41.864251 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-45cd115d-2920-449f-a8b3-c2ab38c86a90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:41.924446 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-45cd115d-2920-449f-a8b3-c2ab38c86a90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:41.932217 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-45cd115d-2920-449f-a8b3-c2ab38c86a90 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081024 Dec 15 13:05:41.932771 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1184/2351] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:41 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:42.949240 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9b51a9ac-c30c-4aad-854d-0b8635cb8821 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:42.949874 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9b51a9ac-c30c-4aad-854d-0b8635cb8821 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:42.963509 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9b51a9ac-c30c-4aad-854d-0b8635cb8821 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:42.963995 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9b51a9ac-c30c-4aad-854d-0b8635cb8821 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:42.964789 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9b51a9ac-c30c-4aad-854d-0b8635cb8821 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:42.965228 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9b51a9ac-c30c-4aad-854d-0b8635cb8821 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:43.027699 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9b51a9ac-c30c-4aad-854d-0b8635cb8821 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:43.036219 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9b51a9ac-c30c-4aad-854d-0b8635cb8821 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.090652 Dec 15 13:05:43.036777 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1168/2352] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:42 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:44.052165 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e879258c-b53d-4e73-b5ad-225bf28d1b60 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:44.052795 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e879258c-b53d-4e73-b5ad-225bf28d1b60 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:44.059668 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e879258c-b53d-4e73-b5ad-225bf28d1b60 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:44.060111 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e879258c-b53d-4e73-b5ad-225bf28d1b60 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:44.060925 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e879258c-b53d-4e73-b5ad-225bf28d1b60 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:44.061360 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e879258c-b53d-4e73-b5ad-225bf28d1b60 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:44.128923 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e879258c-b53d-4e73-b5ad-225bf28d1b60 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:44.137083 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e879258c-b53d-4e73-b5ad-225bf28d1b60 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.088370 Dec 15 13:05:44.137676 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1185/2353] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:44 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:45.153495 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-63e004ee-5f4e-44ac-a953-3ddfe2c75105 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:45.154140 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-63e004ee-5f4e-44ac-a953-3ddfe2c75105 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:45.160670 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-63e004ee-5f4e-44ac-a953-3ddfe2c75105 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:45.161121 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-63e004ee-5f4e-44ac-a953-3ddfe2c75105 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:45.161935 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-63e004ee-5f4e-44ac-a953-3ddfe2c75105 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:45.162375 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-63e004ee-5f4e-44ac-a953-3ddfe2c75105 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:45.224287 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-63e004ee-5f4e-44ac-a953-3ddfe2c75105 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:45.231963 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-63e004ee-5f4e-44ac-a953-3ddfe2c75105 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.082160 Dec 15 13:05:45.232523 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1169/2354] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:45 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:46.248530 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bb5a42c7-ecb7-467e-84ab-655a52726165 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:46.249148 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bb5a42c7-ecb7-467e-84ab-655a52726165 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:46.256576 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bb5a42c7-ecb7-467e-84ab-655a52726165 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:46.257311 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bb5a42c7-ecb7-467e-84ab-655a52726165 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:46.258125 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bb5a42c7-ecb7-467e-84ab-655a52726165 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:46.258655 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bb5a42c7-ecb7-467e-84ab-655a52726165 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:46.320416 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-bb5a42c7-ecb7-467e-84ab-655a52726165 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:46.328059 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bb5a42c7-ecb7-467e-84ab-655a52726165 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.083244 Dec 15 13:05:46.328678 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1186/2355] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:46 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:47.346017 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-87882550-540b-4838-bb1e-45067b8381cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:47.346674 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-87882550-540b-4838-bb1e-45067b8381cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:47.353152 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-87882550-540b-4838-bb1e-45067b8381cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:47.353618 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-87882550-540b-4838-bb1e-45067b8381cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:47.354410 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-87882550-540b-4838-bb1e-45067b8381cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:47.354838 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-87882550-540b-4838-bb1e-45067b8381cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:47.418196 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-87882550-540b-4838-bb1e-45067b8381cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:47.426185 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-87882550-540b-4838-bb1e-45067b8381cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.084551 Dec 15 13:05:47.426749 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1170/2356] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:47 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:48.443507 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b5e87577-1de3-489d-a805-9607ecfed80a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:48.444133 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b5e87577-1de3-489d-a805-9607ecfed80a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:48.450662 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5e87577-1de3-489d-a805-9607ecfed80a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:48.451057 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5e87577-1de3-489d-a805-9607ecfed80a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:48.451832 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5e87577-1de3-489d-a805-9607ecfed80a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:48.452274 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5e87577-1de3-489d-a805-9607ecfed80a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:48.511172 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b5e87577-1de3-489d-a805-9607ecfed80a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:48.520022 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b5e87577-1de3-489d-a805-9607ecfed80a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.080240 Dec 15 13:05:48.520577 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1187/2357] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:48 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:49.536730 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7bef2b0d-2517-4111-ac2d-09dfed98d7b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:49.537665 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7bef2b0d-2517-4111-ac2d-09dfed98d7b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:49.543563 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7bef2b0d-2517-4111-ac2d-09dfed98d7b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:49.544005 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7bef2b0d-2517-4111-ac2d-09dfed98d7b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:49.544776 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7bef2b0d-2517-4111-ac2d-09dfed98d7b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:49.545210 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7bef2b0d-2517-4111-ac2d-09dfed98d7b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:49.604737 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7bef2b0d-2517-4111-ac2d-09dfed98d7b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:49.613253 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7bef2b0d-2517-4111-ac2d-09dfed98d7b8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.080506 Dec 15 13:05:49.613852 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1171/2358] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:49 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:50.630857 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e74c71a6-7960-4ddf-9aa4-e0ec7c9c8728 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:50.631471 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e74c71a6-7960-4ddf-9aa4-e0ec7c9c8728 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:50.638024 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e74c71a6-7960-4ddf-9aa4-e0ec7c9c8728 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:50.638474 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e74c71a6-7960-4ddf-9aa4-e0ec7c9c8728 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:50.639246 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e74c71a6-7960-4ddf-9aa4-e0ec7c9c8728 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:50.639677 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e74c71a6-7960-4ddf-9aa4-e0ec7c9c8728 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:50.703309 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e74c71a6-7960-4ddf-9aa4-e0ec7c9c8728 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:50.712065 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e74c71a6-7960-4ddf-9aa4-e0ec7c9c8728 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.085830 Dec 15 13:05:50.712655 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1188/2359] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:50 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:51.728971 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-066cf65a-2200-4025-99f1-d7209e41ddc7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:51.729619 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-066cf65a-2200-4025-99f1-d7209e41ddc7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:51.736486 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-066cf65a-2200-4025-99f1-d7209e41ddc7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:51.736919 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-066cf65a-2200-4025-99f1-d7209e41ddc7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:51.737717 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-066cf65a-2200-4025-99f1-d7209e41ddc7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:51.738144 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-066cf65a-2200-4025-99f1-d7209e41ddc7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:51.796306 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-066cf65a-2200-4025-99f1-d7209e41ddc7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:51.804575 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-066cf65a-2200-4025-99f1-d7209e41ddc7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.079207 Dec 15 13:05:51.805132 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1172/2360] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:51 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:52.821778 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8fa77983-1130-4616-a246-40524640010d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:52.822394 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8fa77983-1130-4616-a246-40524640010d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:52.829338 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8fa77983-1130-4616-a246-40524640010d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:52.829975 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8fa77983-1130-4616-a246-40524640010d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:52.831033 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8fa77983-1130-4616-a246-40524640010d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:52.831481 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8fa77983-1130-4616-a246-40524640010d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:52.891982 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-8fa77983-1130-4616-a246-40524640010d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:52.899904 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8fa77983-1130-4616-a246-40524640010d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081798 Dec 15 13:05:52.900598 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1189/2361] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:52 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:53.917356 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-62437562-0724-4666-a002-489410d18c51 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:53.917995 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-62437562-0724-4666-a002-489410d18c51 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:53.924729 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-62437562-0724-4666-a002-489410d18c51 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:53.925176 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-62437562-0724-4666-a002-489410d18c51 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:53.925997 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-62437562-0724-4666-a002-489410d18c51 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:53.926430 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-62437562-0724-4666-a002-489410d18c51 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:53.989330 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-62437562-0724-4666-a002-489410d18c51 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:53.997492 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-62437562-0724-4666-a002-489410d18c51 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.083755 Dec 15 13:05:53.998092 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1173/2362] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:53 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:55.015158 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ce1765fb-9cf9-4357-bbdc-1d4fd4658413 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:55.015845 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ce1765fb-9cf9-4357-bbdc-1d4fd4658413 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:55.022589 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce1765fb-9cf9-4357-bbdc-1d4fd4658413 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:55.023046 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce1765fb-9cf9-4357-bbdc-1d4fd4658413 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:55.023870 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce1765fb-9cf9-4357-bbdc-1d4fd4658413 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:55.024314 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ce1765fb-9cf9-4357-bbdc-1d4fd4658413 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:55.083888 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ce1765fb-9cf9-4357-bbdc-1d4fd4658413 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:55.091530 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ce1765fb-9cf9-4357-bbdc-1d4fd4658413 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.080423 Dec 15 13:05:55.092084 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1190/2363] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:55 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:56.108321 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6eaacd45-30f5-414d-86e6-e3cd5801731c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:56.108937 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6eaacd45-30f5-414d-86e6-e3cd5801731c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:56.115546 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6eaacd45-30f5-414d-86e6-e3cd5801731c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:56.115999 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6eaacd45-30f5-414d-86e6-e3cd5801731c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:56.116896 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6eaacd45-30f5-414d-86e6-e3cd5801731c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:56.117219 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6eaacd45-30f5-414d-86e6-e3cd5801731c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:56.176798 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6eaacd45-30f5-414d-86e6-e3cd5801731c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:56.184628 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6eaacd45-30f5-414d-86e6-e3cd5801731c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.079973 Dec 15 13:05:56.185186 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1174/2364] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:56 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:57.201209 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-71632fb7-3463-47ef-a8ae-fe86990f1ffb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:57.201862 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-71632fb7-3463-47ef-a8ae-fe86990f1ffb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:57.208738 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-71632fb7-3463-47ef-a8ae-fe86990f1ffb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:57.209184 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-71632fb7-3463-47ef-a8ae-fe86990f1ffb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:57.209988 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-71632fb7-3463-47ef-a8ae-fe86990f1ffb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:57.210425 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-71632fb7-3463-47ef-a8ae-fe86990f1ffb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:57.270557 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-71632fb7-3463-47ef-a8ae-fe86990f1ffb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:57.278326 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-71632fb7-3463-47ef-a8ae-fe86990f1ffb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.080717 Dec 15 13:05:57.278885 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1191/2365] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:57 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:58.300971 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3170fcf7-5690-424f-ab53-73f779aa4987 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:58.302126 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3170fcf7-5690-424f-ab53-73f779aa4987 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:58.312189 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3170fcf7-5690-424f-ab53-73f779aa4987 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:58.312998 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3170fcf7-5690-424f-ab53-73f779aa4987 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:58.315074 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3170fcf7-5690-424f-ab53-73f779aa4987 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:58.315864 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3170fcf7-5690-424f-ab53-73f779aa4987 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:58.381321 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3170fcf7-5690-424f-ab53-73f779aa4987 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:58.390159 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3170fcf7-5690-424f-ab53-73f779aa4987 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.097504 Dec 15 13:05:58.390725 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1175/2366] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:58 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:05:59.408913 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-53adf886-3dbc-40c5-ad26-7998917c025f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:05:59.409548 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-53adf886-3dbc-40c5-ad26-7998917c025f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:05:59.417240 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-53adf886-3dbc-40c5-ad26-7998917c025f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:59.417898 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-53adf886-3dbc-40c5-ad26-7998917c025f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:59.418735 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-53adf886-3dbc-40c5-ad26-7998917c025f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:05:59.419193 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-53adf886-3dbc-40c5-ad26-7998917c025f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:05:59.479843 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-53adf886-3dbc-40c5-ad26-7998917c025f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:05:59.487782 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-53adf886-3dbc-40c5-ad26-7998917c025f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.084084 Dec 15 13:05:59.488345 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1192/2367] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:05:59 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:00.504589 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-af3ffd98-d6b0-4894-a949-0722843d89cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:00.505141 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-af3ffd98-d6b0-4894-a949-0722843d89cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:00.511563 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-af3ffd98-d6b0-4894-a949-0722843d89cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:00.512277 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-af3ffd98-d6b0-4894-a949-0722843d89cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:00.513077 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-af3ffd98-d6b0-4894-a949-0722843d89cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:00.513534 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-af3ffd98-d6b0-4894-a949-0722843d89cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:00.576421 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-af3ffd98-d6b0-4894-a949-0722843d89cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:00.584863 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-af3ffd98-d6b0-4894-a949-0722843d89cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.084581 Dec 15 13:06:00.585416 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1176/2368] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:00 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:01.601845 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4d83539c-cef1-45db-b21f-0c21d97765cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:01.602419 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4d83539c-cef1-45db-b21f-0c21d97765cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:01.608596 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4d83539c-cef1-45db-b21f-0c21d97765cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:01.609041 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4d83539c-cef1-45db-b21f-0c21d97765cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:01.610221 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4d83539c-cef1-45db-b21f-0c21d97765cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:01.610456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4d83539c-cef1-45db-b21f-0c21d97765cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:01.670149 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4d83539c-cef1-45db-b21f-0c21d97765cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:01.678246 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4d83539c-cef1-45db-b21f-0c21d97765cb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.080278 Dec 15 13:06:01.678814 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1193/2369] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:01 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:02.695604 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6303fe5c-558d-4db5-bf4f-46729025bfc3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:02.696225 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6303fe5c-558d-4db5-bf4f-46729025bfc3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:02.703094 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6303fe5c-558d-4db5-bf4f-46729025bfc3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:02.703583 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6303fe5c-558d-4db5-bf4f-46729025bfc3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:02.705311 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6303fe5c-558d-4db5-bf4f-46729025bfc3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:02.705846 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6303fe5c-558d-4db5-bf4f-46729025bfc3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:02.765904 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6303fe5c-558d-4db5-bf4f-46729025bfc3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:02.773961 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6303fe5c-558d-4db5-bf4f-46729025bfc3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.082077 Dec 15 13:06:02.774520 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1177/2370] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:02 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:03.793772 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-908304f6-5cda-46b6-b4eb-929dc59b71ce tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:03.794384 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-908304f6-5cda-46b6-b4eb-929dc59b71ce tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:03.802233 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-908304f6-5cda-46b6-b4eb-929dc59b71ce tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:03.802675 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-908304f6-5cda-46b6-b4eb-929dc59b71ce tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:03.803456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-908304f6-5cda-46b6-b4eb-929dc59b71ce tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:03.803885 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-908304f6-5cda-46b6-b4eb-929dc59b71ce tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:03.864818 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-908304f6-5cda-46b6-b4eb-929dc59b71ce tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:03.872571 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-908304f6-5cda-46b6-b4eb-929dc59b71ce tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.082540 Dec 15 13:06:03.873124 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1194/2371] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:03 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:04.890099 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-964fbf8f-39cd-44df-b580-e00ac780670d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:04.890709 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-964fbf8f-39cd-44df-b580-e00ac780670d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:04.896968 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-964fbf8f-39cd-44df-b580-e00ac780670d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:04.897420 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-964fbf8f-39cd-44df-b580-e00ac780670d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:04.898229 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-964fbf8f-39cd-44df-b580-e00ac780670d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:04.898663 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-964fbf8f-39cd-44df-b580-e00ac780670d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:04.959803 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-964fbf8f-39cd-44df-b580-e00ac780670d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:04.967471 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-964fbf8f-39cd-44df-b580-e00ac780670d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081349 Dec 15 13:06:04.968034 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1178/2372] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:04 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:05.984079 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5a2e8bf1-d255-4ca0-ad50-37e8a138f83e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:05.984695 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5a2e8bf1-d255-4ca0-ad50-37e8a138f83e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:05.991255 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5a2e8bf1-d255-4ca0-ad50-37e8a138f83e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:05.991694 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5a2e8bf1-d255-4ca0-ad50-37e8a138f83e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:05.992456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5a2e8bf1-d255-4ca0-ad50-37e8a138f83e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:05.992911 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5a2e8bf1-d255-4ca0-ad50-37e8a138f83e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:06.053928 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5a2e8bf1-d255-4ca0-ad50-37e8a138f83e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:06.061591 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5a2e8bf1-d255-4ca0-ad50-37e8a138f83e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081206 Dec 15 13:06:06.062155 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1195/2373] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:05 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:07.079947 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e3bc910d-780e-4df0-b3ac-0f4f1bd62d85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:07.080590 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e3bc910d-780e-4df0-b3ac-0f4f1bd62d85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:07.086856 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e3bc910d-780e-4df0-b3ac-0f4f1bd62d85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:07.087294 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e3bc910d-780e-4df0-b3ac-0f4f1bd62d85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:07.088061 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e3bc910d-780e-4df0-b3ac-0f4f1bd62d85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:07.088488 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e3bc910d-780e-4df0-b3ac-0f4f1bd62d85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:07.150843 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e3bc910d-780e-4df0-b3ac-0f4f1bd62d85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:07.158934 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e3bc910d-780e-4df0-b3ac-0f4f1bd62d85 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.083385 Dec 15 13:06:07.159505 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1179/2374] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:07 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:08.175519 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f9a29fa2-63b0-4aff-9c41-65c1622ed35d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:08.176430 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f9a29fa2-63b0-4aff-9c41-65c1622ed35d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:08.182732 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f9a29fa2-63b0-4aff-9c41-65c1622ed35d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:08.183180 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f9a29fa2-63b0-4aff-9c41-65c1622ed35d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:08.183953 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f9a29fa2-63b0-4aff-9c41-65c1622ed35d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:08.184383 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f9a29fa2-63b0-4aff-9c41-65c1622ed35d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:08.242736 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f9a29fa2-63b0-4aff-9c41-65c1622ed35d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:08.250551 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f9a29fa2-63b0-4aff-9c41-65c1622ed35d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.078720 Dec 15 13:06:08.251207 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1196/2375] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:08 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:08.796304 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:06:08.796894 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 13:06:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:06:09.267645 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-34377191-d05e-4d59-af2a-ca845a1956b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:09.268254 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-34377191-d05e-4d59-af2a-ca845a1956b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:09.274606 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-34377191-d05e-4d59-af2a-ca845a1956b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:09.275058 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-34377191-d05e-4d59-af2a-ca845a1956b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:09.275863 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-34377191-d05e-4d59-af2a-ca845a1956b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:09.276308 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-34377191-d05e-4d59-af2a-ca845a1956b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:09.336707 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-34377191-d05e-4d59-af2a-ca845a1956b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:09.344959 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-34377191-d05e-4d59-af2a-ca845a1956b2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.080605 Dec 15 13:06:09.345645 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1180/2376] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:09 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:10.362935 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7d913af4-7e23-452d-bc02-7c274108bb36 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:10.363564 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7d913af4-7e23-452d-bc02-7c274108bb36 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:10.369775 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7d913af4-7e23-452d-bc02-7c274108bb36 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:10.370223 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7d913af4-7e23-452d-bc02-7c274108bb36 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:10.370985 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7d913af4-7e23-452d-bc02-7c274108bb36 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:10.371415 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7d913af4-7e23-452d-bc02-7c274108bb36 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:10.432029 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7d913af4-7e23-452d-bc02-7c274108bb36 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:10.440662 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7d913af4-7e23-452d-bc02-7c274108bb36 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081892 Dec 15 13:06:10.441234 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1197/2377] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:10 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:11.458092 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-162a134e-3f01-49ca-b695-a4173471a26e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:11.458701 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-162a134e-3f01-49ca-b695-a4173471a26e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:11.465058 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-162a134e-3f01-49ca-b695-a4173471a26e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:11.465524 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-162a134e-3f01-49ca-b695-a4173471a26e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:11.466349 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-162a134e-3f01-49ca-b695-a4173471a26e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:11.466752 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-162a134e-3f01-49ca-b695-a4173471a26e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:11.527224 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-162a134e-3f01-49ca-b695-a4173471a26e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:11.535747 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-162a134e-3f01-49ca-b695-a4173471a26e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081353 Dec 15 13:06:11.536312 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1181/2378] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:11 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:12.552721 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7a549c64-402b-4bb0-8401-fbde2891d955 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:12.553299 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7a549c64-402b-4bb0-8401-fbde2891d955 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:12.559553 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7a549c64-402b-4bb0-8401-fbde2891d955 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:12.560007 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7a549c64-402b-4bb0-8401-fbde2891d955 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:12.560789 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7a549c64-402b-4bb0-8401-fbde2891d955 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:12.561227 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7a549c64-402b-4bb0-8401-fbde2891d955 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:12.620210 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7a549c64-402b-4bb0-8401-fbde2891d955 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:12.628538 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7a549c64-402b-4bb0-8401-fbde2891d955 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.079741 Dec 15 13:06:12.629112 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1198/2379] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:12 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:13.646870 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3d61f753-0841-406d-b827-9032b2871ea8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:13.647491 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3d61f753-0841-406d-b827-9032b2871ea8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:13.653911 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3d61f753-0841-406d-b827-9032b2871ea8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:13.654363 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3d61f753-0841-406d-b827-9032b2871ea8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:13.655148 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3d61f753-0841-406d-b827-9032b2871ea8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:13.655582 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3d61f753-0841-406d-b827-9032b2871ea8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:13.718474 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3d61f753-0841-406d-b827-9032b2871ea8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:13.726325 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3d61f753-0841-406d-b827-9032b2871ea8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.083380 Dec 15 13:06:13.726880 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1182/2380] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:13 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:14.743092 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-68fd7066-85d6-406a-b02c-91cb3b3bb186 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:14.743770 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-68fd7066-85d6-406a-b02c-91cb3b3bb186 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:14.751286 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-68fd7066-85d6-406a-b02c-91cb3b3bb186 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:14.752426 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-68fd7066-85d6-406a-b02c-91cb3b3bb186 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:14.752596 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-68fd7066-85d6-406a-b02c-91cb3b3bb186 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:14.753500 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-68fd7066-85d6-406a-b02c-91cb3b3bb186 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:14.812901 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-68fd7066-85d6-406a-b02c-91cb3b3bb186 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:14.821419 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-68fd7066-85d6-406a-b02c-91cb3b3bb186 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081944 Dec 15 13:06:14.822013 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1199/2381] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:14 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:15.838197 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-399869a3-033e-4251-a8ed-9dd8243ad0b0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:15.838833 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-399869a3-033e-4251-a8ed-9dd8243ad0b0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:15.846073 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-399869a3-033e-4251-a8ed-9dd8243ad0b0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:15.846779 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-399869a3-033e-4251-a8ed-9dd8243ad0b0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:15.847556 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-399869a3-033e-4251-a8ed-9dd8243ad0b0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:15.847985 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-399869a3-033e-4251-a8ed-9dd8243ad0b0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:15.909317 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-399869a3-033e-4251-a8ed-9dd8243ad0b0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:15.917165 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-399869a3-033e-4251-a8ed-9dd8243ad0b0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.082585 Dec 15 13:06:15.917754 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1183/2382] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:15 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:16.936762 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0a46da2a-e24f-444b-b5a4-2a74908fbfdb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:16.937365 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0a46da2a-e24f-444b-b5a4-2a74908fbfdb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:16.943592 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0a46da2a-e24f-444b-b5a4-2a74908fbfdb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:16.944044 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0a46da2a-e24f-444b-b5a4-2a74908fbfdb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:16.944812 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0a46da2a-e24f-444b-b5a4-2a74908fbfdb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:16.945249 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0a46da2a-e24f-444b-b5a4-2a74908fbfdb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:17.013002 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0a46da2a-e24f-444b-b5a4-2a74908fbfdb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:17.022246 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0a46da2a-e24f-444b-b5a4-2a74908fbfdb tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.089044 Dec 15 13:06:17.022819 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1200/2383] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:16 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:18.039077 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7275f683-e8d9-461b-bde3-729daa139a25 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:18.039690 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7275f683-e8d9-461b-bde3-729daa139a25 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:18.046782 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7275f683-e8d9-461b-bde3-729daa139a25 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:18.046782 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7275f683-e8d9-461b-bde3-729daa139a25 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:18.047758 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7275f683-e8d9-461b-bde3-729daa139a25 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:18.048195 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7275f683-e8d9-461b-bde3-729daa139a25 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:18.108953 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7275f683-e8d9-461b-bde3-729daa139a25 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:18.117127 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7275f683-e8d9-461b-bde3-729daa139a25 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081566 Dec 15 13:06:18.117787 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1184/2384] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:18 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:18.407747 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:06:18.408020 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 13:06:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:06:19.133747 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-143d2783-f22a-4bd2-bf32-37e5c794eee4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:19.134343 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-143d2783-f22a-4bd2-bf32-37e5c794eee4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:19.140837 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-143d2783-f22a-4bd2-bf32-37e5c794eee4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:19.141526 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-143d2783-f22a-4bd2-bf32-37e5c794eee4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:19.142416 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-143d2783-f22a-4bd2-bf32-37e5c794eee4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:19.142848 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-143d2783-f22a-4bd2-bf32-37e5c794eee4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:19.204556 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-143d2783-f22a-4bd2-bf32-37e5c794eee4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:19.213099 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-143d2783-f22a-4bd2-bf32-37e5c794eee4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.082907 Dec 15 13:06:19.213714 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1201/2385] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:19 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:20.230292 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a161e0db-2826-4562-baaa-3ea331353959 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:20.230904 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a161e0db-2826-4562-baaa-3ea331353959 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:20.237581 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a161e0db-2826-4562-baaa-3ea331353959 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:20.238036 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a161e0db-2826-4562-baaa-3ea331353959 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:20.238817 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a161e0db-2826-4562-baaa-3ea331353959 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:20.239279 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a161e0db-2826-4562-baaa-3ea331353959 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:20.316112 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a161e0db-2826-4562-baaa-3ea331353959 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:20.323983 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a161e0db-2826-4562-baaa-3ea331353959 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.097321 Dec 15 13:06:20.324548 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1185/2386] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:20 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:21.340982 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-00047011-3f19-42c5-a482-a89b216e6f97 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:21.341624 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-00047011-3f19-42c5-a482-a89b216e6f97 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:21.348052 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-00047011-3f19-42c5-a482-a89b216e6f97 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:21.348503 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-00047011-3f19-42c5-a482-a89b216e6f97 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:21.349301 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-00047011-3f19-42c5-a482-a89b216e6f97 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:21.349767 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-00047011-3f19-42c5-a482-a89b216e6f97 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:21.423486 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-00047011-3f19-42c5-a482-a89b216e6f97 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:21.431133 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-00047011-3f19-42c5-a482-a89b216e6f97 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.093968 Dec 15 13:06:21.431697 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1202/2387] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:21 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:22.448426 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c5a75783-eaf9-4c72-aefb-ceaf641c7ac5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:22.449050 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c5a75783-eaf9-4c72-aefb-ceaf641c7ac5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:22.455488 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c5a75783-eaf9-4c72-aefb-ceaf641c7ac5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:22.455876 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c5a75783-eaf9-4c72-aefb-ceaf641c7ac5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:22.456671 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c5a75783-eaf9-4c72-aefb-ceaf641c7ac5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:22.457110 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c5a75783-eaf9-4c72-aefb-ceaf641c7ac5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:22.517291 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c5a75783-eaf9-4c72-aefb-ceaf641c7ac5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:22.525448 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c5a75783-eaf9-4c72-aefb-ceaf641c7ac5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.080732 Dec 15 13:06:22.526031 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1186/2388] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:22 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:23.542359 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5f4177d3-bebb-4ccd-95f5-41d89f998003 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:23.542971 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5f4177d3-bebb-4ccd-95f5-41d89f998003 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:23.550729 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5f4177d3-bebb-4ccd-95f5-41d89f998003 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:23.551111 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5f4177d3-bebb-4ccd-95f5-41d89f998003 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:23.551893 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5f4177d3-bebb-4ccd-95f5-41d89f998003 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:23.552330 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5f4177d3-bebb-4ccd-95f5-41d89f998003 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:23.611705 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5f4177d3-bebb-4ccd-95f5-41d89f998003 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:23.619406 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5f4177d3-bebb-4ccd-95f5-41d89f998003 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.080683 Dec 15 13:06:23.619967 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1203/2389] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:23 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:24.636336 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-180dcada-d361-4ac3-a8bd-dbc28b1f404e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:24.637201 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-180dcada-d361-4ac3-a8bd-dbc28b1f404e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:24.644370 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-180dcada-d361-4ac3-a8bd-dbc28b1f404e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:24.644816 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-180dcada-d361-4ac3-a8bd-dbc28b1f404e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:24.645627 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-180dcada-d361-4ac3-a8bd-dbc28b1f404e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:24.646068 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-180dcada-d361-4ac3-a8bd-dbc28b1f404e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:24.706839 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-180dcada-d361-4ac3-a8bd-dbc28b1f404e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:24.714716 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-180dcada-d361-4ac3-a8bd-dbc28b1f404e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.082142 Dec 15 13:06:24.715277 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1187/2390] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:24 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:25.732152 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-790082e5-da65-42fb-83c1-714c892f1277 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:25.732960 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-790082e5-da65-42fb-83c1-714c892f1277 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:25.739994 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-790082e5-da65-42fb-83c1-714c892f1277 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:25.740440 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-790082e5-da65-42fb-83c1-714c892f1277 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:25.741222 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-790082e5-da65-42fb-83c1-714c892f1277 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:25.741691 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-790082e5-da65-42fb-83c1-714c892f1277 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:25.800325 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-790082e5-da65-42fb-83c1-714c892f1277 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:25.808373 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-790082e5-da65-42fb-83c1-714c892f1277 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.079878 Dec 15 13:06:25.808942 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1204/2391] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:25 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:26.826280 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ba7ff32e-f361-4bee-8352-fe324ca78a38 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:26.827025 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ba7ff32e-f361-4bee-8352-fe324ca78a38 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:26.833656 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ba7ff32e-f361-4bee-8352-fe324ca78a38 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:26.834112 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ba7ff32e-f361-4bee-8352-fe324ca78a38 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:26.834917 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ba7ff32e-f361-4bee-8352-fe324ca78a38 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:26.835421 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ba7ff32e-f361-4bee-8352-fe324ca78a38 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:26.899999 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ba7ff32e-f361-4bee-8352-fe324ca78a38 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:26.907982 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ba7ff32e-f361-4bee-8352-fe324ca78a38 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.085739 Dec 15 13:06:26.908555 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1188/2392] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:26 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:27.924933 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d0a2ea06-d10b-4539-83f7-a74d48ed1ae2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:27.925614 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d0a2ea06-d10b-4539-83f7-a74d48ed1ae2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:27.932094 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d0a2ea06-d10b-4539-83f7-a74d48ed1ae2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:27.932546 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d0a2ea06-d10b-4539-83f7-a74d48ed1ae2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:27.933334 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d0a2ea06-d10b-4539-83f7-a74d48ed1ae2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:27.933798 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d0a2ea06-d10b-4539-83f7-a74d48ed1ae2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:27.994354 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d0a2ea06-d10b-4539-83f7-a74d48ed1ae2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:28.002263 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d0a2ea06-d10b-4539-83f7-a74d48ed1ae2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081291 Dec 15 13:06:28.002830 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1205/2393] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:27 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:29.022221 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-afb3e97a-1d43-429a-9d17-4d78ab22d29c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:29.022842 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-afb3e97a-1d43-429a-9d17-4d78ab22d29c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:29.029141 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afb3e97a-1d43-429a-9d17-4d78ab22d29c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:29.029617 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afb3e97a-1d43-429a-9d17-4d78ab22d29c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:29.030412 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afb3e97a-1d43-429a-9d17-4d78ab22d29c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:29.030840 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afb3e97a-1d43-429a-9d17-4d78ab22d29c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:29.090617 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-afb3e97a-1d43-429a-9d17-4d78ab22d29c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:29.099338 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-afb3e97a-1d43-429a-9d17-4d78ab22d29c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.080745 Dec 15 13:06:29.100061 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1189/2394] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:29 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:30.117135 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-40165d93-70ec-46fb-9b3f-2394153d7fc0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:30.117805 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-40165d93-70ec-46fb-9b3f-2394153d7fc0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:30.124171 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-40165d93-70ec-46fb-9b3f-2394153d7fc0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:30.124622 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-40165d93-70ec-46fb-9b3f-2394153d7fc0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:30.125481 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-40165d93-70ec-46fb-9b3f-2394153d7fc0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:30.125980 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-40165d93-70ec-46fb-9b3f-2394153d7fc0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:30.191351 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-40165d93-70ec-46fb-9b3f-2394153d7fc0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:30.199317 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-40165d93-70ec-46fb-9b3f-2394153d7fc0 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.086508 Dec 15 13:06:30.199892 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1206/2395] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:30 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:31.216262 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6649b224-4b31-4816-92f7-4dbdfb75bd3f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:31.216878 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6649b224-4b31-4816-92f7-4dbdfb75bd3f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:31.223319 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6649b224-4b31-4816-92f7-4dbdfb75bd3f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:31.223761 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6649b224-4b31-4816-92f7-4dbdfb75bd3f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:31.224599 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6649b224-4b31-4816-92f7-4dbdfb75bd3f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:31.225240 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6649b224-4b31-4816-92f7-4dbdfb75bd3f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:31.288087 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6649b224-4b31-4816-92f7-4dbdfb75bd3f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:31.295906 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6649b224-4b31-4816-92f7-4dbdfb75bd3f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.083449 Dec 15 13:06:31.296478 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1190/2396] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:31 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:32.313769 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-64d06e8e-26b0-4bbf-add3-2409c2a0ddee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:32.314375 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-64d06e8e-26b0-4bbf-add3-2409c2a0ddee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:32.320810 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-64d06e8e-26b0-4bbf-add3-2409c2a0ddee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:32.321258 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-64d06e8e-26b0-4bbf-add3-2409c2a0ddee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:32.322071 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-64d06e8e-26b0-4bbf-add3-2409c2a0ddee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:32.322512 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-64d06e8e-26b0-4bbf-add3-2409c2a0ddee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:32.386758 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-64d06e8e-26b0-4bbf-add3-2409c2a0ddee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:32.395756 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-64d06e8e-26b0-4bbf-add3-2409c2a0ddee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.085755 Dec 15 13:06:32.396332 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1207/2397] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:32 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:33.413018 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d9158b80-0842-4822-bd00-35eb4090781b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:33.413766 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d9158b80-0842-4822-bd00-35eb4090781b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:33.420231 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d9158b80-0842-4822-bd00-35eb4090781b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:33.420680 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d9158b80-0842-4822-bd00-35eb4090781b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:33.421471 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d9158b80-0842-4822-bd00-35eb4090781b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:33.421934 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d9158b80-0842-4822-bd00-35eb4090781b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:33.489696 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d9158b80-0842-4822-bd00-35eb4090781b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:33.497584 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d9158b80-0842-4822-bd00-35eb4090781b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.088555 Dec 15 13:06:33.498151 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1191/2398] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:33 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:34.514235 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-64c697c7-ef2c-4f1a-b7a0-ccf6abca678f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:34.514809 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-64c697c7-ef2c-4f1a-b7a0-ccf6abca678f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:34.521115 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-64c697c7-ef2c-4f1a-b7a0-ccf6abca678f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:34.521621 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-64c697c7-ef2c-4f1a-b7a0-ccf6abca678f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:34.522389 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-64c697c7-ef2c-4f1a-b7a0-ccf6abca678f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:34.522816 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-64c697c7-ef2c-4f1a-b7a0-ccf6abca678f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:34.588837 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-64c697c7-ef2c-4f1a-b7a0-ccf6abca678f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:34.597234 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-64c697c7-ef2c-4f1a-b7a0-ccf6abca678f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.087165 Dec 15 13:06:34.597833 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1208/2399] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:34 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:35.614098 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-df534871-7f1d-4caf-9b7d-f9e2a63e556d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:35.614711 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-df534871-7f1d-4caf-9b7d-f9e2a63e556d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:35.621089 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-df534871-7f1d-4caf-9b7d-f9e2a63e556d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:35.621568 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-df534871-7f1d-4caf-9b7d-f9e2a63e556d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:35.622350 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-df534871-7f1d-4caf-9b7d-f9e2a63e556d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:35.622789 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-df534871-7f1d-4caf-9b7d-f9e2a63e556d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:35.683491 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-df534871-7f1d-4caf-9b7d-f9e2a63e556d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:35.692103 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-df534871-7f1d-4caf-9b7d-f9e2a63e556d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081699 Dec 15 13:06:35.692652 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1192/2400] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:35 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:36.708748 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b04e9954-22b8-4f6d-8c38-1f6fc67f4341 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:36.709348 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b04e9954-22b8-4f6d-8c38-1f6fc67f4341 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:36.715707 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b04e9954-22b8-4f6d-8c38-1f6fc67f4341 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:36.716149 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b04e9954-22b8-4f6d-8c38-1f6fc67f4341 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:36.716913 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b04e9954-22b8-4f6d-8c38-1f6fc67f4341 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:36.717346 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b04e9954-22b8-4f6d-8c38-1f6fc67f4341 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:36.783326 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b04e9954-22b8-4f6d-8c38-1f6fc67f4341 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:36.791047 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b04e9954-22b8-4f6d-8c38-1f6fc67f4341 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.085980 Dec 15 13:06:36.791603 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1209/2401] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:36 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:37.808072 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-992832b9-af0e-4470-bc15-a16f2237ac9e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:37.808703 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-992832b9-af0e-4470-bc15-a16f2237ac9e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:37.815002 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-992832b9-af0e-4470-bc15-a16f2237ac9e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:37.815445 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-992832b9-af0e-4470-bc15-a16f2237ac9e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:37.816214 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-992832b9-af0e-4470-bc15-a16f2237ac9e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:37.816642 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-992832b9-af0e-4470-bc15-a16f2237ac9e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:37.877878 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-992832b9-af0e-4470-bc15-a16f2237ac9e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:37.885947 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-992832b9-af0e-4470-bc15-a16f2237ac9e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081554 Dec 15 13:06:37.886507 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1193/2402] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:37 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:38.903076 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-924fc6ce-a3c5-48cb-a814-4e7b7a3e4f37 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:38.903699 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-924fc6ce-a3c5-48cb-a814-4e7b7a3e4f37 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:38.910748 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-924fc6ce-a3c5-48cb-a814-4e7b7a3e4f37 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:38.911211 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-924fc6ce-a3c5-48cb-a814-4e7b7a3e4f37 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:38.911963 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-924fc6ce-a3c5-48cb-a814-4e7b7a3e4f37 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:38.912392 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-924fc6ce-a3c5-48cb-a814-4e7b7a3e4f37 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:38.970325 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-924fc6ce-a3c5-48cb-a814-4e7b7a3e4f37 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:38.978692 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-924fc6ce-a3c5-48cb-a814-4e7b7a3e4f37 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.079300 Dec 15 13:06:38.979257 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1210/2403] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:38 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:39.995525 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-68ab92ae-3149-4cc3-8f79-d738ec3a5ecf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:39.997929 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-68ab92ae-3149-4cc3-8f79-d738ec3a5ecf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:40.002391 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-68ab92ae-3149-4cc3-8f79-d738ec3a5ecf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:40.002832 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-68ab92ae-3149-4cc3-8f79-d738ec3a5ecf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:40.003617 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-68ab92ae-3149-4cc3-8f79-d738ec3a5ecf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:40.004051 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-68ab92ae-3149-4cc3-8f79-d738ec3a5ecf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:40.043322 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:06:40.043604 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 13:06:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 (ip 10.222.0.76) !!! Dec 15 13:06:40.069081 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-68ab92ae-3149-4cc3-8f79-d738ec3a5ecf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:40.077033 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-68ab92ae-3149-4cc3-8f79-d738ec3a5ecf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.085256 Dec 15 13:06:40.077620 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1194/2404] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:39 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:41.093093 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f2987875-0207-403b-8d0f-b2558957b15a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:41.093761 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f2987875-0207-403b-8d0f-b2558957b15a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:41.100787 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f2987875-0207-403b-8d0f-b2558957b15a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:41.101241 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f2987875-0207-403b-8d0f-b2558957b15a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:41.102046 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f2987875-0207-403b-8d0f-b2558957b15a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:41.102490 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f2987875-0207-403b-8d0f-b2558957b15a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:41.163491 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f2987875-0207-403b-8d0f-b2558957b15a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:41.171288 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f2987875-0207-403b-8d0f-b2558957b15a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081861 Dec 15 13:06:41.171856 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1211/2405] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:41 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:42.187819 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-75fabc64-efe1-463b-9297-ec3ef995e2f4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:42.188415 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-75fabc64-efe1-463b-9297-ec3ef995e2f4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:42.195514 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-75fabc64-efe1-463b-9297-ec3ef995e2f4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:42.195968 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-75fabc64-efe1-463b-9297-ec3ef995e2f4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:42.196739 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-75fabc64-efe1-463b-9297-ec3ef995e2f4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:42.197172 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-75fabc64-efe1-463b-9297-ec3ef995e2f4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:42.264272 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-75fabc64-efe1-463b-9297-ec3ef995e2f4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:42.272292 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-75fabc64-efe1-463b-9297-ec3ef995e2f4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.088073 Dec 15 13:06:42.272860 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1195/2406] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:42 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:43.289876 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5fa81581-38ad-4e1b-a520-b87a44cdbfcc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:43.290570 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5fa81581-38ad-4e1b-a520-b87a44cdbfcc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:43.297376 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5fa81581-38ad-4e1b-a520-b87a44cdbfcc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:43.297882 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5fa81581-38ad-4e1b-a520-b87a44cdbfcc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:43.298737 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5fa81581-38ad-4e1b-a520-b87a44cdbfcc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:43.299397 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5fa81581-38ad-4e1b-a520-b87a44cdbfcc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:43.365025 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5fa81581-38ad-4e1b-a520-b87a44cdbfcc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:43.373289 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5fa81581-38ad-4e1b-a520-b87a44cdbfcc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.087280 Dec 15 13:06:43.373912 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1212/2407] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:43 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:44.390716 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7a3f9b03-7797-4573-9fd4-f8a355e6eedc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:44.391416 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7a3f9b03-7797-4573-9fd4-f8a355e6eedc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:44.398380 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7a3f9b03-7797-4573-9fd4-f8a355e6eedc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:44.398856 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7a3f9b03-7797-4573-9fd4-f8a355e6eedc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:44.399701 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7a3f9b03-7797-4573-9fd4-f8a355e6eedc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:44.400172 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7a3f9b03-7797-4573-9fd4-f8a355e6eedc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:44.464663 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7a3f9b03-7797-4573-9fd4-f8a355e6eedc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:44.475840 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7a3f9b03-7797-4573-9fd4-f8a355e6eedc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.089183 Dec 15 13:06:44.476428 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1196/2408] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:44 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:45.492391 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-23808abd-af59-44e8-9e42-10626752e2fe tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:45.493012 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-23808abd-af59-44e8-9e42-10626752e2fe tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:45.499590 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-23808abd-af59-44e8-9e42-10626752e2fe tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:45.500035 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-23808abd-af59-44e8-9e42-10626752e2fe tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:45.500823 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-23808abd-af59-44e8-9e42-10626752e2fe tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:45.501257 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-23808abd-af59-44e8-9e42-10626752e2fe tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:45.562723 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-23808abd-af59-44e8-9e42-10626752e2fe tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:45.571465 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-23808abd-af59-44e8-9e42-10626752e2fe tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.082796 Dec 15 13:06:45.572032 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1213/2409] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:45 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:46.588257 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-dd06dbd4-ddbb-467d-b9dc-b260160ca30a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:46.588810 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-dd06dbd4-ddbb-467d-b9dc-b260160ca30a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:46.595266 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dd06dbd4-ddbb-467d-b9dc-b260160ca30a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:46.595745 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dd06dbd4-ddbb-467d-b9dc-b260160ca30a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:46.596561 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dd06dbd4-ddbb-467d-b9dc-b260160ca30a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:46.597783 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dd06dbd4-ddbb-467d-b9dc-b260160ca30a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:46.662710 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-dd06dbd4-ddbb-467d-b9dc-b260160ca30a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:46.670575 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-dd06dbd4-ddbb-467d-b9dc-b260160ca30a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.086113 Dec 15 13:06:46.671147 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1197/2410] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:46 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:47.687852 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-426bcb6d-7f3a-469e-8776-1349bb8ad58d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:47.688476 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-426bcb6d-7f3a-469e-8776-1349bb8ad58d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:47.695930 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-426bcb6d-7f3a-469e-8776-1349bb8ad58d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:47.696381 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-426bcb6d-7f3a-469e-8776-1349bb8ad58d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:47.697173 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-426bcb6d-7f3a-469e-8776-1349bb8ad58d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:47.697638 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-426bcb6d-7f3a-469e-8776-1349bb8ad58d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:47.760759 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-426bcb6d-7f3a-469e-8776-1349bb8ad58d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:47.769423 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-426bcb6d-7f3a-469e-8776-1349bb8ad58d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.084842 Dec 15 13:06:47.770231 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1214/2411] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:47 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:06:48.786497 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fe9afc03-a0ec-4ff0-9793-fe353e22a446 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:48.787148 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fe9afc03-a0ec-4ff0-9793-fe353e22a446 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:48.794315 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fe9afc03-a0ec-4ff0-9793-fe353e22a446 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:48.794770 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fe9afc03-a0ec-4ff0-9793-fe353e22a446 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:48.795569 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fe9afc03-a0ec-4ff0-9793-fe353e22a446 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:48.796013 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fe9afc03-a0ec-4ff0-9793-fe353e22a446 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:48.859394 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fe9afc03-a0ec-4ff0-9793-fe353e22a446 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:48.869321 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fe9afc03-a0ec-4ff0-9793-fe353e22a446 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.086390 Dec 15 13:06:48.870062 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1198/2412] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:48 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:49.890384 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-869835fb-191e-45bc-99aa-17d039f9a2a7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:49.891004 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-869835fb-191e-45bc-99aa-17d039f9a2a7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:49.897824 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-869835fb-191e-45bc-99aa-17d039f9a2a7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:49.898278 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-869835fb-191e-45bc-99aa-17d039f9a2a7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:49.899063 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-869835fb-191e-45bc-99aa-17d039f9a2a7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:49.899505 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-869835fb-191e-45bc-99aa-17d039f9a2a7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:49.959775 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-869835fb-191e-45bc-99aa-17d039f9a2a7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:49.968458 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-869835fb-191e-45bc-99aa-17d039f9a2a7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081936 Dec 15 13:06:49.969103 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1215/2413] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:49 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:50.990484 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6e7a3686-ec7b-4626-a7fd-da261b8e6287 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:50.991099 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6e7a3686-ec7b-4626-a7fd-da261b8e6287 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:50.997259 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6e7a3686-ec7b-4626-a7fd-da261b8e6287 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:50.997743 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6e7a3686-ec7b-4626-a7fd-da261b8e6287 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:50.998510 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6e7a3686-ec7b-4626-a7fd-da261b8e6287 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:50.998939 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6e7a3686-ec7b-4626-a7fd-da261b8e6287 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:51.060864 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6e7a3686-ec7b-4626-a7fd-da261b8e6287 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:51.068594 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6e7a3686-ec7b-4626-a7fd-da261b8e6287 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.082763 Dec 15 13:06:51.069154 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1199/2414] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:50 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:52.085372 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d90c4781-f701-4e80-8d10-d743e291ae53 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:52.086127 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d90c4781-f701-4e80-8d10-d743e291ae53 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:52.092386 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d90c4781-f701-4e80-8d10-d743e291ae53 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:52.092856 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d90c4781-f701-4e80-8d10-d743e291ae53 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:52.093644 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d90c4781-f701-4e80-8d10-d743e291ae53 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:52.094091 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d90c4781-f701-4e80-8d10-d743e291ae53 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:52.154764 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d90c4781-f701-4e80-8d10-d743e291ae53 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:52.163221 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d90c4781-f701-4e80-8d10-d743e291ae53 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.082117 Dec 15 13:06:52.163781 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1216/2415] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:52 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:53.181210 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f9bb70d0-ccc6-4294-90b3-6b5c992d1703 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:53.181858 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f9bb70d0-ccc6-4294-90b3-6b5c992d1703 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:53.188053 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f9bb70d0-ccc6-4294-90b3-6b5c992d1703 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:53.188494 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f9bb70d0-ccc6-4294-90b3-6b5c992d1703 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:53.189258 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f9bb70d0-ccc6-4294-90b3-6b5c992d1703 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:53.189723 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f9bb70d0-ccc6-4294-90b3-6b5c992d1703 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:53.252340 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-f9bb70d0-ccc6-4294-90b3-6b5c992d1703 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:53.261113 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f9bb70d0-ccc6-4294-90b3-6b5c992d1703 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.083368 Dec 15 13:06:53.261676 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1200/2416] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:53 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:54.279130 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-edb01080-8054-483f-8439-0e3df535c28e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:54.279842 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-edb01080-8054-483f-8439-0e3df535c28e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:54.287622 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-edb01080-8054-483f-8439-0e3df535c28e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:54.288099 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-edb01080-8054-483f-8439-0e3df535c28e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:54.289025 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-edb01080-8054-483f-8439-0e3df535c28e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:54.289469 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-edb01080-8054-483f-8439-0e3df535c28e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:54.351263 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-edb01080-8054-483f-8439-0e3df535c28e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:54.366130 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-edb01080-8054-483f-8439-0e3df535c28e tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.091013 Dec 15 13:06:54.366720 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1217/2417] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:54 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:55.383381 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-64869b6d-5ced-425d-81fa-a80cd2bab321 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:55.384001 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-64869b6d-5ced-425d-81fa-a80cd2bab321 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:55.390571 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-64869b6d-5ced-425d-81fa-a80cd2bab321 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:55.391280 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-64869b6d-5ced-425d-81fa-a80cd2bab321 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:55.391803 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-64869b6d-5ced-425d-81fa-a80cd2bab321 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:55.392241 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-64869b6d-5ced-425d-81fa-a80cd2bab321 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:55.457990 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-64869b6d-5ced-425d-81fa-a80cd2bab321 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:55.467424 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-64869b6d-5ced-425d-81fa-a80cd2bab321 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.088192 Dec 15 13:06:55.467996 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1201/2418] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:55 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:56.484067 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d6dfaf8f-e705-47ae-8676-903aca0b81b3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:56.484631 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d6dfaf8f-e705-47ae-8676-903aca0b81b3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:56.496873 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d6dfaf8f-e705-47ae-8676-903aca0b81b3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:56.497326 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d6dfaf8f-e705-47ae-8676-903aca0b81b3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:56.498184 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d6dfaf8f-e705-47ae-8676-903aca0b81b3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:56.498623 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d6dfaf8f-e705-47ae-8676-903aca0b81b3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:56.560094 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d6dfaf8f-e705-47ae-8676-903aca0b81b3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:56.567848 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d6dfaf8f-e705-47ae-8676-903aca0b81b3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.087494 Dec 15 13:06:56.568974 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1218/2419] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:56 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:57.586059 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8dcb9f1d-6222-4b11-8f0d-10a347ad886f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:57.586861 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8dcb9f1d-6222-4b11-8f0d-10a347ad886f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:57.595140 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8dcb9f1d-6222-4b11-8f0d-10a347ad886f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:57.595593 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8dcb9f1d-6222-4b11-8f0d-10a347ad886f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:57.596386 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8dcb9f1d-6222-4b11-8f0d-10a347ad886f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:57.596824 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8dcb9f1d-6222-4b11-8f0d-10a347ad886f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:57.656806 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8dcb9f1d-6222-4b11-8f0d-10a347ad886f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:57.666086 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8dcb9f1d-6222-4b11-8f0d-10a347ad886f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.085307 Dec 15 13:06:57.666687 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1202/2420] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:57 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:58.683543 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2518642e-d0ad-46b9-861a-0df6dd119df2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:58.684176 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2518642e-d0ad-46b9-861a-0df6dd119df2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:58.690695 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2518642e-d0ad-46b9-861a-0df6dd119df2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:58.691146 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2518642e-d0ad-46b9-861a-0df6dd119df2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:58.691935 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2518642e-d0ad-46b9-861a-0df6dd119df2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:58.692376 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2518642e-d0ad-46b9-861a-0df6dd119df2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:58.752072 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2518642e-d0ad-46b9-861a-0df6dd119df2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:58.761210 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2518642e-d0ad-46b9-861a-0df6dd119df2 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081458 Dec 15 13:06:58.761852 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1219/2421] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:58 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:59.779905 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-48a85ac9-38c9-47d7-a35d-dc81751e8334 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:59.780737 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-48a85ac9-38c9-47d7-a35d-dc81751e8334 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:59.787359 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-48a85ac9-38c9-47d7-a35d-dc81751e8334 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:59.787812 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-48a85ac9-38c9-47d7-a35d-dc81751e8334 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:59.788598 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-48a85ac9-38c9-47d7-a35d-dc81751e8334 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:59.789035 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-48a85ac9-38c9-47d7-a35d-dc81751e8334 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:59.789406 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-42520a95-b263-4a79-bbf1-f923ade3f082 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:59.789969 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-42520a95-b263-4a79-bbf1-f923ade3f082 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:59.802102 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-42520a95-b263-4a79-bbf1-f923ade3f082 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:59.802594 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-42520a95-b263-4a79-bbf1-f923ade3f082 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:59.803614 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-42520a95-b263-4a79-bbf1-f923ade3f082 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:59.804097 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-42520a95-b263-4a79-bbf1-f923ade3f082 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:59.836393 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-42520a95-b263-4a79-bbf1-f923ade3f082 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Going to try to terminate instance {{(pid=122614) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:06:59.870861 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-48a85ac9-38c9-47d7-a35d-dc81751e8334 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:06:59.880045 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-48a85ac9-38c9-47d7-a35d-dc81751e8334 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.104122 Dec 15 13:06:59.881386 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1203/2422] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:59 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:06:59.916811 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-42520a95-b263-4a79-bbf1-f923ade3f082 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "DELETE /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 204 len: 0 microversion: 2.1 time: 0.130926 Dec 15 13:06:59.917499 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1220/2423] 10.222.0.76 () {58 vars in 1238 bytes} [Wed Dec 15 13:06:59 2021] DELETE /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:06:59.925943 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-80fdf8df-7bb6-41de-98a4-e6e755bb90c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:06:59.926618 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-80fdf8df-7bb6-41de-98a4-e6e755bb90c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:06:59.933430 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-80fdf8df-7bb6-41de-98a4-e6e755bb90c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:59.934058 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-80fdf8df-7bb6-41de-98a4-e6e755bb90c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:06:59.934958 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-80fdf8df-7bb6-41de-98a4-e6e755bb90c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:06:59.935486 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-80fdf8df-7bb6-41de-98a4-e6e755bb90c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:00.074873 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-80fdf8df-7bb6-41de-98a4-e6e755bb90c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:00.082224 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-80fdf8df-7bb6-41de-98a4-e6e755bb90c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1507 microversion: 2.1 time: 0.160227 Dec 15 13:07:00.082788 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1204/2424] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:06:59 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:00.899420 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2594e969-a526-4384-8668-cff0030384c5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:00.900258 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2594e969-a526-4384-8668-cff0030384c5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:00.906875 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2594e969-a526-4384-8668-cff0030384c5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:00.907330 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2594e969-a526-4384-8668-cff0030384c5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:00.908124 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2594e969-a526-4384-8668-cff0030384c5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:00.908570 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2594e969-a526-4384-8668-cff0030384c5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:00.983809 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2594e969-a526-4384-8668-cff0030384c5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:00.994410 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2594e969-a526-4384-8668-cff0030384c5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.099247 Dec 15 13:07:00.998417 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1221/2425] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:00 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:01.099772 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-83fd6b4f-ed5b-40f5-af90-06e43c109ac7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:01.100803 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-83fd6b4f-ed5b-40f5-af90-06e43c109ac7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:01.107721 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-83fd6b4f-ed5b-40f5-af90-06e43c109ac7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:01.108549 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-83fd6b4f-ed5b-40f5-af90-06e43c109ac7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:01.109928 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-83fd6b4f-ed5b-40f5-af90-06e43c109ac7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:01.110708 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-83fd6b4f-ed5b-40f5-af90-06e43c109ac7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:01.136687 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [req-fc65bf70-8787-4cde-b9b3-605143bfccf0 req-5dd08ab9-9145-4b95-92a4-c81810766910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a57f09a7-71bf-49d0-9ee5-fe5c4aa09638", "name": "network-vif-deleted", "tag": "156bfc68-a57b-4095-8995-41bca77b20eb"}]} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:07:01.138703 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:07:01.138703 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: warnings.warn(msg) Dec 15 13:07:01.146084 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-fc65bf70-8787-4cde-b9b3-605143bfccf0 req-5dd08ab9-9145-4b95-92a4-c81810766910 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:01.146545 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-fc65bf70-8787-4cde-b9b3-605143bfccf0 req-5dd08ab9-9145-4b95-92a4-c81810766910 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:01.154285 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-83fd6b4f-ed5b-40f5-af90-06e43c109ac7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:01.154678 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-83fd6b4f-ed5b-40f5-af90-06e43c109ac7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:01.155349 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.objects.instance [None req-83fd6b4f-ed5b-40f5-af90-06e43c109ac7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lazy-loading 'fault' on Instance uuid a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 {{(pid=122614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:07:01.158339 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.compute.server_external_events [req-fc65bf70-8787-4cde-b9b3-605143bfccf0 req-5dd08ab9-9145-4b95-92a4-c81810766910 service nova] Creating event network-vif-deleted:156bfc68-a57b-4095-8995-41bca77b20eb for instance a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 on hv-cinder-81322 Dec 15 13:07:01.165400 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [req-fc65bf70-8787-4cde-b9b3-605143bfccf0 req-5dd08ab9-9145-4b95-92a4-c81810766910 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132032 Dec 15 13:07:01.166926 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1205/2426] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:07:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:07:01.202452 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-83fd6b4f-ed5b-40f5-af90-06e43c109ac7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:01.210166 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-83fd6b4f-ed5b-40f5-af90-06e43c109ac7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 200 len: 1312 microversion: 2.1 time: 0.114332 Dec 15 13:07:01.210729 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1222/2427] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:01 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 1312 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:02.013975 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-609bdf8e-33d1-4779-94b7-f85e291b5373 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:02.015145 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-609bdf8e-33d1-4779-94b7-f85e291b5373 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:02.026674 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-609bdf8e-33d1-4779-94b7-f85e291b5373 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:02.027225 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-609bdf8e-33d1-4779-94b7-f85e291b5373 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:02.028028 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-609bdf8e-33d1-4779-94b7-f85e291b5373 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:02.028459 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-609bdf8e-33d1-4779-94b7-f85e291b5373 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:02.090057 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-609bdf8e-33d1-4779-94b7-f85e291b5373 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:02.097870 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-609bdf8e-33d1-4779-94b7-f85e291b5373 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.088863 Dec 15 13:07:02.098436 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1206/2428] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:02 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:02.227631 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6abde11b-9d2f-47f6-97a9-bddd9c22552a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:02.228248 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6abde11b-9d2f-47f6-97a9-bddd9c22552a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: a57f09a7-71bf-49d0-9ee5-fe5c4aa09638] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:02.234987 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6abde11b-9d2f-47f6-97a9-bddd9c22552a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:02.235439 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6abde11b-9d2f-47f6-97a9-bddd9c22552a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:02.236418 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6abde11b-9d2f-47f6-97a9-bddd9c22552a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:02.236657 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6abde11b-9d2f-47f6-97a9-bddd9c22552a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:02.251079 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.wsgi [None req-6abde11b-9d2f-47f6-97a9-bddd9c22552a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] HTTP exception thrown: Instance a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 could not be found. Dec 15 13:07:02.251676 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6abde11b-9d2f-47f6-97a9-bddd9c22552a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Returning 404 to user: Instance a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 could not be found. {{(pid=122614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:07:02.252512 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6abde11b-9d2f-47f6-97a9-bddd9c22552a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638" status: 404 len: 111 microversion: 2.1 time: 0.028822 Dec 15 13:07:02.253069 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1223/2429] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:02 2021] GET /compute/v2.1/servers/a57f09a7-71bf-49d0-9ee5-fe5c4aa09638 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:07:02.262549 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-88f36df3-abdf-4f94-a584-90c8e54751f4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:02.263171 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-88f36df3-abdf-4f94-a584-90c8e54751f4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:02.269765 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-88f36df3-abdf-4f94-a584-90c8e54751f4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:02.270273 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-88f36df3-abdf-4f94-a584-90c8e54751f4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:02.271202 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-88f36df3-abdf-4f94-a584-90c8e54751f4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:02.271758 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-88f36df3-abdf-4f94-a584-90c8e54751f4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:02.299647 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-88f36df3-abdf-4f94-a584-90c8e54751f4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Going to try to terminate instance {{(pid=122615) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:07:02.383084 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-88f36df3-abdf-4f94-a584-90c8e54751f4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "DELETE /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 204 len: 0 microversion: 2.1 time: 0.124527 Dec 15 13:07:02.383846 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1207/2430] 10.222.0.76 () {58 vars in 1238 bytes} [Wed Dec 15 13:07:02 2021] DELETE /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:07:02.392484 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9eeac9b4-b3fa-4d48-adfd-0b48d4933120 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:02.393120 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9eeac9b4-b3fa-4d48-adfd-0b48d4933120 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:02.401708 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9eeac9b4-b3fa-4d48-adfd-0b48d4933120 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:02.402437 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9eeac9b4-b3fa-4d48-adfd-0b48d4933120 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:02.403682 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9eeac9b4-b3fa-4d48-adfd-0b48d4933120 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:02.404411 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9eeac9b4-b3fa-4d48-adfd-0b48d4933120 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:02.546497 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9eeac9b4-b3fa-4d48-adfd-0b48d4933120 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:02.555732 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9eeac9b4-b3fa-4d48-adfd-0b48d4933120 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1566 microversion: 2.1 time: 0.167179 Dec 15 13:07:02.556341 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1224/2431] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:02 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:03.116322 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-dffb4116-8a0b-4322-9004-523254fa7786 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:03.117071 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-dffb4116-8a0b-4322-9004-523254fa7786 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:03.123910 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dffb4116-8a0b-4322-9004-523254fa7786 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:03.124370 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dffb4116-8a0b-4322-9004-523254fa7786 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:03.125162 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dffb4116-8a0b-4322-9004-523254fa7786 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:03.125620 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dffb4116-8a0b-4322-9004-523254fa7786 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:03.195819 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-dffb4116-8a0b-4322-9004-523254fa7786 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:03.205190 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-dffb4116-8a0b-4322-9004-523254fa7786 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.093981 Dec 15 13:07:03.206118 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1208/2432] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:03 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:03.572914 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9e6d4042-b27c-432b-b4b1-f073e1481f22 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:03.573697 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9e6d4042-b27c-432b-b4b1-f073e1481f22 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:03.580283 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9e6d4042-b27c-432b-b4b1-f073e1481f22 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:03.580828 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9e6d4042-b27c-432b-b4b1-f073e1481f22 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:03.581735 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9e6d4042-b27c-432b-b4b1-f073e1481f22 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:03.582246 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9e6d4042-b27c-432b-b4b1-f073e1481f22 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:03.606037 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [req-825eabcb-2108-44d9-85c5-cea6c6a15d62 req-87317954-a7d0-4e18-a40a-9eedebc9b2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2824788a-14d6-488d-8af1-2df6b3de771a", "name": "network-vif-deleted", "tag": "e4f59a42-9884-4311-ab2f-2c6eb2422029"}]} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:07:03.607884 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:07:03.607884 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: warnings.warn(msg) Dec 15 13:07:03.616073 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-825eabcb-2108-44d9-85c5-cea6c6a15d62 req-87317954-a7d0-4e18-a40a-9eedebc9b2c3 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:03.616980 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-825eabcb-2108-44d9-85c5-cea6c6a15d62 req-87317954-a7d0-4e18-a40a-9eedebc9b2c3 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:03.628551 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.compute.server_external_events [req-825eabcb-2108-44d9-85c5-cea6c6a15d62 req-87317954-a7d0-4e18-a40a-9eedebc9b2c3 service nova] Creating event network-vif-deleted:e4f59a42-9884-4311-ab2f-2c6eb2422029 for instance 2824788a-14d6-488d-8af1-2df6b3de771a on hv-cinder-81322 Dec 15 13:07:03.634451 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [req-825eabcb-2108-44d9-85c5-cea6c6a15d62 req-87317954-a7d0-4e18-a40a-9eedebc9b2c3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032250 Dec 15 13:07:03.635414 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1209/2433] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:07:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:07:03.655523 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9e6d4042-b27c-432b-b4b1-f073e1481f22 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:03.664269 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9e6d4042-b27c-432b-b4b1-f073e1481f22 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1524 microversion: 2.1 time: 0.094892 Dec 15 13:07:03.664806 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1225/2434] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:03 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1524 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:04.224728 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-20dd5545-050b-43d5-8512-2b0279f4e82f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:04.225618 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-20dd5545-050b-43d5-8512-2b0279f4e82f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:04.232227 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-20dd5545-050b-43d5-8512-2b0279f4e82f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:04.232737 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-20dd5545-050b-43d5-8512-2b0279f4e82f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:04.233607 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-20dd5545-050b-43d5-8512-2b0279f4e82f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:04.234054 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-20dd5545-050b-43d5-8512-2b0279f4e82f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:04.303740 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-20dd5545-050b-43d5-8512-2b0279f4e82f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:04.311832 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-20dd5545-050b-43d5-8512-2b0279f4e82f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.092071 Dec 15 13:07:04.312425 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1210/2435] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:04 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:04.681202 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6baf420f-416d-48ad-8257-d7e19e6002f9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:04.681913 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6baf420f-416d-48ad-8257-d7e19e6002f9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:04.688177 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6baf420f-416d-48ad-8257-d7e19e6002f9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:04.688621 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6baf420f-416d-48ad-8257-d7e19e6002f9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:04.689399 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6baf420f-416d-48ad-8257-d7e19e6002f9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:04.689866 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6baf420f-416d-48ad-8257-d7e19e6002f9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:04.755224 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6baf420f-416d-48ad-8257-d7e19e6002f9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:04.763306 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6baf420f-416d-48ad-8257-d7e19e6002f9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.085817 Dec 15 13:07:04.763860 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1226/2436] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:04 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:05.329988 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-92e5ad16-6799-480f-91db-b42e5187f83f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:05.330594 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-92e5ad16-6799-480f-91db-b42e5187f83f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:05.337024 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-92e5ad16-6799-480f-91db-b42e5187f83f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:05.337469 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-92e5ad16-6799-480f-91db-b42e5187f83f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:05.338270 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-92e5ad16-6799-480f-91db-b42e5187f83f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:05.338698 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-92e5ad16-6799-480f-91db-b42e5187f83f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:05.398505 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-92e5ad16-6799-480f-91db-b42e5187f83f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:05.406972 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-92e5ad16-6799-480f-91db-b42e5187f83f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.080533 Dec 15 13:07:05.407556 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1211/2437] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:05 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:05.780857 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b5790f97-1fb4-46d8-b668-20522fd5e42b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:05.781466 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b5790f97-1fb4-46d8-b668-20522fd5e42b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:05.788310 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5790f97-1fb4-46d8-b668-20522fd5e42b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:05.788760 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5790f97-1fb4-46d8-b668-20522fd5e42b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:05.789560 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5790f97-1fb4-46d8-b668-20522fd5e42b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:05.790002 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5790f97-1fb4-46d8-b668-20522fd5e42b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:05.850718 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b5790f97-1fb4-46d8-b668-20522fd5e42b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:05.859292 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b5790f97-1fb4-46d8-b668-20522fd5e42b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081965 Dec 15 13:07:05.859930 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1227/2438] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:05 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:06.425190 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9be77f22-2cd2-49d1-802e-105b9ffa88f3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:06.425847 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9be77f22-2cd2-49d1-802e-105b9ffa88f3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:06.432820 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9be77f22-2cd2-49d1-802e-105b9ffa88f3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:06.433269 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9be77f22-2cd2-49d1-802e-105b9ffa88f3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:06.434108 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9be77f22-2cd2-49d1-802e-105b9ffa88f3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:06.434552 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9be77f22-2cd2-49d1-802e-105b9ffa88f3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:06.497149 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9be77f22-2cd2-49d1-802e-105b9ffa88f3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:06.505580 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9be77f22-2cd2-49d1-802e-105b9ffa88f3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.083936 Dec 15 13:07:06.506191 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1212/2439] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:06 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:06.877647 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3baa75aa-853f-4dcf-9b69-fccf56ae963e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:06.878242 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3baa75aa-853f-4dcf-9b69-fccf56ae963e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:06.884892 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3baa75aa-853f-4dcf-9b69-fccf56ae963e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:06.885343 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3baa75aa-853f-4dcf-9b69-fccf56ae963e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:06.886153 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3baa75aa-853f-4dcf-9b69-fccf56ae963e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:06.886588 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3baa75aa-853f-4dcf-9b69-fccf56ae963e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:06.947456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3baa75aa-853f-4dcf-9b69-fccf56ae963e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:06.955819 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3baa75aa-853f-4dcf-9b69-fccf56ae963e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081882 Dec 15 13:07:06.956384 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1228/2440] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:06 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:07.523237 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ca2105d3-a07b-49f4-a7f7-f91964f23b6b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:07.523926 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ca2105d3-a07b-49f4-a7f7-f91964f23b6b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:07.530099 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ca2105d3-a07b-49f4-a7f7-f91964f23b6b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:07.530550 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ca2105d3-a07b-49f4-a7f7-f91964f23b6b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:07.531329 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ca2105d3-a07b-49f4-a7f7-f91964f23b6b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:07.531766 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ca2105d3-a07b-49f4-a7f7-f91964f23b6b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:07.598358 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ca2105d3-a07b-49f4-a7f7-f91964f23b6b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:07.607144 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ca2105d3-a07b-49f4-a7f7-f91964f23b6b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.088202 Dec 15 13:07:07.607718 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1213/2441] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:07 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:07.972992 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fac21e46-92a4-485c-b6eb-546cc8a781c3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:07.973617 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fac21e46-92a4-485c-b6eb-546cc8a781c3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:07.980539 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fac21e46-92a4-485c-b6eb-546cc8a781c3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:07.981001 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fac21e46-92a4-485c-b6eb-546cc8a781c3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:07.981804 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fac21e46-92a4-485c-b6eb-546cc8a781c3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:07.982247 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fac21e46-92a4-485c-b6eb-546cc8a781c3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:08.048012 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-fac21e46-92a4-485c-b6eb-546cc8a781c3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:08.057164 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fac21e46-92a4-485c-b6eb-546cc8a781c3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.087373 Dec 15 13:07:08.057799 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1229/2442] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:07 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:08.626753 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ca4396c1-d124-44d6-a3e5-59cf85ce2aee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:08.627395 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ca4396c1-d124-44d6-a3e5-59cf85ce2aee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:08.634350 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ca4396c1-d124-44d6-a3e5-59cf85ce2aee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:08.634809 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ca4396c1-d124-44d6-a3e5-59cf85ce2aee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:08.635599 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ca4396c1-d124-44d6-a3e5-59cf85ce2aee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:08.636036 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ca4396c1-d124-44d6-a3e5-59cf85ce2aee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:08.696432 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ca4396c1-d124-44d6-a3e5-59cf85ce2aee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:08.704255 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ca4396c1-d124-44d6-a3e5-59cf85ce2aee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081257 Dec 15 13:07:08.704827 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1214/2443] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:08 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:09.073427 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2d037957-eba7-4dc0-8c86-0f3964fbf9c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:09.074088 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2d037957-eba7-4dc0-8c86-0f3964fbf9c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:09.080436 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2d037957-eba7-4dc0-8c86-0f3964fbf9c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:09.080891 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2d037957-eba7-4dc0-8c86-0f3964fbf9c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:09.081726 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2d037957-eba7-4dc0-8c86-0f3964fbf9c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:09.082196 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2d037957-eba7-4dc0-8c86-0f3964fbf9c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:09.144947 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2d037957-eba7-4dc0-8c86-0f3964fbf9c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:09.155636 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2d037957-eba7-4dc0-8c86-0f3964fbf9c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.085778 Dec 15 13:07:09.156233 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1230/2444] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:09 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:09.721194 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b6f620ce-9c20-4aea-ac7a-0e194a82cfd4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:09.721825 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b6f620ce-9c20-4aea-ac7a-0e194a82cfd4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:09.728614 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b6f620ce-9c20-4aea-ac7a-0e194a82cfd4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:09.729245 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b6f620ce-9c20-4aea-ac7a-0e194a82cfd4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:09.730079 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b6f620ce-9c20-4aea-ac7a-0e194a82cfd4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:09.730508 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b6f620ce-9c20-4aea-ac7a-0e194a82cfd4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:09.791930 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b6f620ce-9c20-4aea-ac7a-0e194a82cfd4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:09.799858 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b6f620ce-9c20-4aea-ac7a-0e194a82cfd4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.082258 Dec 15 13:07:09.800417 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1215/2445] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:09 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:10.173119 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-09cfe53c-396a-4ff2-8e17-74d3ae57de37 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:10.173764 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-09cfe53c-396a-4ff2-8e17-74d3ae57de37 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:10.180780 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-09cfe53c-396a-4ff2-8e17-74d3ae57de37 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:10.181223 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-09cfe53c-396a-4ff2-8e17-74d3ae57de37 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:10.182041 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-09cfe53c-396a-4ff2-8e17-74d3ae57de37 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:10.182473 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-09cfe53c-396a-4ff2-8e17-74d3ae57de37 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:10.241675 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-09cfe53c-396a-4ff2-8e17-74d3ae57de37 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:10.250186 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-09cfe53c-396a-4ff2-8e17-74d3ae57de37 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080631 Dec 15 13:07:10.250784 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1231/2446] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:10 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:10.817418 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b273522f-92d5-409d-b427-9ac16cff4231 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:10.818271 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b273522f-92d5-409d-b427-9ac16cff4231 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:10.825079 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b273522f-92d5-409d-b427-9ac16cff4231 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:10.825553 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b273522f-92d5-409d-b427-9ac16cff4231 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:10.826430 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b273522f-92d5-409d-b427-9ac16cff4231 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:10.826866 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b273522f-92d5-409d-b427-9ac16cff4231 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:10.888357 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b273522f-92d5-409d-b427-9ac16cff4231 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:10.896953 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b273522f-92d5-409d-b427-9ac16cff4231 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.082732 Dec 15 13:07:10.897652 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1216/2447] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:10 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:11.266896 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-20fc0f40-a140-4f42-8d74-2f90cdfbec1b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:11.267509 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-20fc0f40-a140-4f42-8d74-2f90cdfbec1b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:11.274561 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20fc0f40-a140-4f42-8d74-2f90cdfbec1b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:11.275074 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20fc0f40-a140-4f42-8d74-2f90cdfbec1b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:11.275995 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20fc0f40-a140-4f42-8d74-2f90cdfbec1b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:11.276433 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20fc0f40-a140-4f42-8d74-2f90cdfbec1b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:11.340501 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-20fc0f40-a140-4f42-8d74-2f90cdfbec1b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:11.348724 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-20fc0f40-a140-4f42-8d74-2f90cdfbec1b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.085558 Dec 15 13:07:11.349342 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1232/2448] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:11 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:11.914272 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fee82638-a466-44ba-98f9-5d3fe32a6510 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:11.914903 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fee82638-a466-44ba-98f9-5d3fe32a6510 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:11.921862 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fee82638-a466-44ba-98f9-5d3fe32a6510 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:11.922306 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fee82638-a466-44ba-98f9-5d3fe32a6510 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:11.923097 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fee82638-a466-44ba-98f9-5d3fe32a6510 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:11.923535 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fee82638-a466-44ba-98f9-5d3fe32a6510 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:11.985351 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fee82638-a466-44ba-98f9-5d3fe32a6510 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:11.993105 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fee82638-a466-44ba-98f9-5d3fe32a6510 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.083256 Dec 15 13:07:11.993707 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1217/2449] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:11 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:12.366388 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6f9cb4da-f4a6-4397-8a00-09a36300f509 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:12.366982 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6f9cb4da-f4a6-4397-8a00-09a36300f509 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:12.373199 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6f9cb4da-f4a6-4397-8a00-09a36300f509 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:12.373681 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6f9cb4da-f4a6-4397-8a00-09a36300f509 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:12.374445 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6f9cb4da-f4a6-4397-8a00-09a36300f509 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:12.374875 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6f9cb4da-f4a6-4397-8a00-09a36300f509 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:12.441850 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6f9cb4da-f4a6-4397-8a00-09a36300f509 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:12.450003 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6f9cb4da-f4a6-4397-8a00-09a36300f509 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.088086 Dec 15 13:07:12.450563 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1233/2450] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:12 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:13.010035 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-311d706a-e0b5-4085-96e6-8c3e57a1edbe tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:13.010660 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-311d706a-e0b5-4085-96e6-8c3e57a1edbe tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:13.017451 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-311d706a-e0b5-4085-96e6-8c3e57a1edbe tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:13.017932 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-311d706a-e0b5-4085-96e6-8c3e57a1edbe tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:13.018714 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-311d706a-e0b5-4085-96e6-8c3e57a1edbe tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:13.019146 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-311d706a-e0b5-4085-96e6-8c3e57a1edbe tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:13.078719 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-311d706a-e0b5-4085-96e6-8c3e57a1edbe tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:13.087017 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-311d706a-e0b5-4085-96e6-8c3e57a1edbe tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.080896 Dec 15 13:07:13.087585 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1218/2451] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:13 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:13.466269 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1d335382-1bb3-4390-8448-3d6f8470035a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:13.466868 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1d335382-1bb3-4390-8448-3d6f8470035a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:13.473338 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1d335382-1bb3-4390-8448-3d6f8470035a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:13.473820 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1d335382-1bb3-4390-8448-3d6f8470035a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:13.475482 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1d335382-1bb3-4390-8448-3d6f8470035a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:13.475927 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1d335382-1bb3-4390-8448-3d6f8470035a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:13.537624 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1d335382-1bb3-4390-8448-3d6f8470035a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:13.545525 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1d335382-1bb3-4390-8448-3d6f8470035a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082908 Dec 15 13:07:13.546084 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1234/2452] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:13 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:14.103444 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3fd1e88b-e923-445b-ae0f-99c9c27535cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:14.104089 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3fd1e88b-e923-445b-ae0f-99c9c27535cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:14.110672 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3fd1e88b-e923-445b-ae0f-99c9c27535cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:14.111113 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3fd1e88b-e923-445b-ae0f-99c9c27535cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:14.111876 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3fd1e88b-e923-445b-ae0f-99c9c27535cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:14.112304 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3fd1e88b-e923-445b-ae0f-99c9c27535cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:14.178843 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3fd1e88b-e923-445b-ae0f-99c9c27535cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:14.186696 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3fd1e88b-e923-445b-ae0f-99c9c27535cc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.087086 Dec 15 13:07:14.187262 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1219/2453] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:14 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:14.562338 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6f02c32e-91c2-4c03-80e4-c52113b0a6a4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:14.562951 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6f02c32e-91c2-4c03-80e4-c52113b0a6a4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:14.570206 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6f02c32e-91c2-4c03-80e4-c52113b0a6a4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:14.570651 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6f02c32e-91c2-4c03-80e4-c52113b0a6a4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:14.571441 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6f02c32e-91c2-4c03-80e4-c52113b0a6a4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:14.571878 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6f02c32e-91c2-4c03-80e4-c52113b0a6a4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:14.635116 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6f02c32e-91c2-4c03-80e4-c52113b0a6a4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:14.643431 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6f02c32e-91c2-4c03-80e4-c52113b0a6a4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.084425 Dec 15 13:07:14.643997 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1235/2454] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:14 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:15.204051 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-35494c9b-af28-4c66-8176-a4cf580b8fe1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:15.204656 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-35494c9b-af28-4c66-8176-a4cf580b8fe1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:15.211617 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-35494c9b-af28-4c66-8176-a4cf580b8fe1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:15.212064 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-35494c9b-af28-4c66-8176-a4cf580b8fe1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:15.212842 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-35494c9b-af28-4c66-8176-a4cf580b8fe1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:15.213280 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-35494c9b-af28-4c66-8176-a4cf580b8fe1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:15.272425 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-35494c9b-af28-4c66-8176-a4cf580b8fe1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:15.280205 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-35494c9b-af28-4c66-8176-a4cf580b8fe1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.079861 Dec 15 13:07:15.280761 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1220/2455] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:15 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:15.660391 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d092ac95-e825-4002-aa3b-8dc806287fb3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:15.661214 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d092ac95-e825-4002-aa3b-8dc806287fb3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:15.668059 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d092ac95-e825-4002-aa3b-8dc806287fb3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:15.668515 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d092ac95-e825-4002-aa3b-8dc806287fb3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:15.669307 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d092ac95-e825-4002-aa3b-8dc806287fb3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:15.669776 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d092ac95-e825-4002-aa3b-8dc806287fb3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:15.730740 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d092ac95-e825-4002-aa3b-8dc806287fb3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:15.738573 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d092ac95-e825-4002-aa3b-8dc806287fb3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082154 Dec 15 13:07:15.739139 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1236/2456] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:15 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:16.296667 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b18b43a5-5823-4a2f-8690-c4d67488c043 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:16.297383 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b18b43a5-5823-4a2f-8690-c4d67488c043 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:16.305116 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b18b43a5-5823-4a2f-8690-c4d67488c043 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:16.305591 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b18b43a5-5823-4a2f-8690-c4d67488c043 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:16.306389 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b18b43a5-5823-4a2f-8690-c4d67488c043 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:16.306831 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b18b43a5-5823-4a2f-8690-c4d67488c043 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:16.366997 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b18b43a5-5823-4a2f-8690-c4d67488c043 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:16.374831 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b18b43a5-5823-4a2f-8690-c4d67488c043 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.082160 Dec 15 13:07:16.375398 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1221/2457] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:16 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:16.755797 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c283abea-d1cc-47d3-abd1-2db3942ef3d6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:16.756407 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c283abea-d1cc-47d3-abd1-2db3942ef3d6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:16.763536 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c283abea-d1cc-47d3-abd1-2db3942ef3d6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:16.763995 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c283abea-d1cc-47d3-abd1-2db3942ef3d6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:16.764809 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c283abea-d1cc-47d3-abd1-2db3942ef3d6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:16.765257 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c283abea-d1cc-47d3-abd1-2db3942ef3d6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:16.826340 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c283abea-d1cc-47d3-abd1-2db3942ef3d6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:16.834768 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c283abea-d1cc-47d3-abd1-2db3942ef3d6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082610 Dec 15 13:07:16.835432 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1237/2458] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:16 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:17.391945 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b83204e0-b891-4649-968e-eca61bf001af tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:17.392600 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b83204e0-b891-4649-968e-eca61bf001af tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:17.399669 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b83204e0-b891-4649-968e-eca61bf001af tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:17.400114 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b83204e0-b891-4649-968e-eca61bf001af tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:17.400901 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b83204e0-b891-4649-968e-eca61bf001af tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:17.401312 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b83204e0-b891-4649-968e-eca61bf001af tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:17.467414 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b83204e0-b891-4649-968e-eca61bf001af tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:17.475913 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b83204e0-b891-4649-968e-eca61bf001af tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.087756 Dec 15 13:07:17.476470 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1222/2459] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:17 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:17.851736 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c17cbe5b-15f0-47e0-8400-0ce1c4e40503 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:17.852393 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c17cbe5b-15f0-47e0-8400-0ce1c4e40503 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:17.859229 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c17cbe5b-15f0-47e0-8400-0ce1c4e40503 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:17.859684 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c17cbe5b-15f0-47e0-8400-0ce1c4e40503 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:17.860482 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c17cbe5b-15f0-47e0-8400-0ce1c4e40503 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:17.860920 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c17cbe5b-15f0-47e0-8400-0ce1c4e40503 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:17.925151 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c17cbe5b-15f0-47e0-8400-0ce1c4e40503 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:17.933627 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c17cbe5b-15f0-47e0-8400-0ce1c4e40503 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.085813 Dec 15 13:07:17.934260 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1238/2460] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:17 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:18.493206 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0260b6c9-cfa0-46f4-b6e7-da58cb4b0471 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:18.493917 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0260b6c9-cfa0-46f4-b6e7-da58cb4b0471 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:18.500120 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0260b6c9-cfa0-46f4-b6e7-da58cb4b0471 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:18.500570 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0260b6c9-cfa0-46f4-b6e7-da58cb4b0471 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:18.501381 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0260b6c9-cfa0-46f4-b6e7-da58cb4b0471 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:18.501848 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0260b6c9-cfa0-46f4-b6e7-da58cb4b0471 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:18.561307 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0260b6c9-cfa0-46f4-b6e7-da58cb4b0471 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:18.569135 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0260b6c9-cfa0-46f4-b6e7-da58cb4b0471 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.080304 Dec 15 13:07:18.569725 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1223/2461] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:18 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:18.951339 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-53ad5a3f-02b5-472c-85ea-faf85c1ebdc0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:18.951930 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-53ad5a3f-02b5-472c-85ea-faf85c1ebdc0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:18.958702 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-53ad5a3f-02b5-472c-85ea-faf85c1ebdc0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:18.959147 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-53ad5a3f-02b5-472c-85ea-faf85c1ebdc0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:18.959913 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-53ad5a3f-02b5-472c-85ea-faf85c1ebdc0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:18.960340 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-53ad5a3f-02b5-472c-85ea-faf85c1ebdc0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:19.018907 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-53ad5a3f-02b5-472c-85ea-faf85c1ebdc0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:19.027319 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-53ad5a3f-02b5-472c-85ea-faf85c1ebdc0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.079708 Dec 15 13:07:19.027880 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1239/2462] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:18 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:19.586353 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d12f0def-4f3f-4fd6-9f48-488b75bf0f84 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:19.586936 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d12f0def-4f3f-4fd6-9f48-488b75bf0f84 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:19.593098 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d12f0def-4f3f-4fd6-9f48-488b75bf0f84 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:19.593575 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d12f0def-4f3f-4fd6-9f48-488b75bf0f84 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:19.594357 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d12f0def-4f3f-4fd6-9f48-488b75bf0f84 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:19.594789 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d12f0def-4f3f-4fd6-9f48-488b75bf0f84 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:19.654634 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d12f0def-4f3f-4fd6-9f48-488b75bf0f84 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:19.663069 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d12f0def-4f3f-4fd6-9f48-488b75bf0f84 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.080874 Dec 15 13:07:19.663645 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1224/2463] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:19 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:20.044671 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f5f8e331-888a-4446-a64e-5fb1262c4ab3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:20.045427 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f5f8e331-888a-4446-a64e-5fb1262c4ab3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:20.051584 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f5f8e331-888a-4446-a64e-5fb1262c4ab3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:20.052071 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f5f8e331-888a-4446-a64e-5fb1262c4ab3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:20.052936 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f5f8e331-888a-4446-a64e-5fb1262c4ab3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:20.053376 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f5f8e331-888a-4446-a64e-5fb1262c4ab3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:20.112710 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f5f8e331-888a-4446-a64e-5fb1262c4ab3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:20.121149 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f5f8e331-888a-4446-a64e-5fb1262c4ab3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080154 Dec 15 13:07:20.121754 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1240/2464] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:20 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:20.681899 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-cd47335b-d9c6-4e90-bfec-843676b98893 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:20.682509 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-cd47335b-d9c6-4e90-bfec-843676b98893 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:20.688723 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cd47335b-d9c6-4e90-bfec-843676b98893 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:20.689164 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cd47335b-d9c6-4e90-bfec-843676b98893 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:20.689962 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cd47335b-d9c6-4e90-bfec-843676b98893 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:20.690490 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cd47335b-d9c6-4e90-bfec-843676b98893 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:20.752637 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-cd47335b-d9c6-4e90-bfec-843676b98893 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:20.760620 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cd47335b-d9c6-4e90-bfec-843676b98893 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.083379 Dec 15 13:07:20.761180 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1225/2465] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:20 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:21.139250 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e3f9b0c4-4eec-447e-a143-13766b546ca2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:21.139901 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e3f9b0c4-4eec-447e-a143-13766b546ca2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:21.146913 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e3f9b0c4-4eec-447e-a143-13766b546ca2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:21.147366 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e3f9b0c4-4eec-447e-a143-13766b546ca2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:21.148153 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e3f9b0c4-4eec-447e-a143-13766b546ca2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:21.148593 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e3f9b0c4-4eec-447e-a143-13766b546ca2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:21.211254 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e3f9b0c4-4eec-447e-a143-13766b546ca2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:21.218976 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e3f9b0c4-4eec-447e-a143-13766b546ca2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.083721 Dec 15 13:07:21.219531 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1241/2466] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:21 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:21.777536 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5cca5b44-657e-4b45-88a1-6bcfdbc908ac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:21.778137 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5cca5b44-657e-4b45-88a1-6bcfdbc908ac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:21.784329 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5cca5b44-657e-4b45-88a1-6bcfdbc908ac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:21.784771 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5cca5b44-657e-4b45-88a1-6bcfdbc908ac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:21.785557 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5cca5b44-657e-4b45-88a1-6bcfdbc908ac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:21.785986 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5cca5b44-657e-4b45-88a1-6bcfdbc908ac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:21.844862 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5cca5b44-657e-4b45-88a1-6bcfdbc908ac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:21.852552 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5cca5b44-657e-4b45-88a1-6bcfdbc908ac tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.078737 Dec 15 13:07:21.853135 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1226/2467] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:21 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:22.236066 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-20aa4f88-aede-46dd-8244-8c6ec12372fd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:22.236720 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-20aa4f88-aede-46dd-8244-8c6ec12372fd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:22.243844 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20aa4f88-aede-46dd-8244-8c6ec12372fd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:22.244296 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20aa4f88-aede-46dd-8244-8c6ec12372fd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:22.245071 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20aa4f88-aede-46dd-8244-8c6ec12372fd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:22.245521 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-20aa4f88-aede-46dd-8244-8c6ec12372fd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:22.306271 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-20aa4f88-aede-46dd-8244-8c6ec12372fd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:22.314010 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-20aa4f88-aede-46dd-8244-8c6ec12372fd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081586 Dec 15 13:07:22.314571 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1242/2468] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:22 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:22.871681 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1dff8961-a4ba-4393-ac0c-25b3a08c332a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:22.872324 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1dff8961-a4ba-4393-ac0c-25b3a08c332a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:22.878542 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1dff8961-a4ba-4393-ac0c-25b3a08c332a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:22.878988 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1dff8961-a4ba-4393-ac0c-25b3a08c332a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:22.879758 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1dff8961-a4ba-4393-ac0c-25b3a08c332a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:22.880708 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1dff8961-a4ba-4393-ac0c-25b3a08c332a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:22.941154 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1dff8961-a4ba-4393-ac0c-25b3a08c332a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:22.949454 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1dff8961-a4ba-4393-ac0c-25b3a08c332a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081483 Dec 15 13:07:22.950051 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1227/2469] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:22 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:23.337739 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-83380405-b87e-4791-a4b2-75c1ad6297ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:23.338357 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-83380405-b87e-4791-a4b2-75c1ad6297ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:23.345569 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-83380405-b87e-4791-a4b2-75c1ad6297ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:23.346028 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-83380405-b87e-4791-a4b2-75c1ad6297ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:23.346807 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-83380405-b87e-4791-a4b2-75c1ad6297ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:23.347255 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-83380405-b87e-4791-a4b2-75c1ad6297ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:23.406991 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-83380405-b87e-4791-a4b2-75c1ad6297ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:23.414777 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-83380405-b87e-4791-a4b2-75c1ad6297ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080670 Dec 15 13:07:23.415342 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1243/2470] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:23 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:23.967083 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-01564d35-4a8e-4a5b-a797-1d338e45b768 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:23.967686 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-01564d35-4a8e-4a5b-a797-1d338e45b768 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:23.974702 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-01564d35-4a8e-4a5b-a797-1d338e45b768 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:23.975157 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-01564d35-4a8e-4a5b-a797-1d338e45b768 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:23.975933 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-01564d35-4a8e-4a5b-a797-1d338e45b768 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:23.976368 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-01564d35-4a8e-4a5b-a797-1d338e45b768 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:24.037122 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-01564d35-4a8e-4a5b-a797-1d338e45b768 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:24.045170 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-01564d35-4a8e-4a5b-a797-1d338e45b768 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081653 Dec 15 13:07:24.045806 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1228/2471] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:23 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:24.431944 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d5eacd38-3432-4b28-881b-142166210fa8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:24.432548 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d5eacd38-3432-4b28-881b-142166210fa8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:24.438962 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d5eacd38-3432-4b28-881b-142166210fa8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:24.439414 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d5eacd38-3432-4b28-881b-142166210fa8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:24.440189 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d5eacd38-3432-4b28-881b-142166210fa8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:24.440625 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d5eacd38-3432-4b28-881b-142166210fa8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:24.502671 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d5eacd38-3432-4b28-881b-142166210fa8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:24.511218 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d5eacd38-3432-4b28-881b-142166210fa8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.083069 Dec 15 13:07:24.511823 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1244/2472] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:24 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:25.062634 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d5738b4f-362b-44b2-8beb-5c40eaa9560d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:25.063249 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d5738b4f-362b-44b2-8beb-5c40eaa9560d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:25.070128 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d5738b4f-362b-44b2-8beb-5c40eaa9560d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:25.070581 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d5738b4f-362b-44b2-8beb-5c40eaa9560d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:25.071356 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d5738b4f-362b-44b2-8beb-5c40eaa9560d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:25.071791 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d5738b4f-362b-44b2-8beb-5c40eaa9560d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:25.132057 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d5738b4f-362b-44b2-8beb-5c40eaa9560d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:25.140083 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d5738b4f-362b-44b2-8beb-5c40eaa9560d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081082 Dec 15 13:07:25.140667 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1229/2473] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:25 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:25.532247 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-94ed8292-70fe-455d-b5b1-313d60181e7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:25.532854 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-94ed8292-70fe-455d-b5b1-313d60181e7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:25.540310 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-94ed8292-70fe-455d-b5b1-313d60181e7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:25.540778 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-94ed8292-70fe-455d-b5b1-313d60181e7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:25.541585 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-94ed8292-70fe-455d-b5b1-313d60181e7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:25.542026 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-94ed8292-70fe-455d-b5b1-313d60181e7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:25.602328 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-94ed8292-70fe-455d-b5b1-313d60181e7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:25.610401 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-94ed8292-70fe-455d-b5b1-313d60181e7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081859 Dec 15 13:07:25.611006 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1245/2474] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:25 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:26.157211 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fd1631d8-d0d8-44fb-8d8e-322f69c79a17 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:26.157881 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fd1631d8-d0d8-44fb-8d8e-322f69c79a17 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:26.164857 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fd1631d8-d0d8-44fb-8d8e-322f69c79a17 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:26.165300 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fd1631d8-d0d8-44fb-8d8e-322f69c79a17 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:26.166116 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fd1631d8-d0d8-44fb-8d8e-322f69c79a17 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:26.166557 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fd1631d8-d0d8-44fb-8d8e-322f69c79a17 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:26.226627 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fd1631d8-d0d8-44fb-8d8e-322f69c79a17 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:26.234496 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fd1631d8-d0d8-44fb-8d8e-322f69c79a17 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.080869 Dec 15 13:07:26.235083 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1230/2475] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:26 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:26.627103 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f2dab27c-1c91-4cfc-a69a-705095a7da4b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:26.627658 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f2dab27c-1c91-4cfc-a69a-705095a7da4b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:26.634277 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f2dab27c-1c91-4cfc-a69a-705095a7da4b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:26.634737 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f2dab27c-1c91-4cfc-a69a-705095a7da4b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:26.635535 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f2dab27c-1c91-4cfc-a69a-705095a7da4b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:26.635979 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f2dab27c-1c91-4cfc-a69a-705095a7da4b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:26.704073 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f2dab27c-1c91-4cfc-a69a-705095a7da4b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:26.712743 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f2dab27c-1c91-4cfc-a69a-705095a7da4b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.089321 Dec 15 13:07:26.713335 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1246/2476] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:26 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:27.252248 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bd8ebebe-b0f5-4d78-bc0d-0b967d728dca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:27.252900 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bd8ebebe-b0f5-4d78-bc0d-0b967d728dca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:27.259515 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd8ebebe-b0f5-4d78-bc0d-0b967d728dca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:27.259966 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd8ebebe-b0f5-4d78-bc0d-0b967d728dca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:27.260773 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd8ebebe-b0f5-4d78-bc0d-0b967d728dca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:27.261212 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd8ebebe-b0f5-4d78-bc0d-0b967d728dca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:27.326737 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bd8ebebe-b0f5-4d78-bc0d-0b967d728dca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:27.336472 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bd8ebebe-b0f5-4d78-bc0d-0b967d728dca tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.087893 Dec 15 13:07:27.337069 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1231/2477] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:27 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:27.729319 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-78c29d2c-2530-4463-9719-4ab93749ee53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:27.729972 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-78c29d2c-2530-4463-9719-4ab93749ee53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:27.736208 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-78c29d2c-2530-4463-9719-4ab93749ee53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:27.736655 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-78c29d2c-2530-4463-9719-4ab93749ee53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:27.737430 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-78c29d2c-2530-4463-9719-4ab93749ee53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:27.737893 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-78c29d2c-2530-4463-9719-4ab93749ee53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:27.809304 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-78c29d2c-2530-4463-9719-4ab93749ee53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:27.816976 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-78c29d2c-2530-4463-9719-4ab93749ee53 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.091304 Dec 15 13:07:27.817550 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1247/2478] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:27 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:28.354600 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b4af6d64-5ea7-4a7d-8f0b-d940ef65bc86 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:28.355332 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b4af6d64-5ea7-4a7d-8f0b-d940ef65bc86 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:28.361573 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b4af6d64-5ea7-4a7d-8f0b-d940ef65bc86 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:28.362029 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b4af6d64-5ea7-4a7d-8f0b-d940ef65bc86 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:28.362863 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b4af6d64-5ea7-4a7d-8f0b-d940ef65bc86 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:28.363304 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b4af6d64-5ea7-4a7d-8f0b-d940ef65bc86 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:28.426137 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b4af6d64-5ea7-4a7d-8f0b-d940ef65bc86 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:28.435581 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b4af6d64-5ea7-4a7d-8f0b-d940ef65bc86 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.085289 Dec 15 13:07:28.436169 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1232/2479] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:28 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:28.835314 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9708b7e3-b448-428b-b08e-9451da439ffd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:28.835989 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9708b7e3-b448-428b-b08e-9451da439ffd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:28.842733 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9708b7e3-b448-428b-b08e-9451da439ffd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:28.843732 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9708b7e3-b448-428b-b08e-9451da439ffd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:28.844899 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9708b7e3-b448-428b-b08e-9451da439ffd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:28.845568 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9708b7e3-b448-428b-b08e-9451da439ffd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:28.907855 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9708b7e3-b448-428b-b08e-9451da439ffd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:28.915751 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9708b7e3-b448-428b-b08e-9451da439ffd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.085237 Dec 15 13:07:28.916315 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1248/2480] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:28 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:29.451971 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f9926575-9587-488e-9566-c6b10e7b4b13 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:29.452578 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f9926575-9587-488e-9566-c6b10e7b4b13 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:29.459296 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f9926575-9587-488e-9566-c6b10e7b4b13 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:29.459739 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f9926575-9587-488e-9566-c6b10e7b4b13 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:29.460506 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f9926575-9587-488e-9566-c6b10e7b4b13 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:29.460931 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f9926575-9587-488e-9566-c6b10e7b4b13 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:29.523776 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-f9926575-9587-488e-9566-c6b10e7b4b13 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:29.531817 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f9926575-9587-488e-9566-c6b10e7b4b13 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.083446 Dec 15 13:07:29.532389 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1233/2481] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:29 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:29.933039 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-adf791a2-e498-45bb-909c-6b23c9ba4bbf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:29.933710 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-adf791a2-e498-45bb-909c-6b23c9ba4bbf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:29.940228 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-adf791a2-e498-45bb-909c-6b23c9ba4bbf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:29.940673 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-adf791a2-e498-45bb-909c-6b23c9ba4bbf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:29.941485 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-adf791a2-e498-45bb-909c-6b23c9ba4bbf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:29.941951 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-adf791a2-e498-45bb-909c-6b23c9ba4bbf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:30.002740 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-adf791a2-e498-45bb-909c-6b23c9ba4bbf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:30.011165 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-adf791a2-e498-45bb-909c-6b23c9ba4bbf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082407 Dec 15 13:07:30.011721 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1249/2482] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:29 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:30.549793 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-af3a7e08-7a26-4c95-a525-5bd80751ce67 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:30.550359 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-af3a7e08-7a26-4c95-a525-5bd80751ce67 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:30.557302 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-af3a7e08-7a26-4c95-a525-5bd80751ce67 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:30.557852 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-af3a7e08-7a26-4c95-a525-5bd80751ce67 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:30.558628 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-af3a7e08-7a26-4c95-a525-5bd80751ce67 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:30.559064 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-af3a7e08-7a26-4c95-a525-5bd80751ce67 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:30.618781 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-af3a7e08-7a26-4c95-a525-5bd80751ce67 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:30.627189 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-af3a7e08-7a26-4c95-a525-5bd80751ce67 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081043 Dec 15 13:07:30.627778 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1234/2483] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:30 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:31.028460 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c1a8b45f-d8c1-482e-8c7a-a57261e9d2f6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:31.029108 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c1a8b45f-d8c1-482e-8c7a-a57261e9d2f6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:31.036665 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c1a8b45f-d8c1-482e-8c7a-a57261e9d2f6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:31.037317 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c1a8b45f-d8c1-482e-8c7a-a57261e9d2f6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:31.039118 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c1a8b45f-d8c1-482e-8c7a-a57261e9d2f6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:31.039744 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c1a8b45f-d8c1-482e-8c7a-a57261e9d2f6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:31.105152 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c1a8b45f-d8c1-482e-8c7a-a57261e9d2f6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:31.113035 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c1a8b45f-d8c1-482e-8c7a-a57261e9d2f6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.088290 Dec 15 13:07:31.113642 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1250/2484] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:31 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:31.644042 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-92355802-f8e0-43fb-993b-087dff32f120 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:31.644654 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-92355802-f8e0-43fb-993b-087dff32f120 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:31.651221 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-92355802-f8e0-43fb-993b-087dff32f120 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:31.651657 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-92355802-f8e0-43fb-993b-087dff32f120 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:31.652434 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-92355802-f8e0-43fb-993b-087dff32f120 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:31.652861 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-92355802-f8e0-43fb-993b-087dff32f120 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:31.713539 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-92355802-f8e0-43fb-993b-087dff32f120 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:31.724135 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-92355802-f8e0-43fb-993b-087dff32f120 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.083647 Dec 15 13:07:31.724727 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1235/2485] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:31 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:32.131603 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-aacb6cc5-1899-4656-b112-428919265e72 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:32.132255 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-aacb6cc5-1899-4656-b112-428919265e72 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:32.143958 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aacb6cc5-1899-4656-b112-428919265e72 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:32.144777 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aacb6cc5-1899-4656-b112-428919265e72 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:32.146228 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aacb6cc5-1899-4656-b112-428919265e72 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:32.146886 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aacb6cc5-1899-4656-b112-428919265e72 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:32.217972 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-aacb6cc5-1899-4656-b112-428919265e72 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:32.226071 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-aacb6cc5-1899-4656-b112-428919265e72 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.099470 Dec 15 13:07:32.227281 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1251/2486] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:32 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:32.742623 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-51f804ce-0c0c-4a06-86ab-4707e04ffa48 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:32.743454 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-51f804ce-0c0c-4a06-86ab-4707e04ffa48 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:32.749834 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-51f804ce-0c0c-4a06-86ab-4707e04ffa48 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:32.750285 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-51f804ce-0c0c-4a06-86ab-4707e04ffa48 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:32.751070 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-51f804ce-0c0c-4a06-86ab-4707e04ffa48 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:32.751502 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-51f804ce-0c0c-4a06-86ab-4707e04ffa48 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:32.813201 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-51f804ce-0c0c-4a06-86ab-4707e04ffa48 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:32.824530 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-51f804ce-0c0c-4a06-86ab-4707e04ffa48 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.086064 Dec 15 13:07:32.825129 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1236/2487] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:32 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:33.243681 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c83bd861-73ba-4202-b086-9017b5c17bab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:33.244332 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c83bd861-73ba-4202-b086-9017b5c17bab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:33.250901 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c83bd861-73ba-4202-b086-9017b5c17bab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:33.251351 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c83bd861-73ba-4202-b086-9017b5c17bab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:33.252141 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c83bd861-73ba-4202-b086-9017b5c17bab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:33.252582 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c83bd861-73ba-4202-b086-9017b5c17bab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:33.315942 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c83bd861-73ba-4202-b086-9017b5c17bab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:33.324571 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c83bd861-73ba-4202-b086-9017b5c17bab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.084769 Dec 15 13:07:33.325160 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1252/2488] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:33 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:33.841208 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8d33289a-29ae-44f6-a58d-9316e11d5a6a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:33.841853 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8d33289a-29ae-44f6-a58d-9316e11d5a6a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:33.848633 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8d33289a-29ae-44f6-a58d-9316e11d5a6a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:33.849278 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8d33289a-29ae-44f6-a58d-9316e11d5a6a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:33.850201 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8d33289a-29ae-44f6-a58d-9316e11d5a6a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:33.850645 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8d33289a-29ae-44f6-a58d-9316e11d5a6a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:33.916009 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8d33289a-29ae-44f6-a58d-9316e11d5a6a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:33.932226 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8d33289a-29ae-44f6-a58d-9316e11d5a6a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.094732 Dec 15 13:07:33.932816 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1237/2489] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:33 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:34.343093 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-38ab2d55-3661-46c9-968c-037bf3ff9d57 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:34.343725 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-38ab2d55-3661-46c9-968c-037bf3ff9d57 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:34.350468 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-38ab2d55-3661-46c9-968c-037bf3ff9d57 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:34.350925 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-38ab2d55-3661-46c9-968c-037bf3ff9d57 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:34.352218 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-38ab2d55-3661-46c9-968c-037bf3ff9d57 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:34.352651 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-38ab2d55-3661-46c9-968c-037bf3ff9d57 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:34.417283 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-38ab2d55-3661-46c9-968c-037bf3ff9d57 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:34.425374 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-38ab2d55-3661-46c9-968c-037bf3ff9d57 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.086023 Dec 15 13:07:34.425998 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1253/2490] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:34 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:34.948679 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-43a96cf0-477e-4a7c-85fb-48a62238c3ef tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:34.949322 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-43a96cf0-477e-4a7c-85fb-48a62238c3ef tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:34.955765 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-43a96cf0-477e-4a7c-85fb-48a62238c3ef tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:34.956217 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-43a96cf0-477e-4a7c-85fb-48a62238c3ef tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:34.957008 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-43a96cf0-477e-4a7c-85fb-48a62238c3ef tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:34.957448 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-43a96cf0-477e-4a7c-85fb-48a62238c3ef tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:35.020763 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-43a96cf0-477e-4a7c-85fb-48a62238c3ef tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:35.029148 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-43a96cf0-477e-4a7c-85fb-48a62238c3ef tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.084372 Dec 15 13:07:35.029771 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1238/2491] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:34 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:35.442410 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-99772cb7-af53-4415-90c2-6621d4815215 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:35.443131 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-99772cb7-af53-4415-90c2-6621d4815215 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:35.450084 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-99772cb7-af53-4415-90c2-6621d4815215 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:35.450534 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-99772cb7-af53-4415-90c2-6621d4815215 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:35.451311 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-99772cb7-af53-4415-90c2-6621d4815215 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:35.451747 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-99772cb7-af53-4415-90c2-6621d4815215 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:35.510830 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-99772cb7-af53-4415-90c2-6621d4815215 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:35.519255 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-99772cb7-af53-4415-90c2-6621d4815215 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080529 Dec 15 13:07:35.519806 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1254/2492] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:35 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:36.045778 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-05b7808c-9cf8-4494-9f4e-4d8b7ca12b6c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:36.046449 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-05b7808c-9cf8-4494-9f4e-4d8b7ca12b6c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:36.052646 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-05b7808c-9cf8-4494-9f4e-4d8b7ca12b6c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:36.053098 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-05b7808c-9cf8-4494-9f4e-4d8b7ca12b6c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:36.053907 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-05b7808c-9cf8-4494-9f4e-4d8b7ca12b6c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:36.054366 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-05b7808c-9cf8-4494-9f4e-4d8b7ca12b6c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:36.117981 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-05b7808c-9cf8-4494-9f4e-4d8b7ca12b6c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:36.125994 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-05b7808c-9cf8-4494-9f4e-4d8b7ca12b6c tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.083789 Dec 15 13:07:36.126565 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1239/2493] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:36 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:36.536017 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-683b5979-3a5d-463e-a9c3-2c7d2e97a23e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:36.536620 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-683b5979-3a5d-463e-a9c3-2c7d2e97a23e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:36.542973 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-683b5979-3a5d-463e-a9c3-2c7d2e97a23e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:36.543422 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-683b5979-3a5d-463e-a9c3-2c7d2e97a23e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:36.544195 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-683b5979-3a5d-463e-a9c3-2c7d2e97a23e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:36.544632 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-683b5979-3a5d-463e-a9c3-2c7d2e97a23e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:36.603938 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-683b5979-3a5d-463e-a9c3-2c7d2e97a23e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:36.611820 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-683b5979-3a5d-463e-a9c3-2c7d2e97a23e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.079479 Dec 15 13:07:36.612377 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1255/2494] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:36 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:37.143013 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-261c5959-cc28-4134-8464-f888fca78b0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:37.143632 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-261c5959-cc28-4134-8464-f888fca78b0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:37.150004 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-261c5959-cc28-4134-8464-f888fca78b0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:37.150502 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-261c5959-cc28-4134-8464-f888fca78b0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:37.151349 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-261c5959-cc28-4134-8464-f888fca78b0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:37.151794 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-261c5959-cc28-4134-8464-f888fca78b0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:37.213052 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-261c5959-cc28-4134-8464-f888fca78b0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:37.220921 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-261c5959-cc28-4134-8464-f888fca78b0f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081643 Dec 15 13:07:37.221486 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1240/2495] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:37 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:37.628835 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2645e9a9-7940-4245-ba2d-5d401204a940 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:37.629482 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2645e9a9-7940-4245-ba2d-5d401204a940 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:37.635947 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2645e9a9-7940-4245-ba2d-5d401204a940 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:37.636402 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2645e9a9-7940-4245-ba2d-5d401204a940 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:37.637190 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2645e9a9-7940-4245-ba2d-5d401204a940 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:37.637919 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2645e9a9-7940-4245-ba2d-5d401204a940 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:37.702627 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2645e9a9-7940-4245-ba2d-5d401204a940 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:37.711534 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2645e9a9-7940-4245-ba2d-5d401204a940 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.085635 Dec 15 13:07:37.712156 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1256/2496] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:37 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:38.238592 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-546d3781-16bd-42c1-a328-3c8bb7a50f1f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:38.239203 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-546d3781-16bd-42c1-a328-3c8bb7a50f1f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:38.253431 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-546d3781-16bd-42c1-a328-3c8bb7a50f1f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:38.253912 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-546d3781-16bd-42c1-a328-3c8bb7a50f1f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:38.254704 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-546d3781-16bd-42c1-a328-3c8bb7a50f1f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:38.255399 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-546d3781-16bd-42c1-a328-3c8bb7a50f1f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:38.322821 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-546d3781-16bd-42c1-a328-3c8bb7a50f1f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:38.330809 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-546d3781-16bd-42c1-a328-3c8bb7a50f1f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.095853 Dec 15 13:07:38.331377 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1241/2497] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:38 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:38.728501 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ffd5a3c6-051c-4c3e-99bd-10e136c7414f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:38.729688 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ffd5a3c6-051c-4c3e-99bd-10e136c7414f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:38.736057 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ffd5a3c6-051c-4c3e-99bd-10e136c7414f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:38.736507 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ffd5a3c6-051c-4c3e-99bd-10e136c7414f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:38.737319 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ffd5a3c6-051c-4c3e-99bd-10e136c7414f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:38.737810 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ffd5a3c6-051c-4c3e-99bd-10e136c7414f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:38.802517 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ffd5a3c6-051c-4c3e-99bd-10e136c7414f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:38.810974 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ffd5a3c6-051c-4c3e-99bd-10e136c7414f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.086621 Dec 15 13:07:38.811531 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1257/2498] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:38 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:39.347782 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4a11dfe6-07b8-4742-a14f-8b2e12359cab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:39.348328 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4a11dfe6-07b8-4742-a14f-8b2e12359cab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:39.355028 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a11dfe6-07b8-4742-a14f-8b2e12359cab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:39.355476 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a11dfe6-07b8-4742-a14f-8b2e12359cab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:39.356244 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a11dfe6-07b8-4742-a14f-8b2e12359cab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:39.356671 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a11dfe6-07b8-4742-a14f-8b2e12359cab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:39.418388 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4a11dfe6-07b8-4742-a14f-8b2e12359cab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:39.426049 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4a11dfe6-07b8-4742-a14f-8b2e12359cab tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.082035 Dec 15 13:07:39.426669 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1242/2499] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:39 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:39.827521 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c814bb12-59d4-482f-812d-5bfbbbc1c04b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:39.828146 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c814bb12-59d4-482f-812d-5bfbbbc1c04b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:39.834317 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c814bb12-59d4-482f-812d-5bfbbbc1c04b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:39.834764 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c814bb12-59d4-482f-812d-5bfbbbc1c04b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:39.835533 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c814bb12-59d4-482f-812d-5bfbbbc1c04b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:39.836109 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c814bb12-59d4-482f-812d-5bfbbbc1c04b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:39.895505 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c814bb12-59d4-482f-812d-5bfbbbc1c04b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:39.903682 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c814bb12-59d4-482f-812d-5bfbbbc1c04b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.079814 Dec 15 13:07:39.904261 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1258/2500] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:39 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:40.442775 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9cff366b-b878-4533-937a-a38f8e4f7fc1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:40.443338 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9cff366b-b878-4533-937a-a38f8e4f7fc1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:40.451327 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9cff366b-b878-4533-937a-a38f8e4f7fc1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:40.451771 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9cff366b-b878-4533-937a-a38f8e4f7fc1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:40.452559 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9cff366b-b878-4533-937a-a38f8e4f7fc1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:40.452987 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9cff366b-b878-4533-937a-a38f8e4f7fc1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:40.512643 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9cff366b-b878-4533-937a-a38f8e4f7fc1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:40.520360 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9cff366b-b878-4533-937a-a38f8e4f7fc1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081346 Dec 15 13:07:40.520925 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1243/2501] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:40 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:40.920445 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-502f1c9c-fc9e-4f0f-88db-ea51342849ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:40.921052 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-502f1c9c-fc9e-4f0f-88db-ea51342849ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:40.927258 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-502f1c9c-fc9e-4f0f-88db-ea51342849ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:40.927700 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-502f1c9c-fc9e-4f0f-88db-ea51342849ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:40.928460 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-502f1c9c-fc9e-4f0f-88db-ea51342849ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:40.928890 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-502f1c9c-fc9e-4f0f-88db-ea51342849ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:40.991586 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-502f1c9c-fc9e-4f0f-88db-ea51342849ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:41.000418 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-502f1c9c-fc9e-4f0f-88db-ea51342849ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.083530 Dec 15 13:07:41.001000 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1259/2502] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:40 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:41.537664 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-22aa115b-43f7-4c6f-ad04-50b37562ce24 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:41.538301 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-22aa115b-43f7-4c6f-ad04-50b37562ce24 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:41.545010 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-22aa115b-43f7-4c6f-ad04-50b37562ce24 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:41.545449 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-22aa115b-43f7-4c6f-ad04-50b37562ce24 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:41.546249 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-22aa115b-43f7-4c6f-ad04-50b37562ce24 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:41.546678 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-22aa115b-43f7-4c6f-ad04-50b37562ce24 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:41.607054 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-22aa115b-43f7-4c6f-ad04-50b37562ce24 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:41.615013 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-22aa115b-43f7-4c6f-ad04-50b37562ce24 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081032 Dec 15 13:07:41.615579 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1244/2503] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:41 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:42.017372 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6be7d2ff-20e3-4d53-a656-5c651edeb168 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:42.018028 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6be7d2ff-20e3-4d53-a656-5c651edeb168 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:42.024717 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6be7d2ff-20e3-4d53-a656-5c651edeb168 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:42.025172 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6be7d2ff-20e3-4d53-a656-5c651edeb168 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:42.026062 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6be7d2ff-20e3-4d53-a656-5c651edeb168 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:42.026485 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6be7d2ff-20e3-4d53-a656-5c651edeb168 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:42.087305 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6be7d2ff-20e3-4d53-a656-5c651edeb168 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:42.095960 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6be7d2ff-20e3-4d53-a656-5c651edeb168 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081981 Dec 15 13:07:42.096606 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1260/2504] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:42 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:42.632144 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3a7f5652-faef-4759-b50f-821703674959 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:42.633008 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3a7f5652-faef-4759-b50f-821703674959 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:42.639622 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3a7f5652-faef-4759-b50f-821703674959 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:42.640163 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3a7f5652-faef-4759-b50f-821703674959 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:42.640949 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3a7f5652-faef-4759-b50f-821703674959 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:42.641377 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3a7f5652-faef-4759-b50f-821703674959 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:42.702442 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3a7f5652-faef-4759-b50f-821703674959 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:42.710262 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3a7f5652-faef-4759-b50f-821703674959 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081770 Dec 15 13:07:42.711538 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1245/2505] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:42 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:43.114060 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ea17d4cc-c130-4718-bca2-65d1fd3695af tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:43.114639 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ea17d4cc-c130-4718-bca2-65d1fd3695af tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:43.121052 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea17d4cc-c130-4718-bca2-65d1fd3695af tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:43.121528 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea17d4cc-c130-4718-bca2-65d1fd3695af tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:43.122319 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea17d4cc-c130-4718-bca2-65d1fd3695af tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:43.122760 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea17d4cc-c130-4718-bca2-65d1fd3695af tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:43.184772 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ea17d4cc-c130-4718-bca2-65d1fd3695af tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:43.200246 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ea17d4cc-c130-4718-bca2-65d1fd3695af tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.090300 Dec 15 13:07:43.200845 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1261/2506] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:43 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:43.730518 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ecbed814-9007-4c04-86c2-5776086b0d42 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:43.731145 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ecbed814-9007-4c04-86c2-5776086b0d42 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:43.737750 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ecbed814-9007-4c04-86c2-5776086b0d42 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:43.738206 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ecbed814-9007-4c04-86c2-5776086b0d42 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:43.738990 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ecbed814-9007-4c04-86c2-5776086b0d42 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:43.739477 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ecbed814-9007-4c04-86c2-5776086b0d42 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:43.799439 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ecbed814-9007-4c04-86c2-5776086b0d42 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:43.807924 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ecbed814-9007-4c04-86c2-5776086b0d42 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.083409 Dec 15 13:07:43.808492 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1246/2507] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:43 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:44.216925 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-aea617a3-bdcc-4683-8198-b2a708438883 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:44.217559 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-aea617a3-bdcc-4683-8198-b2a708438883 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:44.223928 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aea617a3-bdcc-4683-8198-b2a708438883 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:44.224380 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aea617a3-bdcc-4683-8198-b2a708438883 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:44.225154 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aea617a3-bdcc-4683-8198-b2a708438883 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:44.225621 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aea617a3-bdcc-4683-8198-b2a708438883 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:44.297604 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-aea617a3-bdcc-4683-8198-b2a708438883 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:44.306297 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-aea617a3-bdcc-4683-8198-b2a708438883 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.092936 Dec 15 13:07:44.306844 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1262/2508] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:44 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:44.825455 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3848528f-28d7-4bc1-b034-275d2bfb44f3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:44.826143 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3848528f-28d7-4bc1-b034-275d2bfb44f3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:44.832349 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3848528f-28d7-4bc1-b034-275d2bfb44f3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:44.832789 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3848528f-28d7-4bc1-b034-275d2bfb44f3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:44.833579 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3848528f-28d7-4bc1-b034-275d2bfb44f3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:44.834010 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3848528f-28d7-4bc1-b034-275d2bfb44f3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:44.895636 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3848528f-28d7-4bc1-b034-275d2bfb44f3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:44.904666 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3848528f-28d7-4bc1-b034-275d2bfb44f3 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.082832 Dec 15 13:07:44.905234 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1247/2509] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:44 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:45.322119 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d3c388ed-46f7-4a87-8ac0-6da800c6d1ff tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:45.322755 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d3c388ed-46f7-4a87-8ac0-6da800c6d1ff tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:45.329800 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d3c388ed-46f7-4a87-8ac0-6da800c6d1ff tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:45.330260 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d3c388ed-46f7-4a87-8ac0-6da800c6d1ff tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:45.331078 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d3c388ed-46f7-4a87-8ac0-6da800c6d1ff tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:45.331527 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d3c388ed-46f7-4a87-8ac0-6da800c6d1ff tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:45.391596 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d3c388ed-46f7-4a87-8ac0-6da800c6d1ff tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:45.399625 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d3c388ed-46f7-4a87-8ac0-6da800c6d1ff tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081203 Dec 15 13:07:45.400195 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1263/2510] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:45 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:45.921694 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-de25b820-a3f9-40d0-bb3a-a0d50eb155a8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:45.922355 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-de25b820-a3f9-40d0-bb3a-a0d50eb155a8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:45.928913 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-de25b820-a3f9-40d0-bb3a-a0d50eb155a8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:45.929946 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-de25b820-a3f9-40d0-bb3a-a0d50eb155a8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:45.930794 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-de25b820-a3f9-40d0-bb3a-a0d50eb155a8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:45.931234 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-de25b820-a3f9-40d0-bb3a-a0d50eb155a8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:45.993416 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-de25b820-a3f9-40d0-bb3a-a0d50eb155a8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:46.001143 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-de25b820-a3f9-40d0-bb3a-a0d50eb155a8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.083173 Dec 15 13:07:46.001738 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1248/2511] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:45 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:46.416653 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-495b8bae-6fb9-4f68-9acd-ebc47280d369 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:46.417298 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-495b8bae-6fb9-4f68-9acd-ebc47280d369 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:46.424075 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-495b8bae-6fb9-4f68-9acd-ebc47280d369 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:46.424589 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-495b8bae-6fb9-4f68-9acd-ebc47280d369 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:46.425417 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-495b8bae-6fb9-4f68-9acd-ebc47280d369 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:46.425904 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-495b8bae-6fb9-4f68-9acd-ebc47280d369 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:46.486433 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-495b8bae-6fb9-4f68-9acd-ebc47280d369 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:46.494978 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-495b8bae-6fb9-4f68-9acd-ebc47280d369 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082603 Dec 15 13:07:46.495676 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1264/2512] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:46 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:07:47.018979 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-61df12d8-56a2-48ec-94f2-6e2879cb77bc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:47.019572 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-61df12d8-56a2-48ec-94f2-6e2879cb77bc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:47.026572 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-61df12d8-56a2-48ec-94f2-6e2879cb77bc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:47.027019 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-61df12d8-56a2-48ec-94f2-6e2879cb77bc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:47.027786 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-61df12d8-56a2-48ec-94f2-6e2879cb77bc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:47.028215 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-61df12d8-56a2-48ec-94f2-6e2879cb77bc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:47.087617 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-61df12d8-56a2-48ec-94f2-6e2879cb77bc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:47.095386 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-61df12d8-56a2-48ec-94f2-6e2879cb77bc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.080089 Dec 15 13:07:47.096449 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1249/2513] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:47 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:47.512380 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-662b804a-4a30-4a79-a35f-03db8ace088f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:47.513268 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-662b804a-4a30-4a79-a35f-03db8ace088f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:47.519698 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-662b804a-4a30-4a79-a35f-03db8ace088f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:47.520143 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-662b804a-4a30-4a79-a35f-03db8ace088f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:47.520940 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-662b804a-4a30-4a79-a35f-03db8ace088f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:47.521371 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-662b804a-4a30-4a79-a35f-03db8ace088f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:47.591773 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-662b804a-4a30-4a79-a35f-03db8ace088f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:47.599528 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-662b804a-4a30-4a79-a35f-03db8ace088f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.090887 Dec 15 13:07:47.600093 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1265/2514] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:47 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:48.112833 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7129aa1a-b81a-4118-9e34-2a4f93d5de4b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:48.113440 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7129aa1a-b81a-4118-9e34-2a4f93d5de4b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:48.122940 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7129aa1a-b81a-4118-9e34-2a4f93d5de4b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:48.122940 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7129aa1a-b81a-4118-9e34-2a4f93d5de4b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:48.122940 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7129aa1a-b81a-4118-9e34-2a4f93d5de4b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:48.122940 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7129aa1a-b81a-4118-9e34-2a4f93d5de4b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:48.185880 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7129aa1a-b81a-4118-9e34-2a4f93d5de4b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:48.198669 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7129aa1a-b81a-4118-9e34-2a4f93d5de4b tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.089539 Dec 15 13:07:48.199292 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1250/2515] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:48 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:48.616009 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9ec53b9c-4a43-4ae9-8fdb-7ca20834a8a2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:48.616777 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9ec53b9c-4a43-4ae9-8fdb-7ca20834a8a2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:48.623498 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9ec53b9c-4a43-4ae9-8fdb-7ca20834a8a2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:48.623956 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9ec53b9c-4a43-4ae9-8fdb-7ca20834a8a2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:48.624749 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9ec53b9c-4a43-4ae9-8fdb-7ca20834a8a2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:48.625182 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9ec53b9c-4a43-4ae9-8fdb-7ca20834a8a2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:48.687380 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9ec53b9c-4a43-4ae9-8fdb-7ca20834a8a2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:48.696424 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9ec53b9c-4a43-4ae9-8fdb-7ca20834a8a2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.083856 Dec 15 13:07:48.696993 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1266/2516] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:48 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:49.215588 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6c16173c-fcce-4555-899d-4c150663d228 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:49.216226 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6c16173c-fcce-4555-899d-4c150663d228 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:49.222473 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6c16173c-fcce-4555-899d-4c150663d228 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:49.222928 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6c16173c-fcce-4555-899d-4c150663d228 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:49.223712 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6c16173c-fcce-4555-899d-4c150663d228 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:49.224149 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6c16173c-fcce-4555-899d-4c150663d228 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:49.285716 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6c16173c-fcce-4555-899d-4c150663d228 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:49.294454 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6c16173c-fcce-4555-899d-4c150663d228 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.082544 Dec 15 13:07:49.295072 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1251/2517] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:49 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:49.713684 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-43a41673-8005-440c-b2f2-c5fc06c2d87b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:49.714576 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-43a41673-8005-440c-b2f2-c5fc06c2d87b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:49.723204 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-43a41673-8005-440c-b2f2-c5fc06c2d87b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:49.723657 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-43a41673-8005-440c-b2f2-c5fc06c2d87b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:49.724454 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-43a41673-8005-440c-b2f2-c5fc06c2d87b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:49.724895 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-43a41673-8005-440c-b2f2-c5fc06c2d87b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:49.785676 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-43a41673-8005-440c-b2f2-c5fc06c2d87b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:49.794433 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-43a41673-8005-440c-b2f2-c5fc06c2d87b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.086105 Dec 15 13:07:49.795009 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1267/2518] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:49 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:50.311360 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d23cd45d-5dbd-473f-8305-54dadab2984f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:50.312004 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d23cd45d-5dbd-473f-8305-54dadab2984f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:50.318530 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d23cd45d-5dbd-473f-8305-54dadab2984f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:50.318978 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d23cd45d-5dbd-473f-8305-54dadab2984f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:50.319832 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d23cd45d-5dbd-473f-8305-54dadab2984f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:50.320818 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d23cd45d-5dbd-473f-8305-54dadab2984f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:50.392449 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d23cd45d-5dbd-473f-8305-54dadab2984f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:50.403102 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d23cd45d-5dbd-473f-8305-54dadab2984f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.095469 Dec 15 13:07:50.403689 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1252/2519] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:50 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:50.812541 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d5b3e35e-2566-4fd4-99b2-436f90d2bba2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:50.813178 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d5b3e35e-2566-4fd4-99b2-436f90d2bba2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:50.819840 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d5b3e35e-2566-4fd4-99b2-436f90d2bba2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:50.820301 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d5b3e35e-2566-4fd4-99b2-436f90d2bba2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:50.821084 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d5b3e35e-2566-4fd4-99b2-436f90d2bba2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:50.821551 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d5b3e35e-2566-4fd4-99b2-436f90d2bba2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:50.887721 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d5b3e35e-2566-4fd4-99b2-436f90d2bba2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:50.895786 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d5b3e35e-2566-4fd4-99b2-436f90d2bba2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.088076 Dec 15 13:07:50.896356 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1268/2520] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:50 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:51.420387 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0c00376f-b156-40cc-93b3-3b1e8c0333bf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:51.421003 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0c00376f-b156-40cc-93b3-3b1e8c0333bf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:51.427554 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0c00376f-b156-40cc-93b3-3b1e8c0333bf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:51.428006 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0c00376f-b156-40cc-93b3-3b1e8c0333bf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:51.428837 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0c00376f-b156-40cc-93b3-3b1e8c0333bf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:51.429465 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0c00376f-b156-40cc-93b3-3b1e8c0333bf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:51.493207 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0c00376f-b156-40cc-93b3-3b1e8c0333bf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:51.501175 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0c00376f-b156-40cc-93b3-3b1e8c0333bf tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.084697 Dec 15 13:07:51.501786 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1253/2521] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:51 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:51.913008 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6a211cc9-3fad-4774-98b8-f4cd9070902f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:51.913645 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6a211cc9-3fad-4774-98b8-f4cd9070902f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:51.919858 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6a211cc9-3fad-4774-98b8-f4cd9070902f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:51.920306 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6a211cc9-3fad-4774-98b8-f4cd9070902f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:51.921073 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6a211cc9-3fad-4774-98b8-f4cd9070902f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:51.921532 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6a211cc9-3fad-4774-98b8-f4cd9070902f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:51.980389 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6a211cc9-3fad-4774-98b8-f4cd9070902f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:51.988190 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6a211cc9-3fad-4774-98b8-f4cd9070902f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.078845 Dec 15 13:07:51.988759 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1269/2522] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:51 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:52.518699 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a53f878b-81b8-41be-8ccc-f7a5f0beb3c6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:52.519254 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a53f878b-81b8-41be-8ccc-f7a5f0beb3c6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:52.526121 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a53f878b-81b8-41be-8ccc-f7a5f0beb3c6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:52.526679 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a53f878b-81b8-41be-8ccc-f7a5f0beb3c6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:52.527532 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a53f878b-81b8-41be-8ccc-f7a5f0beb3c6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:52.527981 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a53f878b-81b8-41be-8ccc-f7a5f0beb3c6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:52.595210 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a53f878b-81b8-41be-8ccc-f7a5f0beb3c6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:52.604062 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a53f878b-81b8-41be-8ccc-f7a5f0beb3c6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.089109 Dec 15 13:07:52.604631 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1254/2523] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:52 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:53.005420 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-867dbe68-c70e-46d5-b8a9-a187e6223a78 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:53.006049 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-867dbe68-c70e-46d5-b8a9-a187e6223a78 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:53.013123 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-867dbe68-c70e-46d5-b8a9-a187e6223a78 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:53.013604 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-867dbe68-c70e-46d5-b8a9-a187e6223a78 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:53.014408 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-867dbe68-c70e-46d5-b8a9-a187e6223a78 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:53.014828 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-867dbe68-c70e-46d5-b8a9-a187e6223a78 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:53.075474 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-867dbe68-c70e-46d5-b8a9-a187e6223a78 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:53.083318 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-867dbe68-c70e-46d5-b8a9-a187e6223a78 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081598 Dec 15 13:07:53.083892 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1270/2524] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:53 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:53.621232 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a0ebdc0c-6878-4c55-a0ba-04ac03cb8b30 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:53.621822 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a0ebdc0c-6878-4c55-a0ba-04ac03cb8b30 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:53.628529 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a0ebdc0c-6878-4c55-a0ba-04ac03cb8b30 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:53.628979 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a0ebdc0c-6878-4c55-a0ba-04ac03cb8b30 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:53.629823 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a0ebdc0c-6878-4c55-a0ba-04ac03cb8b30 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:53.630259 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a0ebdc0c-6878-4c55-a0ba-04ac03cb8b30 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:53.690502 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a0ebdc0c-6878-4c55-a0ba-04ac03cb8b30 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:53.698568 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a0ebdc0c-6878-4c55-a0ba-04ac03cb8b30 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081824 Dec 15 13:07:53.699133 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1255/2525] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:53 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:54.100651 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-33e93463-6712-46b9-9f3c-9101c2b961cd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:54.101262 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-33e93463-6712-46b9-9f3c-9101c2b961cd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:54.108696 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-33e93463-6712-46b9-9f3c-9101c2b961cd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:54.109145 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-33e93463-6712-46b9-9f3c-9101c2b961cd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:54.109946 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-33e93463-6712-46b9-9f3c-9101c2b961cd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:54.110387 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-33e93463-6712-46b9-9f3c-9101c2b961cd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:54.172452 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-33e93463-6712-46b9-9f3c-9101c2b961cd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:54.181809 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-33e93463-6712-46b9-9f3c-9101c2b961cd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.085258 Dec 15 13:07:54.182391 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1271/2526] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:54 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:54.714443 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c582de45-017c-4fd9-b300-9c648960b1d4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:54.715058 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c582de45-017c-4fd9-b300-9c648960b1d4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:54.721355 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c582de45-017c-4fd9-b300-9c648960b1d4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:54.721845 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c582de45-017c-4fd9-b300-9c648960b1d4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:54.722635 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c582de45-017c-4fd9-b300-9c648960b1d4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:54.723094 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c582de45-017c-4fd9-b300-9c648960b1d4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:54.784363 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c582de45-017c-4fd9-b300-9c648960b1d4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:54.792427 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c582de45-017c-4fd9-b300-9c648960b1d4 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081661 Dec 15 13:07:54.792998 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1256/2527] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:54 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:55.199132 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-172dfc2a-6265-4764-8998-e1276035cbbb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:55.199793 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-172dfc2a-6265-4764-8998-e1276035cbbb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:55.206255 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-172dfc2a-6265-4764-8998-e1276035cbbb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:55.206703 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-172dfc2a-6265-4764-8998-e1276035cbbb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:55.207482 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-172dfc2a-6265-4764-8998-e1276035cbbb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:55.207917 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-172dfc2a-6265-4764-8998-e1276035cbbb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:55.268226 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-172dfc2a-6265-4764-8998-e1276035cbbb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:55.276203 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-172dfc2a-6265-4764-8998-e1276035cbbb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081404 Dec 15 13:07:55.276767 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1272/2528] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:55 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:55.809158 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-149d82cf-17c8-4ad2-8057-7b3c3c953720 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:55.809792 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-149d82cf-17c8-4ad2-8057-7b3c3c953720 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:55.816414 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-149d82cf-17c8-4ad2-8057-7b3c3c953720 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:55.816869 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-149d82cf-17c8-4ad2-8057-7b3c3c953720 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:55.817704 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-149d82cf-17c8-4ad2-8057-7b3c3c953720 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:55.818148 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-149d82cf-17c8-4ad2-8057-7b3c3c953720 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:55.878346 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-149d82cf-17c8-4ad2-8057-7b3c3c953720 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:55.886740 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-149d82cf-17c8-4ad2-8057-7b3c3c953720 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081232 Dec 15 13:07:55.887299 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1257/2529] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:55 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:56.292456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-951b44d2-a632-48f0-8eae-a08a38623230 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:56.293051 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-951b44d2-a632-48f0-8eae-a08a38623230 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:56.299702 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-951b44d2-a632-48f0-8eae-a08a38623230 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:56.300448 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-951b44d2-a632-48f0-8eae-a08a38623230 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:56.300953 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-951b44d2-a632-48f0-8eae-a08a38623230 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:56.301388 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-951b44d2-a632-48f0-8eae-a08a38623230 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:56.361473 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-951b44d2-a632-48f0-8eae-a08a38623230 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:56.369794 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-951b44d2-a632-48f0-8eae-a08a38623230 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081152 Dec 15 13:07:56.370367 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1273/2530] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:56 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:56.904256 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e1dcc295-6dea-4fcc-a8e5-9a0fcf7f2280 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:56.904906 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e1dcc295-6dea-4fcc-a8e5-9a0fcf7f2280 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:56.912905 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e1dcc295-6dea-4fcc-a8e5-9a0fcf7f2280 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:56.913358 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e1dcc295-6dea-4fcc-a8e5-9a0fcf7f2280 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:56.914220 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e1dcc295-6dea-4fcc-a8e5-9a0fcf7f2280 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:56.914660 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e1dcc295-6dea-4fcc-a8e5-9a0fcf7f2280 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:56.974806 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e1dcc295-6dea-4fcc-a8e5-9a0fcf7f2280 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:56.983329 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e1dcc295-6dea-4fcc-a8e5-9a0fcf7f2280 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.082752 Dec 15 13:07:56.983901 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1258/2531] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:56 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:57.387213 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3f702465-8dc5-4a0c-af3b-1e225c129179 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:57.388091 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3f702465-8dc5-4a0c-af3b-1e225c129179 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:57.394330 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3f702465-8dc5-4a0c-af3b-1e225c129179 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:57.394776 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3f702465-8dc5-4a0c-af3b-1e225c129179 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:57.395539 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3f702465-8dc5-4a0c-af3b-1e225c129179 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:57.395974 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3f702465-8dc5-4a0c-af3b-1e225c129179 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:57.457726 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3f702465-8dc5-4a0c-af3b-1e225c129179 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:57.466215 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3f702465-8dc5-4a0c-af3b-1e225c129179 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.083473 Dec 15 13:07:57.466778 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1274/2532] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:57 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:57.999970 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-318868f2-c6c4-471a-933b-11c5d6850582 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:58.000589 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-318868f2-c6c4-471a-933b-11c5d6850582 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:58.007082 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-318868f2-c6c4-471a-933b-11c5d6850582 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:58.007653 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-318868f2-c6c4-471a-933b-11c5d6850582 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:58.008972 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-318868f2-c6c4-471a-933b-11c5d6850582 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:58.009410 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-318868f2-c6c4-471a-933b-11c5d6850582 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:58.070621 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-318868f2-c6c4-471a-933b-11c5d6850582 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:58.078573 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-318868f2-c6c4-471a-933b-11c5d6850582 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.082307 Dec 15 13:07:58.079194 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1259/2533] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:57 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:58.482976 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-75802dce-97d5-4171-ba8d-55b54cc6a482 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:58.483594 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-75802dce-97d5-4171-ba8d-55b54cc6a482 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:58.489854 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-75802dce-97d5-4171-ba8d-55b54cc6a482 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:58.490308 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-75802dce-97d5-4171-ba8d-55b54cc6a482 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:58.491086 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-75802dce-97d5-4171-ba8d-55b54cc6a482 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:58.491528 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-75802dce-97d5-4171-ba8d-55b54cc6a482 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:58.514620 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:07:58.516946 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 13:07:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a (ip 10.222.0.76) !!! Dec 15 13:07:58.553919 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-75802dce-97d5-4171-ba8d-55b54cc6a482 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:58.561745 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-75802dce-97d5-4171-ba8d-55b54cc6a482 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082366 Dec 15 13:07:58.562306 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1275/2534] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:58 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:59.095467 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2ff63625-25e4-4e31-8deb-9e2d79b5fa46 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:59.096103 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2ff63625-25e4-4e31-8deb-9e2d79b5fa46 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:59.102951 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2ff63625-25e4-4e31-8deb-9e2d79b5fa46 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:59.103400 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2ff63625-25e4-4e31-8deb-9e2d79b5fa46 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:59.104321 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2ff63625-25e4-4e31-8deb-9e2d79b5fa46 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:59.104628 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2ff63625-25e4-4e31-8deb-9e2d79b5fa46 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:59.166250 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2ff63625-25e4-4e31-8deb-9e2d79b5fa46 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:59.174077 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2ff63625-25e4-4e31-8deb-9e2d79b5fa46 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.082450 Dec 15 13:07:59.174646 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1260/2535] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:59 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:07:59.578301 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-730af5f6-54f5-4296-89f8-df036b268f61 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:07:59.578905 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-730af5f6-54f5-4296-89f8-df036b268f61 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:07:59.585091 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-730af5f6-54f5-4296-89f8-df036b268f61 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:59.585571 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-730af5f6-54f5-4296-89f8-df036b268f61 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:59.586538 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-730af5f6-54f5-4296-89f8-df036b268f61 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:07:59.586973 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-730af5f6-54f5-4296-89f8-df036b268f61 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:07:59.645871 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-730af5f6-54f5-4296-89f8-df036b268f61 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:07:59.653867 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-730af5f6-54f5-4296-89f8-df036b268f61 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.079119 Dec 15 13:07:59.654445 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1276/2536] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:07:59 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:00.191420 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-daf17a04-d41e-4649-9acd-022da6f521d9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:00.192048 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-daf17a04-d41e-4649-9acd-022da6f521d9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:00.198845 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-daf17a04-d41e-4649-9acd-022da6f521d9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:00.199297 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-daf17a04-d41e-4649-9acd-022da6f521d9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:00.200156 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-daf17a04-d41e-4649-9acd-022da6f521d9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:00.200528 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-daf17a04-d41e-4649-9acd-022da6f521d9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:00.268421 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-daf17a04-d41e-4649-9acd-022da6f521d9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:00.276787 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-daf17a04-d41e-4649-9acd-022da6f521d9 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.089142 Dec 15 13:08:00.277365 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1261/2537] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:00 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:00.670207 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b57bfef9-3e75-4eae-bde6-66031c178097 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:00.670867 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b57bfef9-3e75-4eae-bde6-66031c178097 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:00.677152 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b57bfef9-3e75-4eae-bde6-66031c178097 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:00.677633 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b57bfef9-3e75-4eae-bde6-66031c178097 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:00.678419 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b57bfef9-3e75-4eae-bde6-66031c178097 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:00.678862 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b57bfef9-3e75-4eae-bde6-66031c178097 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:00.742410 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b57bfef9-3e75-4eae-bde6-66031c178097 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:00.750504 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b57bfef9-3e75-4eae-bde6-66031c178097 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.083962 Dec 15 13:08:00.751073 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1277/2538] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:00 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:01.293576 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6d044bb8-30cd-4c68-8bc5-fe88bf1305e5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:01.294316 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6d044bb8-30cd-4c68-8bc5-fe88bf1305e5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:01.300999 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d044bb8-30cd-4c68-8bc5-fe88bf1305e5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:01.301654 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d044bb8-30cd-4c68-8bc5-fe88bf1305e5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:01.302271 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d044bb8-30cd-4c68-8bc5-fe88bf1305e5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:01.302705 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d044bb8-30cd-4c68-8bc5-fe88bf1305e5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:01.365885 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6d044bb8-30cd-4c68-8bc5-fe88bf1305e5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:01.374396 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6d044bb8-30cd-4c68-8bc5-fe88bf1305e5 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.085525 Dec 15 13:08:01.374973 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1262/2539] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:01 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:01.768868 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f1e2a5be-d3dd-4767-b13d-7a11c82b4240 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:01.769470 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f1e2a5be-d3dd-4767-b13d-7a11c82b4240 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:01.776573 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f1e2a5be-d3dd-4767-b13d-7a11c82b4240 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:01.777015 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f1e2a5be-d3dd-4767-b13d-7a11c82b4240 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:01.777805 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f1e2a5be-d3dd-4767-b13d-7a11c82b4240 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:01.778237 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f1e2a5be-d3dd-4767-b13d-7a11c82b4240 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:01.847550 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f1e2a5be-d3dd-4767-b13d-7a11c82b4240 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:01.856180 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f1e2a5be-d3dd-4767-b13d-7a11c82b4240 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.090759 Dec 15 13:08:01.856806 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1278/2540] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:01 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:02.392211 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-de4adbe3-2dde-45e6-a018-9596e1963e74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:02.392865 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-de4adbe3-2dde-45e6-a018-9596e1963e74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:02.399195 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-de4adbe3-2dde-45e6-a018-9596e1963e74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:02.399644 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-de4adbe3-2dde-45e6-a018-9596e1963e74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:02.400438 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-de4adbe3-2dde-45e6-a018-9596e1963e74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:02.400873 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-de4adbe3-2dde-45e6-a018-9596e1963e74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:02.459468 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-de4adbe3-2dde-45e6-a018-9596e1963e74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:02.467277 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-de4adbe3-2dde-45e6-a018-9596e1963e74 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.078760 Dec 15 13:08:02.467845 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1263/2541] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:02 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:02.872804 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3faa0d4a-1b64-4e78-9848-10c3a5e84a9e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:02.873422 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3faa0d4a-1b64-4e78-9848-10c3a5e84a9e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:02.879665 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3faa0d4a-1b64-4e78-9848-10c3a5e84a9e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:02.880109 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3faa0d4a-1b64-4e78-9848-10c3a5e84a9e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:02.880872 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3faa0d4a-1b64-4e78-9848-10c3a5e84a9e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:02.881301 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3faa0d4a-1b64-4e78-9848-10c3a5e84a9e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:02.941363 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3faa0d4a-1b64-4e78-9848-10c3a5e84a9e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:02.949861 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3faa0d4a-1b64-4e78-9848-10c3a5e84a9e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080549 Dec 15 13:08:02.950447 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1279/2542] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:02 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:03.484511 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fb0638a7-3a6a-470b-b230-cc8eb13c69e1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:03.485132 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fb0638a7-3a6a-470b-b230-cc8eb13c69e1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:03.491564 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fb0638a7-3a6a-470b-b230-cc8eb13c69e1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:03.492078 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fb0638a7-3a6a-470b-b230-cc8eb13c69e1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:03.492858 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fb0638a7-3a6a-470b-b230-cc8eb13c69e1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:03.493295 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fb0638a7-3a6a-470b-b230-cc8eb13c69e1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:03.557644 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fb0638a7-3a6a-470b-b230-cc8eb13c69e1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:03.567094 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fb0638a7-3a6a-470b-b230-cc8eb13c69e1 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.086150 Dec 15 13:08:03.567925 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1264/2543] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:03 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:08:03.966448 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-af02fa10-0c15-45d1-a21f-0498c1ffed3b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:03.967048 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-af02fa10-0c15-45d1-a21f-0498c1ffed3b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:03.973176 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-af02fa10-0c15-45d1-a21f-0498c1ffed3b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:03.973650 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-af02fa10-0c15-45d1-a21f-0498c1ffed3b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:03.974410 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-af02fa10-0c15-45d1-a21f-0498c1ffed3b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:03.974842 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-af02fa10-0c15-45d1-a21f-0498c1ffed3b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:04.037054 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-af02fa10-0c15-45d1-a21f-0498c1ffed3b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:04.046448 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-af02fa10-0c15-45d1-a21f-0498c1ffed3b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.083377 Dec 15 13:08:04.046880 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1280/2544] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:03 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:04.257012 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:08:04.257241 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 13:08:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:08:04.587323 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f8c411ad-2a2f-40ee-a7b2-92faa8213552 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:04.588080 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f8c411ad-2a2f-40ee-a7b2-92faa8213552 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:04.594486 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f8c411ad-2a2f-40ee-a7b2-92faa8213552 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:04.594933 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f8c411ad-2a2f-40ee-a7b2-92faa8213552 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:04.595717 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f8c411ad-2a2f-40ee-a7b2-92faa8213552 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:04.596147 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f8c411ad-2a2f-40ee-a7b2-92faa8213552 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:04.891590 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-f8c411ad-2a2f-40ee-a7b2-92faa8213552 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:04.900197 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f8c411ad-2a2f-40ee-a7b2-92faa8213552 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.317169 Dec 15 13:08:04.900789 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1265/2545] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:04 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:05.063641 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9b3ac590-bd3e-45c7-9cc7-1377e49347c8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:05.064264 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9b3ac590-bd3e-45c7-9cc7-1377e49347c8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:05.071096 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9b3ac590-bd3e-45c7-9cc7-1377e49347c8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:05.071543 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9b3ac590-bd3e-45c7-9cc7-1377e49347c8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:05.072321 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9b3ac590-bd3e-45c7-9cc7-1377e49347c8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:05.072792 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9b3ac590-bd3e-45c7-9cc7-1377e49347c8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:05.132120 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9b3ac590-bd3e-45c7-9cc7-1377e49347c8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:05.141209 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9b3ac590-bd3e-45c7-9cc7-1377e49347c8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081018 Dec 15 13:08:05.141740 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1281/2546] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:05 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:05.916977 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fddabf8b-50ab-4407-8448-2614aa4a79c6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:05.917658 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fddabf8b-50ab-4407-8448-2614aa4a79c6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:05.924003 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fddabf8b-50ab-4407-8448-2614aa4a79c6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:05.924450 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fddabf8b-50ab-4407-8448-2614aa4a79c6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:05.925235 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fddabf8b-50ab-4407-8448-2614aa4a79c6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:05.925721 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fddabf8b-50ab-4407-8448-2614aa4a79c6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:05.984580 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fddabf8b-50ab-4407-8448-2614aa4a79c6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:05.993402 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fddabf8b-50ab-4407-8448-2614aa4a79c6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.080287 Dec 15 13:08:05.994012 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1266/2547] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:05 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:06.157807 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-753a456e-1771-4188-9fef-0cad50674bfe tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:06.158535 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-753a456e-1771-4188-9fef-0cad50674bfe tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:06.165545 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-753a456e-1771-4188-9fef-0cad50674bfe tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:06.165989 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-753a456e-1771-4188-9fef-0cad50674bfe tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:06.166865 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-753a456e-1771-4188-9fef-0cad50674bfe tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:06.167378 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-753a456e-1771-4188-9fef-0cad50674bfe tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:06.227604 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-753a456e-1771-4188-9fef-0cad50674bfe tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:06.235370 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-753a456e-1771-4188-9fef-0cad50674bfe tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081170 Dec 15 13:08:06.235927 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1282/2548] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:06 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:07.011483 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-073f1a36-da3f-4bd4-bafd-75a822a83b36 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:07.012111 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-073f1a36-da3f-4bd4-bafd-75a822a83b36 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:07.018669 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-073f1a36-da3f-4bd4-bafd-75a822a83b36 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:07.019110 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-073f1a36-da3f-4bd4-bafd-75a822a83b36 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:07.019880 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-073f1a36-da3f-4bd4-bafd-75a822a83b36 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:07.020309 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-073f1a36-da3f-4bd4-bafd-75a822a83b36 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:07.079325 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-073f1a36-da3f-4bd4-bafd-75a822a83b36 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:07.087114 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-073f1a36-da3f-4bd4-bafd-75a822a83b36 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.080113 Dec 15 13:08:07.087681 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1267/2549] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:07 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:07.252284 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-358bfdea-bc54-48f1-b266-54005fb14388 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:07.252843 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-358bfdea-bc54-48f1-b266-54005fb14388 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:07.259369 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-358bfdea-bc54-48f1-b266-54005fb14388 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:07.259808 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-358bfdea-bc54-48f1-b266-54005fb14388 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:07.260614 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-358bfdea-bc54-48f1-b266-54005fb14388 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:07.261056 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-358bfdea-bc54-48f1-b266-54005fb14388 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:07.323891 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-358bfdea-bc54-48f1-b266-54005fb14388 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:07.331558 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-358bfdea-bc54-48f1-b266-54005fb14388 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082974 Dec 15 13:08:07.332112 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1283/2550] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:07 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:08.103796 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0671bcab-9dab-46be-88bd-2f2464328d3f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:08.104402 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0671bcab-9dab-46be-88bd-2f2464328d3f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:08.110946 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0671bcab-9dab-46be-88bd-2f2464328d3f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:08.111404 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0671bcab-9dab-46be-88bd-2f2464328d3f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:08.112199 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0671bcab-9dab-46be-88bd-2f2464328d3f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:08.112659 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0671bcab-9dab-46be-88bd-2f2464328d3f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:08.176099 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0671bcab-9dab-46be-88bd-2f2464328d3f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:08.184694 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0671bcab-9dab-46be-88bd-2f2464328d3f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.084924 Dec 15 13:08:08.185596 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1268/2551] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:08 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:08.349660 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bf3500da-bb0f-4fe9-8569-33242adea581 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:08.350267 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-bf3500da-bb0f-4fe9-8569-33242adea581 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:08.356879 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bf3500da-bb0f-4fe9-8569-33242adea581 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:08.357325 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bf3500da-bb0f-4fe9-8569-33242adea581 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:08.358187 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bf3500da-bb0f-4fe9-8569-33242adea581 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:08.358623 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-bf3500da-bb0f-4fe9-8569-33242adea581 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:08.419088 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-bf3500da-bb0f-4fe9-8569-33242adea581 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:08.426817 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bf3500da-bb0f-4fe9-8569-33242adea581 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081452 Dec 15 13:08:08.427381 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1284/2552] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:08 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:09.201428 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5ceb466b-3b4a-49e0-9225-331cb47b1d6a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:09.202083 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5ceb466b-3b4a-49e0-9225-331cb47b1d6a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:09.208306 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ceb466b-3b4a-49e0-9225-331cb47b1d6a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:09.208764 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ceb466b-3b4a-49e0-9225-331cb47b1d6a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:09.209577 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ceb466b-3b4a-49e0-9225-331cb47b1d6a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:09.210026 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ceb466b-3b4a-49e0-9225-331cb47b1d6a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:09.270582 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5ceb466b-3b4a-49e0-9225-331cb47b1d6a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:09.279348 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5ceb466b-3b4a-49e0-9225-331cb47b1d6a tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.081646 Dec 15 13:08:09.279927 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1269/2553] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:09 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:09.444276 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1769add7-8c30-4374-9f1e-20957b960724 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:09.445489 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1769add7-8c30-4374-9f1e-20957b960724 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:09.452093 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1769add7-8c30-4374-9f1e-20957b960724 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:09.452549 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1769add7-8c30-4374-9f1e-20957b960724 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:09.453344 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1769add7-8c30-4374-9f1e-20957b960724 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:09.453835 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1769add7-8c30-4374-9f1e-20957b960724 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:09.516687 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1769add7-8c30-4374-9f1e-20957b960724 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:09.525840 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1769add7-8c30-4374-9f1e-20957b960724 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.085136 Dec 15 13:08:09.526416 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1285/2554] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:09 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:10.298665 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-62152027-a021-4dc6-b3f0-e041dfe31c9d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:10.299312 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-62152027-a021-4dc6-b3f0-e041dfe31c9d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:10.306388 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-62152027-a021-4dc6-b3f0-e041dfe31c9d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:10.306842 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-62152027-a021-4dc6-b3f0-e041dfe31c9d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:10.307621 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-62152027-a021-4dc6-b3f0-e041dfe31c9d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:10.308063 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-62152027-a021-4dc6-b3f0-e041dfe31c9d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:10.370279 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-62152027-a021-4dc6-b3f0-e041dfe31c9d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:10.378383 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-62152027-a021-4dc6-b3f0-e041dfe31c9d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.083392 Dec 15 13:08:10.378951 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1270/2555] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:10 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:10.542731 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-77ef9c98-7eef-47ce-a2d3-0be5e6d40880 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:10.543320 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-77ef9c98-7eef-47ce-a2d3-0be5e6d40880 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:10.549954 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-77ef9c98-7eef-47ce-a2d3-0be5e6d40880 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:10.550413 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-77ef9c98-7eef-47ce-a2d3-0be5e6d40880 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:10.551221 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-77ef9c98-7eef-47ce-a2d3-0be5e6d40880 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:10.551660 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-77ef9c98-7eef-47ce-a2d3-0be5e6d40880 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:10.619941 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-77ef9c98-7eef-47ce-a2d3-0be5e6d40880 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:10.627741 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-77ef9c98-7eef-47ce-a2d3-0be5e6d40880 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.089352 Dec 15 13:08:10.628305 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1286/2556] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:10 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:11.395693 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e8263dd2-ea24-45a4-bbce-67b0b86d76ba tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:11.396294 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e8263dd2-ea24-45a4-bbce-67b0b86d76ba tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:11.402742 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e8263dd2-ea24-45a4-bbce-67b0b86d76ba tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:11.403192 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e8263dd2-ea24-45a4-bbce-67b0b86d76ba tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:11.403972 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e8263dd2-ea24-45a4-bbce-67b0b86d76ba tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:11.404408 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e8263dd2-ea24-45a4-bbce-67b0b86d76ba tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:11.464175 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e8263dd2-ea24-45a4-bbce-67b0b86d76ba tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:11.472989 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e8263dd2-ea24-45a4-bbce-67b0b86d76ba tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.080974 Dec 15 13:08:11.473671 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1271/2557] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:11 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:11.644459 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ac7479a3-3f73-4778-9e85-fe9e492396c0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:11.645107 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ac7479a3-3f73-4778-9e85-fe9e492396c0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:11.652616 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ac7479a3-3f73-4778-9e85-fe9e492396c0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:11.653067 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ac7479a3-3f73-4778-9e85-fe9e492396c0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:11.654408 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ac7479a3-3f73-4778-9e85-fe9e492396c0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:11.654845 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ac7479a3-3f73-4778-9e85-fe9e492396c0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:11.714603 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ac7479a3-3f73-4778-9e85-fe9e492396c0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:11.722357 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ac7479a3-3f73-4778-9e85-fe9e492396c0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081769 Dec 15 13:08:11.722918 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1287/2558] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:11 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:12.489924 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-46205494-5bea-44c1-ae47-104233d084fc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:12.490566 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-46205494-5bea-44c1-ae47-104233d084fc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:12.497422 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-46205494-5bea-44c1-ae47-104233d084fc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:12.497895 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-46205494-5bea-44c1-ae47-104233d084fc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:12.498669 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-46205494-5bea-44c1-ae47-104233d084fc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:12.499097 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-46205494-5bea-44c1-ae47-104233d084fc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:12.558034 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-46205494-5bea-44c1-ae47-104233d084fc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:12.565953 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-46205494-5bea-44c1-ae47-104233d084fc tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.079712 Dec 15 13:08:12.566539 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1272/2559] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:12 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:12.739268 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a568b686-93ea-462e-8dfd-298e7e64ff88 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:12.739954 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a568b686-93ea-462e-8dfd-298e7e64ff88 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:12.746456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a568b686-93ea-462e-8dfd-298e7e64ff88 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:12.746907 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a568b686-93ea-462e-8dfd-298e7e64ff88 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:12.747697 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a568b686-93ea-462e-8dfd-298e7e64ff88 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:12.748134 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a568b686-93ea-462e-8dfd-298e7e64ff88 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:12.809042 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a568b686-93ea-462e-8dfd-298e7e64ff88 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:12.816825 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a568b686-93ea-462e-8dfd-298e7e64ff88 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081250 Dec 15 13:08:12.817400 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1288/2560] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:12 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:13.582840 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-98b7ff96-45a9-4831-b08b-9ecbd6950a49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:13.583428 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-98b7ff96-45a9-4831-b08b-9ecbd6950a49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:13.589824 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-98b7ff96-45a9-4831-b08b-9ecbd6950a49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:13.590267 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-98b7ff96-45a9-4831-b08b-9ecbd6950a49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:13.591068 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-98b7ff96-45a9-4831-b08b-9ecbd6950a49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:13.591460 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-98b7ff96-45a9-4831-b08b-9ecbd6950a49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:13.650883 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-98b7ff96-45a9-4831-b08b-9ecbd6950a49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:13.658668 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-98b7ff96-45a9-4831-b08b-9ecbd6950a49 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.079554 Dec 15 13:08:13.659237 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1273/2561] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:13 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:13.834058 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-70c9ccee-9fee-44a6-ad12-9e34f4adfa38 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:13.834638 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-70c9ccee-9fee-44a6-ad12-9e34f4adfa38 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:13.841027 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-70c9ccee-9fee-44a6-ad12-9e34f4adfa38 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:13.841470 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-70c9ccee-9fee-44a6-ad12-9e34f4adfa38 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:13.842276 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-70c9ccee-9fee-44a6-ad12-9e34f4adfa38 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:13.842709 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-70c9ccee-9fee-44a6-ad12-9e34f4adfa38 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:13.905212 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-70c9ccee-9fee-44a6-ad12-9e34f4adfa38 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:13.913007 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-70c9ccee-9fee-44a6-ad12-9e34f4adfa38 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082725 Dec 15 13:08:13.914112 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1289/2562] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:13 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:14.675737 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4a6b958d-b6fd-4e10-ad99-1b72ad4260d8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:14.676377 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4a6b958d-b6fd-4e10-ad99-1b72ad4260d8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: af14627f-65d9-46ce-9fea-d9c7c74c0ef3] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:14.683319 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a6b958d-b6fd-4e10-ad99-1b72ad4260d8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:14.683768 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a6b958d-b6fd-4e10-ad99-1b72ad4260d8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:14.684557 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a6b958d-b6fd-4e10-ad99-1b72ad4260d8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:14.684991 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a6b958d-b6fd-4e10-ad99-1b72ad4260d8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:14.751758 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4a6b958d-b6fd-4e10-ad99-1b72ad4260d8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:14.759719 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4a6b958d-b6fd-4e10-ad99-1b72ad4260d8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3" status: 200 len: 1349 microversion: 2.1 time: 0.087623 Dec 15 13:08:14.760277 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1274/2563] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:14 2021] GET /compute/v2.1/servers/af14627f-65d9-46ce-9fea-d9c7c74c0ef3 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:08:14.931886 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e1dbd8c1-cc6f-4f17-ad4f-442db7be3275 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:14.932839 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e1dbd8c1-cc6f-4f17-ad4f-442db7be3275 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:14.939725 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e1dbd8c1-cc6f-4f17-ad4f-442db7be3275 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:14.940285 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e1dbd8c1-cc6f-4f17-ad4f-442db7be3275 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:14.941181 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e1dbd8c1-cc6f-4f17-ad4f-442db7be3275 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:14.941771 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e1dbd8c1-cc6f-4f17-ad4f-442db7be3275 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:15.000849 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e1dbd8c1-cc6f-4f17-ad4f-442db7be3275 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:15.008734 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e1dbd8c1-cc6f-4f17-ad4f-442db7be3275 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081207 Dec 15 13:08:15.009286 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1290/2564] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:14 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:16.027272 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ac9307fd-71aa-45d8-988a-93226d1f307f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:16.028025 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ac9307fd-71aa-45d8-988a-93226d1f307f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:16.034732 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ac9307fd-71aa-45d8-988a-93226d1f307f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:16.035183 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ac9307fd-71aa-45d8-988a-93226d1f307f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:16.035988 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ac9307fd-71aa-45d8-988a-93226d1f307f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:16.036433 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ac9307fd-71aa-45d8-988a-93226d1f307f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:16.096668 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ac9307fd-71aa-45d8-988a-93226d1f307f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:16.104730 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ac9307fd-71aa-45d8-988a-93226d1f307f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082365 Dec 15 13:08:16.105301 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1275/2565] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:16 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:17.122321 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4d0174dc-5046-4593-ae98-8025f8fcc408 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:17.122977 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4d0174dc-5046-4593-ae98-8025f8fcc408 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:17.130123 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4d0174dc-5046-4593-ae98-8025f8fcc408 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:17.130679 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4d0174dc-5046-4593-ae98-8025f8fcc408 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:17.131458 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4d0174dc-5046-4593-ae98-8025f8fcc408 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:17.131894 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4d0174dc-5046-4593-ae98-8025f8fcc408 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:17.192388 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4d0174dc-5046-4593-ae98-8025f8fcc408 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:17.200541 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4d0174dc-5046-4593-ae98-8025f8fcc408 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082047 Dec 15 13:08:17.201101 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1291/2566] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:17 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:18.217413 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-48acbde0-c4d0-44b2-8d2c-c10cbfc221ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:18.218061 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-48acbde0-c4d0-44b2-8d2c-c10cbfc221ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:18.228662 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-48acbde0-c4d0-44b2-8d2c-c10cbfc221ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:18.229255 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-48acbde0-c4d0-44b2-8d2c-c10cbfc221ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:18.230139 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-48acbde0-c4d0-44b2-8d2c-c10cbfc221ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:18.230581 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-48acbde0-c4d0-44b2-8d2c-c10cbfc221ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:18.291747 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-48acbde0-c4d0-44b2-8d2c-c10cbfc221ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:18.302530 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-48acbde0-c4d0-44b2-8d2c-c10cbfc221ad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.088782 Dec 15 13:08:18.303113 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1276/2567] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:18 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:19.326064 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ad6ef589-273c-4e77-8621-87b313741a32 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:19.332697 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ad6ef589-273c-4e77-8621-87b313741a32 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:19.333615 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ad6ef589-273c-4e77-8621-87b313741a32 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:19.334115 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ad6ef589-273c-4e77-8621-87b313741a32 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:19.335138 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ad6ef589-273c-4e77-8621-87b313741a32 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:19.336372 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ad6ef589-273c-4e77-8621-87b313741a32 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:19.408088 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ad6ef589-273c-4e77-8621-87b313741a32 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:19.416425 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ad6ef589-273c-4e77-8621-87b313741a32 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.094613 Dec 15 13:08:19.417030 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1292/2568] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:19 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:20.434022 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8863f5db-9fb3-4158-b79d-db022b065dd9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:20.434714 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8863f5db-9fb3-4158-b79d-db022b065dd9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:20.441208 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8863f5db-9fb3-4158-b79d-db022b065dd9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:20.441776 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8863f5db-9fb3-4158-b79d-db022b065dd9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:20.442566 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8863f5db-9fb3-4158-b79d-db022b065dd9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:20.443037 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8863f5db-9fb3-4158-b79d-db022b065dd9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:20.504438 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8863f5db-9fb3-4158-b79d-db022b065dd9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:20.513541 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8863f5db-9fb3-4158-b79d-db022b065dd9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.083120 Dec 15 13:08:20.514123 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1277/2569] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:20 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:21.529804 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2086375f-6b42-425e-bf01-1cd0a89dd5fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:21.530438 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2086375f-6b42-425e-bf01-1cd0a89dd5fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:21.536680 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2086375f-6b42-425e-bf01-1cd0a89dd5fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:21.537124 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2086375f-6b42-425e-bf01-1cd0a89dd5fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:21.537955 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2086375f-6b42-425e-bf01-1cd0a89dd5fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:21.538449 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2086375f-6b42-425e-bf01-1cd0a89dd5fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:21.598408 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2086375f-6b42-425e-bf01-1cd0a89dd5fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:21.606292 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2086375f-6b42-425e-bf01-1cd0a89dd5fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080102 Dec 15 13:08:21.606844 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1293/2570] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:21 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:22.622894 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b9fb051d-80cc-48b5-9478-6f549a783437 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:22.623482 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b9fb051d-80cc-48b5-9478-6f549a783437 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:22.629739 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b9fb051d-80cc-48b5-9478-6f549a783437 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:22.630188 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b9fb051d-80cc-48b5-9478-6f549a783437 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:22.631059 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b9fb051d-80cc-48b5-9478-6f549a783437 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:22.631500 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b9fb051d-80cc-48b5-9478-6f549a783437 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:22.694048 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b9fb051d-80cc-48b5-9478-6f549a783437 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:22.702182 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b9fb051d-80cc-48b5-9478-6f549a783437 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082984 Dec 15 13:08:22.702767 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1278/2571] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:22 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:23.719047 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3e5b0d09-6420-42ce-8b54-61598ebc8470 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:23.719692 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3e5b0d09-6420-42ce-8b54-61598ebc8470 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:23.726616 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3e5b0d09-6420-42ce-8b54-61598ebc8470 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:23.727112 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3e5b0d09-6420-42ce-8b54-61598ebc8470 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:23.727951 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3e5b0d09-6420-42ce-8b54-61598ebc8470 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:23.728380 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3e5b0d09-6420-42ce-8b54-61598ebc8470 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:23.796076 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3e5b0d09-6420-42ce-8b54-61598ebc8470 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:23.804512 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3e5b0d09-6420-42ce-8b54-61598ebc8470 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.088538 Dec 15 13:08:23.805085 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1294/2572] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:23 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:24.821110 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-571122bf-7c31-4d9e-8475-2bf1ca89a7e1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:24.821775 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-571122bf-7c31-4d9e-8475-2bf1ca89a7e1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:24.829035 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-571122bf-7c31-4d9e-8475-2bf1ca89a7e1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:24.829492 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-571122bf-7c31-4d9e-8475-2bf1ca89a7e1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:24.830333 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-571122bf-7c31-4d9e-8475-2bf1ca89a7e1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:24.830826 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-571122bf-7c31-4d9e-8475-2bf1ca89a7e1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:24.895955 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-571122bf-7c31-4d9e-8475-2bf1ca89a7e1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:24.904166 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-571122bf-7c31-4d9e-8475-2bf1ca89a7e1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.086859 Dec 15 13:08:24.904760 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1279/2573] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:24 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:25.920874 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-276c6830-05d4-4eaf-90b5-1e15d9d863d6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:25.921493 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-276c6830-05d4-4eaf-90b5-1e15d9d863d6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:25.928136 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-276c6830-05d4-4eaf-90b5-1e15d9d863d6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:25.928597 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-276c6830-05d4-4eaf-90b5-1e15d9d863d6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:25.929997 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-276c6830-05d4-4eaf-90b5-1e15d9d863d6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:25.930438 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-276c6830-05d4-4eaf-90b5-1e15d9d863d6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:25.992130 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-276c6830-05d4-4eaf-90b5-1e15d9d863d6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:25.999980 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-276c6830-05d4-4eaf-90b5-1e15d9d863d6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082912 Dec 15 13:08:26.000537 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1295/2574] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:25 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:27.016421 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-75561c39-fdd9-4b5c-900d-84592b6992a6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:27.017026 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-75561c39-fdd9-4b5c-900d-84592b6992a6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:27.023814 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-75561c39-fdd9-4b5c-900d-84592b6992a6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:27.024261 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-75561c39-fdd9-4b5c-900d-84592b6992a6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:27.025047 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-75561c39-fdd9-4b5c-900d-84592b6992a6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:27.025543 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-75561c39-fdd9-4b5c-900d-84592b6992a6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:27.086508 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-75561c39-fdd9-4b5c-900d-84592b6992a6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:27.094399 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-75561c39-fdd9-4b5c-900d-84592b6992a6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081870 Dec 15 13:08:27.094981 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1280/2575] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:27 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:28.110726 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6e35a0f9-3213-4a1f-be66-a2b3c6b1a0c5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:28.111339 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6e35a0f9-3213-4a1f-be66-a2b3c6b1a0c5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:28.118042 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e35a0f9-3213-4a1f-be66-a2b3c6b1a0c5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:28.118493 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e35a0f9-3213-4a1f-be66-a2b3c6b1a0c5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:28.119271 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e35a0f9-3213-4a1f-be66-a2b3c6b1a0c5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:28.119710 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e35a0f9-3213-4a1f-be66-a2b3c6b1a0c5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:28.181053 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6e35a0f9-3213-4a1f-be66-a2b3c6b1a0c5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:28.189069 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6e35a0f9-3213-4a1f-be66-a2b3c6b1a0c5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081931 Dec 15 13:08:28.189675 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1296/2576] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:28 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:29.206281 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-668131ab-6f0d-4455-9253-f0b4216d4268 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:29.206903 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-668131ab-6f0d-4455-9253-f0b4216d4268 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:29.213590 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-668131ab-6f0d-4455-9253-f0b4216d4268 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:29.214043 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-668131ab-6f0d-4455-9253-f0b4216d4268 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:29.214825 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-668131ab-6f0d-4455-9253-f0b4216d4268 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:29.215268 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-668131ab-6f0d-4455-9253-f0b4216d4268 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:29.275965 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-668131ab-6f0d-4455-9253-f0b4216d4268 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:29.284227 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-668131ab-6f0d-4455-9253-f0b4216d4268 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081560 Dec 15 13:08:29.284812 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1281/2577] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:29 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:30.301679 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-19a0ddcc-1c59-4229-8a8b-9d8a6170723c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:30.302295 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-19a0ddcc-1c59-4229-8a8b-9d8a6170723c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:30.309230 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-19a0ddcc-1c59-4229-8a8b-9d8a6170723c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:30.309719 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-19a0ddcc-1c59-4229-8a8b-9d8a6170723c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:30.310490 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-19a0ddcc-1c59-4229-8a8b-9d8a6170723c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:30.310928 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-19a0ddcc-1c59-4229-8a8b-9d8a6170723c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:30.380543 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-19a0ddcc-1c59-4229-8a8b-9d8a6170723c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:30.388670 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-19a0ddcc-1c59-4229-8a8b-9d8a6170723c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.090673 Dec 15 13:08:30.389235 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1297/2578] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:30 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:31.405076 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4cf9bb35-a0fe-463a-850a-17df4faa3c9d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:31.405736 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4cf9bb35-a0fe-463a-850a-17df4faa3c9d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:31.411983 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4cf9bb35-a0fe-463a-850a-17df4faa3c9d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:31.412434 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4cf9bb35-a0fe-463a-850a-17df4faa3c9d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:31.413208 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4cf9bb35-a0fe-463a-850a-17df4faa3c9d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:31.413829 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4cf9bb35-a0fe-463a-850a-17df4faa3c9d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:31.482353 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4cf9bb35-a0fe-463a-850a-17df4faa3c9d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:31.490127 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4cf9bb35-a0fe-463a-850a-17df4faa3c9d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.088712 Dec 15 13:08:31.490692 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1282/2579] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:31 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:32.507955 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0326a322-aca6-45c8-bd0e-c42407694135 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:32.508688 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0326a322-aca6-45c8-bd0e-c42407694135 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:32.515635 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0326a322-aca6-45c8-bd0e-c42407694135 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:32.516077 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0326a322-aca6-45c8-bd0e-c42407694135 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:32.516881 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0326a322-aca6-45c8-bd0e-c42407694135 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:32.517314 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0326a322-aca6-45c8-bd0e-c42407694135 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:32.588486 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0326a322-aca6-45c8-bd0e-c42407694135 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:32.596244 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0326a322-aca6-45c8-bd0e-c42407694135 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.092429 Dec 15 13:08:32.596796 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1298/2580] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:32 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:33.613443 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0245f352-74de-40db-963e-1a95570ea01e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:33.614047 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0245f352-74de-40db-963e-1a95570ea01e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:33.622316 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0245f352-74de-40db-963e-1a95570ea01e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:33.622903 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0245f352-74de-40db-963e-1a95570ea01e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:33.623770 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0245f352-74de-40db-963e-1a95570ea01e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:33.624222 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0245f352-74de-40db-963e-1a95570ea01e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:33.695156 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0245f352-74de-40db-963e-1a95570ea01e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:33.703561 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0245f352-74de-40db-963e-1a95570ea01e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.093855 Dec 15 13:08:33.704145 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1283/2581] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:33 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:34.724035 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3420d4f2-35d9-4a80-9cd9-b639eaba71cf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:34.724637 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3420d4f2-35d9-4a80-9cd9-b639eaba71cf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:34.731309 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3420d4f2-35d9-4a80-9cd9-b639eaba71cf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:34.731756 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3420d4f2-35d9-4a80-9cd9-b639eaba71cf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:34.732531 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3420d4f2-35d9-4a80-9cd9-b639eaba71cf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:34.732966 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3420d4f2-35d9-4a80-9cd9-b639eaba71cf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:34.792689 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3420d4f2-35d9-4a80-9cd9-b639eaba71cf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:34.800501 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3420d4f2-35d9-4a80-9cd9-b639eaba71cf tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080808 Dec 15 13:08:34.801247 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1299/2582] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:34 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:35.821037 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bd9658e8-fae4-4a33-9563-be38b3e1e399 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:35.821664 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bd9658e8-fae4-4a33-9563-be38b3e1e399 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:35.828502 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd9658e8-fae4-4a33-9563-be38b3e1e399 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:35.829018 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd9658e8-fae4-4a33-9563-be38b3e1e399 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:35.829934 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd9658e8-fae4-4a33-9563-be38b3e1e399 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:35.830409 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd9658e8-fae4-4a33-9563-be38b3e1e399 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:35.894024 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bd9658e8-fae4-4a33-9563-be38b3e1e399 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:35.901987 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bd9658e8-fae4-4a33-9563-be38b3e1e399 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.088458 Dec 15 13:08:35.902562 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1284/2583] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:35 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:36.918801 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e3e851de-1c9c-45e5-9238-81b8a5775937 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:36.919501 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e3e851de-1c9c-45e5-9238-81b8a5775937 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:36.925894 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e3e851de-1c9c-45e5-9238-81b8a5775937 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:36.926349 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e3e851de-1c9c-45e5-9238-81b8a5775937 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:36.927132 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e3e851de-1c9c-45e5-9238-81b8a5775937 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:36.927570 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e3e851de-1c9c-45e5-9238-81b8a5775937 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:36.988344 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e3e851de-1c9c-45e5-9238-81b8a5775937 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:36.996992 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e3e851de-1c9c-45e5-9238-81b8a5775937 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082049 Dec 15 13:08:36.997581 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1300/2584] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:36 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:38.013750 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7cc0dc03-e578-49c0-be42-0747b60c5995 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:38.014373 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7cc0dc03-e578-49c0-be42-0747b60c5995 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:38.020641 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7cc0dc03-e578-49c0-be42-0747b60c5995 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:38.021094 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7cc0dc03-e578-49c0-be42-0747b60c5995 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:38.021899 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7cc0dc03-e578-49c0-be42-0747b60c5995 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:38.022342 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7cc0dc03-e578-49c0-be42-0747b60c5995 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:38.082218 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7cc0dc03-e578-49c0-be42-0747b60c5995 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:38.090148 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7cc0dc03-e578-49c0-be42-0747b60c5995 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080503 Dec 15 13:08:38.090721 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1285/2585] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:38 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:39.106095 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2223b5c9-f066-403e-80c2-7df68b71bd8b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:39.106736 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2223b5c9-f066-403e-80c2-7df68b71bd8b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:39.113431 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2223b5c9-f066-403e-80c2-7df68b71bd8b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:39.113947 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2223b5c9-f066-403e-80c2-7df68b71bd8b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:39.114739 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2223b5c9-f066-403e-80c2-7df68b71bd8b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:39.115173 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2223b5c9-f066-403e-80c2-7df68b71bd8b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:39.182837 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2223b5c9-f066-403e-80c2-7df68b71bd8b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:39.190661 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2223b5c9-f066-403e-80c2-7df68b71bd8b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.088284 Dec 15 13:08:39.191270 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1301/2586] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:39 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:40.208015 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b9bc416b-f33f-4e11-9628-36884f1d019b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:40.208619 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b9bc416b-f33f-4e11-9628-36884f1d019b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:40.215364 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b9bc416b-f33f-4e11-9628-36884f1d019b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:40.215811 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b9bc416b-f33f-4e11-9628-36884f1d019b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:40.216579 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b9bc416b-f33f-4e11-9628-36884f1d019b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:40.217010 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b9bc416b-f33f-4e11-9628-36884f1d019b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:40.280176 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b9bc416b-f33f-4e11-9628-36884f1d019b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:40.288897 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b9bc416b-f33f-4e11-9628-36884f1d019b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.084154 Dec 15 13:08:40.289637 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1286/2587] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:40 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:41.306232 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7bcd1c87-3c28-4799-aa9d-e5abb74671ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:41.306850 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7bcd1c87-3c28-4799-aa9d-e5abb74671ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:41.313081 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7bcd1c87-3c28-4799-aa9d-e5abb74671ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:41.313559 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7bcd1c87-3c28-4799-aa9d-e5abb74671ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:41.314347 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7bcd1c87-3c28-4799-aa9d-e5abb74671ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:41.314787 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7bcd1c87-3c28-4799-aa9d-e5abb74671ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:41.375590 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7bcd1c87-3c28-4799-aa9d-e5abb74671ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:41.384712 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7bcd1c87-3c28-4799-aa9d-e5abb74671ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082642 Dec 15 13:08:41.385295 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1302/2588] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:41 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:42.401922 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ca6b661e-4193-4d8b-bf4e-a51c327ab940 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:42.402603 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ca6b661e-4193-4d8b-bf4e-a51c327ab940 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:42.408966 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ca6b661e-4193-4d8b-bf4e-a51c327ab940 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:42.409420 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ca6b661e-4193-4d8b-bf4e-a51c327ab940 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:42.410244 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ca6b661e-4193-4d8b-bf4e-a51c327ab940 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:42.410680 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ca6b661e-4193-4d8b-bf4e-a51c327ab940 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:42.477771 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ca6b661e-4193-4d8b-bf4e-a51c327ab940 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:42.486546 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ca6b661e-4193-4d8b-bf4e-a51c327ab940 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.088235 Dec 15 13:08:42.487143 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1287/2589] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:42 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:43.502811 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-dcbb2127-d794-4a6a-8645-77df428d2561 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:43.503451 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-dcbb2127-d794-4a6a-8645-77df428d2561 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:43.510428 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dcbb2127-d794-4a6a-8645-77df428d2561 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:43.510873 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dcbb2127-d794-4a6a-8645-77df428d2561 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:43.511634 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dcbb2127-d794-4a6a-8645-77df428d2561 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:43.512063 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dcbb2127-d794-4a6a-8645-77df428d2561 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:43.571472 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-dcbb2127-d794-4a6a-8645-77df428d2561 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:43.586888 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-dcbb2127-d794-4a6a-8645-77df428d2561 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.087548 Dec 15 13:08:43.587523 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1303/2590] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:43 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:44.603150 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d89424a1-7f2a-4c7b-8cbf-f21e57cd6cc6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:44.603814 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d89424a1-7f2a-4c7b-8cbf-f21e57cd6cc6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:44.610104 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d89424a1-7f2a-4c7b-8cbf-f21e57cd6cc6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:44.610560 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d89424a1-7f2a-4c7b-8cbf-f21e57cd6cc6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:44.611346 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d89424a1-7f2a-4c7b-8cbf-f21e57cd6cc6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:44.611783 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d89424a1-7f2a-4c7b-8cbf-f21e57cd6cc6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:44.672684 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d89424a1-7f2a-4c7b-8cbf-f21e57cd6cc6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:44.683676 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d89424a1-7f2a-4c7b-8cbf-f21e57cd6cc6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.084380 Dec 15 13:08:44.684270 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1288/2591] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:44 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:45.700249 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-92223e2e-9132-49e4-9970-3427a36dd7fe tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:45.700855 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-92223e2e-9132-49e4-9970-3427a36dd7fe tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:45.708056 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-92223e2e-9132-49e4-9970-3427a36dd7fe tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:45.708505 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-92223e2e-9132-49e4-9970-3427a36dd7fe tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:45.709298 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-92223e2e-9132-49e4-9970-3427a36dd7fe tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:45.709766 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-92223e2e-9132-49e4-9970-3427a36dd7fe tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:45.778802 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-92223e2e-9132-49e4-9970-3427a36dd7fe tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:45.786798 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-92223e2e-9132-49e4-9970-3427a36dd7fe tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.090226 Dec 15 13:08:45.787366 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1304/2592] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:45 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:46.803708 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6ed88ea9-e582-46d3-a466-4a5a9af366ca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:46.804495 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6ed88ea9-e582-46d3-a466-4a5a9af366ca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:46.810967 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6ed88ea9-e582-46d3-a466-4a5a9af366ca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:46.811416 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6ed88ea9-e582-46d3-a466-4a5a9af366ca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:46.812198 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6ed88ea9-e582-46d3-a466-4a5a9af366ca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:46.812637 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6ed88ea9-e582-46d3-a466-4a5a9af366ca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:46.874597 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6ed88ea9-e582-46d3-a466-4a5a9af366ca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:46.882691 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6ed88ea9-e582-46d3-a466-4a5a9af366ca tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082689 Dec 15 13:08:46.883262 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1289/2593] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:46 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:47.900225 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-79849464-3f1c-41df-a865-39c35614039a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:47.900851 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-79849464-3f1c-41df-a865-39c35614039a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:47.909305 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-79849464-3f1c-41df-a865-39c35614039a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:47.909785 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-79849464-3f1c-41df-a865-39c35614039a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:47.910583 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-79849464-3f1c-41df-a865-39c35614039a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:47.911020 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-79849464-3f1c-41df-a865-39c35614039a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:47.973081 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-79849464-3f1c-41df-a865-39c35614039a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:47.980965 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-79849464-3f1c-41df-a865-39c35614039a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.084983 Dec 15 13:08:47.981551 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1305/2594] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:47 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:48.997731 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4d972a88-9516-4ea5-8668-b7064a49f9c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:48.998345 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4d972a88-9516-4ea5-8668-b7064a49f9c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:49.004876 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4d972a88-9516-4ea5-8668-b7064a49f9c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:49.005332 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4d972a88-9516-4ea5-8668-b7064a49f9c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:49.006155 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4d972a88-9516-4ea5-8668-b7064a49f9c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:49.006645 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4d972a88-9516-4ea5-8668-b7064a49f9c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:49.071760 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4d972a88-9516-4ea5-8668-b7064a49f9c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:49.079472 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4d972a88-9516-4ea5-8668-b7064a49f9c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.085447 Dec 15 13:08:49.080044 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1290/2595] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:48 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:50.095720 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-693456ed-4014-48c5-a582-d1558223c0fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:50.096346 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-693456ed-4014-48c5-a582-d1558223c0fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:50.106186 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-693456ed-4014-48c5-a582-d1558223c0fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:50.106639 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-693456ed-4014-48c5-a582-d1558223c0fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:50.107429 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-693456ed-4014-48c5-a582-d1558223c0fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:50.107872 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-693456ed-4014-48c5-a582-d1558223c0fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:50.175736 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-693456ed-4014-48c5-a582-d1558223c0fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:50.184204 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-693456ed-4014-48c5-a582-d1558223c0fa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.092102 Dec 15 13:08:50.184777 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1306/2596] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:50 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:51.201196 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-08affbd6-f592-4851-8800-62a256caeb2b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:51.201883 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-08affbd6-f592-4851-8800-62a256caeb2b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:51.208218 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-08affbd6-f592-4851-8800-62a256caeb2b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:51.208671 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-08affbd6-f592-4851-8800-62a256caeb2b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:51.209454 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-08affbd6-f592-4851-8800-62a256caeb2b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:51.210556 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-08affbd6-f592-4851-8800-62a256caeb2b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:51.269735 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-08affbd6-f592-4851-8800-62a256caeb2b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:51.278292 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-08affbd6-f592-4851-8800-62a256caeb2b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080789 Dec 15 13:08:51.278866 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1291/2597] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:51 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:52.295195 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e56c7232-ca29-460f-906b-09776e80bec6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:52.295848 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e56c7232-ca29-460f-906b-09776e80bec6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:52.302668 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e56c7232-ca29-460f-906b-09776e80bec6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:52.303119 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e56c7232-ca29-460f-906b-09776e80bec6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:52.304589 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e56c7232-ca29-460f-906b-09776e80bec6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:52.305060 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e56c7232-ca29-460f-906b-09776e80bec6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:52.368719 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e56c7232-ca29-460f-906b-09776e80bec6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:52.376822 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e56c7232-ca29-460f-906b-09776e80bec6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.085308 Dec 15 13:08:52.377433 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1307/2598] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:52 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:53.394758 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ec97709e-4db7-4814-8e35-5d777765e673 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:53.395359 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ec97709e-4db7-4814-8e35-5d777765e673 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:53.404659 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ec97709e-4db7-4814-8e35-5d777765e673 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:53.405115 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ec97709e-4db7-4814-8e35-5d777765e673 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:53.405944 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ec97709e-4db7-4814-8e35-5d777765e673 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:53.406387 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ec97709e-4db7-4814-8e35-5d777765e673 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:53.475457 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ec97709e-4db7-4814-8e35-5d777765e673 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:53.485371 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ec97709e-4db7-4814-8e35-5d777765e673 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.093803 Dec 15 13:08:53.486458 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1292/2599] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:53 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:54.502823 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-29adc8b1-870f-41ba-8f2b-a780baf75126 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:54.503419 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-29adc8b1-870f-41ba-8f2b-a780baf75126 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:54.511275 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-29adc8b1-870f-41ba-8f2b-a780baf75126 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:54.511726 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-29adc8b1-870f-41ba-8f2b-a780baf75126 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:54.512498 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-29adc8b1-870f-41ba-8f2b-a780baf75126 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:54.513191 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-29adc8b1-870f-41ba-8f2b-a780baf75126 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:54.580684 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-29adc8b1-870f-41ba-8f2b-a780baf75126 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:54.588929 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-29adc8b1-870f-41ba-8f2b-a780baf75126 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.089754 Dec 15 13:08:54.589489 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1308/2600] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:54 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:55.605851 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2cdbc36b-fbbd-414b-b91f-7db535d9a50c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:55.606442 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2cdbc36b-fbbd-414b-b91f-7db535d9a50c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:55.613026 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2cdbc36b-fbbd-414b-b91f-7db535d9a50c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:55.613477 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2cdbc36b-fbbd-414b-b91f-7db535d9a50c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:55.614301 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2cdbc36b-fbbd-414b-b91f-7db535d9a50c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:55.614743 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2cdbc36b-fbbd-414b-b91f-7db535d9a50c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:55.676016 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2cdbc36b-fbbd-414b-b91f-7db535d9a50c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:55.684556 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2cdbc36b-fbbd-414b-b91f-7db535d9a50c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082605 Dec 15 13:08:55.685128 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1293/2601] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:55 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:56.700490 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-730e695d-e1a9-4401-92c2-f9f3454b2c4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:56.701099 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-730e695d-e1a9-4401-92c2-f9f3454b2c4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:56.707964 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-730e695d-e1a9-4401-92c2-f9f3454b2c4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:56.708416 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-730e695d-e1a9-4401-92c2-f9f3454b2c4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:56.709222 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-730e695d-e1a9-4401-92c2-f9f3454b2c4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:56.710308 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-730e695d-e1a9-4401-92c2-f9f3454b2c4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:56.774382 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-730e695d-e1a9-4401-92c2-f9f3454b2c4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:56.782078 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-730e695d-e1a9-4401-92c2-f9f3454b2c4a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.085210 Dec 15 13:08:56.782631 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1309/2602] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:56 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:57.799307 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-06127797-8fc3-49da-85f2-a4527291ebda tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:57.799956 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-06127797-8fc3-49da-85f2-a4527291ebda tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:57.806215 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-06127797-8fc3-49da-85f2-a4527291ebda tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:57.806665 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-06127797-8fc3-49da-85f2-a4527291ebda tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:57.807457 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-06127797-8fc3-49da-85f2-a4527291ebda tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:57.807893 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-06127797-8fc3-49da-85f2-a4527291ebda tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:57.867410 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-06127797-8fc3-49da-85f2-a4527291ebda tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:57.875394 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-06127797-8fc3-49da-85f2-a4527291ebda tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.079881 Dec 15 13:08:57.875961 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1294/2603] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:57 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:08:58.893303 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-475987a2-74ff-4df9-b78b-833de4edb3e3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:58.893961 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-475987a2-74ff-4df9-b78b-833de4edb3e3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:58.900339 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-475987a2-74ff-4df9-b78b-833de4edb3e3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:58.900792 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-475987a2-74ff-4df9-b78b-833de4edb3e3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:58.901631 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-475987a2-74ff-4df9-b78b-833de4edb3e3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:08:58.902057 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-475987a2-74ff-4df9-b78b-833de4edb3e3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:08:58.963895 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-475987a2-74ff-4df9-b78b-833de4edb3e3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:08:58.971608 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-475987a2-74ff-4df9-b78b-833de4edb3e3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082116 Dec 15 13:08:58.972174 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1310/2604] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:58 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:08:59.993027 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-86a51c10-52c0-44bd-b279-eaee5f68efe4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:08:59.993728 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-86a51c10-52c0-44bd-b279-eaee5f68efe4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:08:59.999604 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-86a51c10-52c0-44bd-b279-eaee5f68efe4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:00.000055 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-86a51c10-52c0-44bd-b279-eaee5f68efe4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:00.000846 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-86a51c10-52c0-44bd-b279-eaee5f68efe4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:00.001281 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-86a51c10-52c0-44bd-b279-eaee5f68efe4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:00.061424 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-86a51c10-52c0-44bd-b279-eaee5f68efe4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:00.069845 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-86a51c10-52c0-44bd-b279-eaee5f68efe4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081093 Dec 15 13:09:00.070760 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1295/2605] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:08:59 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:00.422365 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3c13412b-f835-4395-9f73-9a23f46d3b87 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:00.422936 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3c13412b-f835-4395-9f73-9a23f46d3b87 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:00.429090 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3c13412b-f835-4395-9f73-9a23f46d3b87 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:00.429552 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3c13412b-f835-4395-9f73-9a23f46d3b87 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:00.430496 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3c13412b-f835-4395-9f73-9a23f46d3b87 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:00.430934 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3c13412b-f835-4395-9f73-9a23f46d3b87 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:00.460710 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3c13412b-f835-4395-9f73-9a23f46d3b87 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Going to try to terminate instance {{(pid=122614) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:09:00.543666 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3c13412b-f835-4395-9f73-9a23f46d3b87 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "DELETE /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206" status: 204 len: 0 microversion: 2.20 time: 0.124783 Dec 15 13:09:00.544420 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1311/2606] 10.222.0.76 () {60 vars in 1279 bytes} [Wed Dec 15 13:09:00 2021] DELETE /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 13:09:00.554355 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-876f54b7-fb2f-4f07-a50d-d3e4aa18b92a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:00.554355 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-876f54b7-fb2f-4f07-a50d-d3e4aa18b92a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:00.560310 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-876f54b7-fb2f-4f07-a50d-d3e4aa18b92a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:00.560762 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-876f54b7-fb2f-4f07-a50d-d3e4aa18b92a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:00.561586 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-876f54b7-fb2f-4f07-a50d-d3e4aa18b92a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:00.562028 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-876f54b7-fb2f-4f07-a50d-d3e4aa18b92a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:00.701115 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-876f54b7-fb2f-4f07-a50d-d3e4aa18b92a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:00.713071 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-876f54b7-fb2f-4f07-a50d-d3e4aa18b92a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:00.714890 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-876f54b7-fb2f-4f07-a50d-d3e4aa18b92a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:00.716623 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-876f54b7-fb2f-4f07-a50d-d3e4aa18b92a tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206" status: 200 len: 1723 microversion: 2.20 time: 0.167754 Dec 15 13:09:00.717638 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1296/2607] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 13:09:00 2021] GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:09:01.088033 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6a317428-66fa-4422-abe8-4443b3b9436e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:01.088737 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6a317428-66fa-4422-abe8-4443b3b9436e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:01.094602 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6a317428-66fa-4422-abe8-4443b3b9436e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:01.095057 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6a317428-66fa-4422-abe8-4443b3b9436e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:01.095845 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6a317428-66fa-4422-abe8-4443b3b9436e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:01.096285 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6a317428-66fa-4422-abe8-4443b3b9436e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:01.156642 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6a317428-66fa-4422-abe8-4443b3b9436e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:01.165285 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6a317428-66fa-4422-abe8-4443b3b9436e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081859 Dec 15 13:09:01.165892 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1312/2608] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:01 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:01.736272 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-013c6bdb-7eaf-4c1f-9a2c-6ca2166fe4b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:01.736918 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-013c6bdb-7eaf-4c1f-9a2c-6ca2166fe4b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:01.743509 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-013c6bdb-7eaf-4c1f-9a2c-6ca2166fe4b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:01.743962 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-013c6bdb-7eaf-4c1f-9a2c-6ca2166fe4b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:01.744749 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-013c6bdb-7eaf-4c1f-9a2c-6ca2166fe4b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:01.745227 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-013c6bdb-7eaf-4c1f-9a2c-6ca2166fe4b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:01.817207 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-013c6bdb-7eaf-4c1f-9a2c-6ca2166fe4b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:01.826369 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-013c6bdb-7eaf-4c1f-9a2c-6ca2166fe4b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:01.827954 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-013c6bdb-7eaf-4c1f-9a2c-6ca2166fe4b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8dfa6af1a5a4bfcab0eab3ea87226b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0465053a5542468dad24b48ad38f5430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:01.829188 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-013c6bdb-7eaf-4c1f-9a2c-6ca2166fe4b8 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206" status: 200 len: 1656 microversion: 2.20 time: 0.096870 Dec 15 13:09:01.830114 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1297/2609] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 13:09:01 2021] GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206 => generated 1656 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:09:01.954914 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-c6bfc9cc-e0b7-4f46-876e-c36eb3139668 req-1487b22c-1b1b-414c-95f4-f84e28562b55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f24920-c5f0-4998-abf1-1f4619400206", "name": "network-vif-deleted", "tag": "30bcb6fc-8770-4d42-9db7-cc5543321b77"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:09:01.957075 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:09:01.957075 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 13:09:01.965820 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-c6bfc9cc-e0b7-4f46-876e-c36eb3139668 req-1487b22c-1b1b-414c-95f4-f84e28562b55 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:01.966391 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-c6bfc9cc-e0b7-4f46-876e-c36eb3139668 req-1487b22c-1b1b-414c-95f4-f84e28562b55 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:01.979038 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-c6bfc9cc-e0b7-4f46-876e-c36eb3139668 req-1487b22c-1b1b-414c-95f4-f84e28562b55 service nova] Creating event network-vif-deleted:30bcb6fc-8770-4d42-9db7-cc5543321b77 for instance 25f24920-c5f0-4998-abf1-1f4619400206 on hv-cinder-81322 Dec 15 13:09:01.984254 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-c6bfc9cc-e0b7-4f46-876e-c36eb3139668 req-1487b22c-1b1b-414c-95f4-f84e28562b55 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034138 Dec 15 13:09:01.985396 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1313/2610] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:09:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:09:02.183006 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2d81c5c2-df92-4f29-b9cb-4ffc748e48ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:02.183948 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2d81c5c2-df92-4f29-b9cb-4ffc748e48ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:02.190382 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2d81c5c2-df92-4f29-b9cb-4ffc748e48ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:02.191168 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2d81c5c2-df92-4f29-b9cb-4ffc748e48ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:02.192194 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2d81c5c2-df92-4f29-b9cb-4ffc748e48ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:02.193058 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2d81c5c2-df92-4f29-b9cb-4ffc748e48ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:02.257931 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2d81c5c2-df92-4f29-b9cb-4ffc748e48ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:02.272230 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2d81c5c2-df92-4f29-b9cb-4ffc748e48ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.093781 Dec 15 13:09:02.272982 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1298/2611] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:02 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:02.849002 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6e022118-845f-4b93-8887-26f25834d205 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:02.849896 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6e022118-845f-4b93-8887-26f25834d205 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:02.857847 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e022118-845f-4b93-8887-26f25834d205 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:02.858539 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e022118-845f-4b93-8887-26f25834d205 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:02.859352 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e022118-845f-4b93-8887-26f25834d205 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:02.859883 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e022118-845f-4b93-8887-26f25834d205 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:02.875816 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.wsgi [None req-6e022118-845f-4b93-8887-26f25834d205 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] HTTP exception thrown: Instance 25f24920-c5f0-4998-abf1-1f4619400206 could not be found. Dec 15 13:09:02.876579 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6e022118-845f-4b93-8887-26f25834d205 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Returning 404 to user: Instance 25f24920-c5f0-4998-abf1-1f4619400206 could not be found. {{(pid=122614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:09:02.877534 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6e022118-845f-4b93-8887-26f25834d205 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206" status: 404 len: 111 microversion: 2.20 time: 0.032863 Dec 15 13:09:02.878195 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1314/2612] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 13:09:02 2021] GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:09:02.886850 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b9142c52-f5ba-4dd3-936d-7bbbc4b38b7f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '.version_select at 0x7f3c691efe50>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:02.925448 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b9142c52-f5ba-4dd3-936d-7bbbc4b38b7f tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-833939605" status: 204 len: 0 microversion: 2.20 time: 0.042230 Dec 15 13:09:02.929752 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1299/2613] 10.222.0.76 () {60 vars in 1258 bytes} [Wed Dec 15 13:09:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-833939605 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 13:09:03.290958 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-43a978a7-3d3b-4179-9ad6-cc530c84da88 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:03.291689 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-43a978a7-3d3b-4179-9ad6-cc530c84da88 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:03.304290 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-43a978a7-3d3b-4179-9ad6-cc530c84da88 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:03.305318 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-43a978a7-3d3b-4179-9ad6-cc530c84da88 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:03.306858 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-43a978a7-3d3b-4179-9ad6-cc530c84da88 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:03.307807 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-43a978a7-3d3b-4179-9ad6-cc530c84da88 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:03.401065 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-43a978a7-3d3b-4179-9ad6-cc530c84da88 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:03.409654 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-43a978a7-3d3b-4179-9ad6-cc530c84da88 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.123707 Dec 15 13:09:03.410592 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1315/2614] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:03 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:04.427775 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5a84c66b-77fe-4306-bda3-3318a0de7382 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:04.429173 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5a84c66b-77fe-4306-bda3-3318a0de7382 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:04.435400 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5a84c66b-77fe-4306-bda3-3318a0de7382 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:04.435845 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5a84c66b-77fe-4306-bda3-3318a0de7382 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:04.436613 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5a84c66b-77fe-4306-bda3-3318a0de7382 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:04.437040 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5a84c66b-77fe-4306-bda3-3318a0de7382 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:04.500381 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5a84c66b-77fe-4306-bda3-3318a0de7382 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:04.508827 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5a84c66b-77fe-4306-bda3-3318a0de7382 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.085137 Dec 15 13:09:04.509425 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1300/2615] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:04 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:05.526631 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-70f055fa-c084-40d5-9b75-30d37b4c726f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:05.527242 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-70f055fa-c084-40d5-9b75-30d37b4c726f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:05.533652 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-70f055fa-c084-40d5-9b75-30d37b4c726f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:05.534108 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-70f055fa-c084-40d5-9b75-30d37b4c726f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:05.534890 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-70f055fa-c084-40d5-9b75-30d37b4c726f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:05.535329 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-70f055fa-c084-40d5-9b75-30d37b4c726f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:05.608087 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-70f055fa-c084-40d5-9b75-30d37b4c726f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:05.623395 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-70f055fa-c084-40d5-9b75-30d37b4c726f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.101115 Dec 15 13:09:05.624270 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1316/2616] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:05 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:06.640151 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2051aeec-898d-4cbe-b1d3-977608f799d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:06.640802 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2051aeec-898d-4cbe-b1d3-977608f799d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:06.647343 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2051aeec-898d-4cbe-b1d3-977608f799d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:06.647866 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2051aeec-898d-4cbe-b1d3-977608f799d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:06.648667 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2051aeec-898d-4cbe-b1d3-977608f799d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:06.649105 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2051aeec-898d-4cbe-b1d3-977608f799d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:06.718240 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2051aeec-898d-4cbe-b1d3-977608f799d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:06.726916 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2051aeec-898d-4cbe-b1d3-977608f799d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.090660 Dec 15 13:09:06.727489 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1301/2617] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:06 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:07.743271 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-75a95552-3e59-4f10-999f-2915c59de1d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:07.743886 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-75a95552-3e59-4f10-999f-2915c59de1d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:07.750206 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-75a95552-3e59-4f10-999f-2915c59de1d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:07.750694 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-75a95552-3e59-4f10-999f-2915c59de1d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:07.751551 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-75a95552-3e59-4f10-999f-2915c59de1d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:07.751996 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-75a95552-3e59-4f10-999f-2915c59de1d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:07.813330 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-75a95552-3e59-4f10-999f-2915c59de1d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:07.821728 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-75a95552-3e59-4f10-999f-2915c59de1d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082049 Dec 15 13:09:07.822294 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1317/2618] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:07 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:08.838741 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4feabe85-fbc6-4c71-9123-9cbc331b3aa5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:08.839361 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4feabe85-fbc6-4c71-9123-9cbc331b3aa5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:08.846046 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4feabe85-fbc6-4c71-9123-9cbc331b3aa5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:08.846503 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4feabe85-fbc6-4c71-9123-9cbc331b3aa5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:08.847331 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4feabe85-fbc6-4c71-9123-9cbc331b3aa5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:08.847779 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4feabe85-fbc6-4c71-9123-9cbc331b3aa5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:08.917795 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4feabe85-fbc6-4c71-9123-9cbc331b3aa5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:08.925531 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4feabe85-fbc6-4c71-9123-9cbc331b3aa5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.091171 Dec 15 13:09:08.926265 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1302/2619] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:08 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:09.942762 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e186fecd-db61-4084-bce3-7a41f0051479 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:09.943409 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e186fecd-db61-4084-bce3-7a41f0051479 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:09.950733 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e186fecd-db61-4084-bce3-7a41f0051479 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:09.951183 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e186fecd-db61-4084-bce3-7a41f0051479 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:09.951966 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e186fecd-db61-4084-bce3-7a41f0051479 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:09.952400 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e186fecd-db61-4084-bce3-7a41f0051479 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:10.017096 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e186fecd-db61-4084-bce3-7a41f0051479 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:10.025718 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e186fecd-db61-4084-bce3-7a41f0051479 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.086683 Dec 15 13:09:10.026280 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1318/2620] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:09 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:11.042745 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-00bbe40e-5283-493b-8d92-8b25312f4021 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:11.043367 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-00bbe40e-5283-493b-8d92-8b25312f4021 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:11.049638 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-00bbe40e-5283-493b-8d92-8b25312f4021 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:11.050161 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-00bbe40e-5283-493b-8d92-8b25312f4021 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:11.051268 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-00bbe40e-5283-493b-8d92-8b25312f4021 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:11.051643 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-00bbe40e-5283-493b-8d92-8b25312f4021 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:11.111273 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-00bbe40e-5283-493b-8d92-8b25312f4021 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:11.119110 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-00bbe40e-5283-493b-8d92-8b25312f4021 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080785 Dec 15 13:09:11.119686 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1303/2621] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:11 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:12.135916 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-08342b2e-9d5b-4198-bbf1-7c5a4d8f3059 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:12.136557 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-08342b2e-9d5b-4198-bbf1-7c5a4d8f3059 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:12.143042 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-08342b2e-9d5b-4198-bbf1-7c5a4d8f3059 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:12.143494 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-08342b2e-9d5b-4198-bbf1-7c5a4d8f3059 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:12.144270 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-08342b2e-9d5b-4198-bbf1-7c5a4d8f3059 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:12.144735 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-08342b2e-9d5b-4198-bbf1-7c5a4d8f3059 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:12.204120 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-08342b2e-9d5b-4198-bbf1-7c5a4d8f3059 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:12.212079 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-08342b2e-9d5b-4198-bbf1-7c5a4d8f3059 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.079802 Dec 15 13:09:12.212649 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1319/2622] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:12 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:13.229087 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8344ff3b-cb2b-4172-bac8-6c3f16901594 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:13.229726 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8344ff3b-cb2b-4172-bac8-6c3f16901594 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:13.236045 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8344ff3b-cb2b-4172-bac8-6c3f16901594 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:13.236496 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8344ff3b-cb2b-4172-bac8-6c3f16901594 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:13.237274 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8344ff3b-cb2b-4172-bac8-6c3f16901594 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:13.237745 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8344ff3b-cb2b-4172-bac8-6c3f16901594 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:13.344527 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8344ff3b-cb2b-4172-bac8-6c3f16901594 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:13.352636 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8344ff3b-cb2b-4172-bac8-6c3f16901594 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.127474 Dec 15 13:09:13.353203 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1304/2623] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:13 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:14.368824 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e9b6168d-fdff-41f4-b912-372d6272390a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:14.369533 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e9b6168d-fdff-41f4-b912-372d6272390a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:14.376034 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e9b6168d-fdff-41f4-b912-372d6272390a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:14.376493 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e9b6168d-fdff-41f4-b912-372d6272390a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:14.377313 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e9b6168d-fdff-41f4-b912-372d6272390a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:14.377785 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e9b6168d-fdff-41f4-b912-372d6272390a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:14.437289 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e9b6168d-fdff-41f4-b912-372d6272390a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:14.445680 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e9b6168d-fdff-41f4-b912-372d6272390a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080914 Dec 15 13:09:14.446244 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1320/2624] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:14 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:15.462329 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b8074958-8ac8-452f-90c8-70a16d6094fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:15.462938 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b8074958-8ac8-452f-90c8-70a16d6094fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:15.469157 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b8074958-8ac8-452f-90c8-70a16d6094fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:15.469637 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b8074958-8ac8-452f-90c8-70a16d6094fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:15.470414 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b8074958-8ac8-452f-90c8-70a16d6094fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:15.470853 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b8074958-8ac8-452f-90c8-70a16d6094fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:15.529866 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b8074958-8ac8-452f-90c8-70a16d6094fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:15.538233 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b8074958-8ac8-452f-90c8-70a16d6094fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.078961 Dec 15 13:09:15.538796 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1305/2625] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:15 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:16.555737 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-23042954-7bc5-4af4-8090-691de3612dab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:16.556329 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-23042954-7bc5-4af4-8090-691de3612dab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:16.562531 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-23042954-7bc5-4af4-8090-691de3612dab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:16.562985 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-23042954-7bc5-4af4-8090-691de3612dab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:16.563768 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-23042954-7bc5-4af4-8090-691de3612dab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:16.564205 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-23042954-7bc5-4af4-8090-691de3612dab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:16.625986 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-23042954-7bc5-4af4-8090-691de3612dab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:16.634551 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-23042954-7bc5-4af4-8090-691de3612dab tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.083696 Dec 15 13:09:16.635122 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1321/2626] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:16 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:17.651706 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-19f4b3f6-fab5-4909-948c-96b03c53b09c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:17.652366 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-19f4b3f6-fab5-4909-948c-96b03c53b09c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:17.658786 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-19f4b3f6-fab5-4909-948c-96b03c53b09c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:17.659234 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-19f4b3f6-fab5-4909-948c-96b03c53b09c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:17.660020 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-19f4b3f6-fab5-4909-948c-96b03c53b09c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:17.660454 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-19f4b3f6-fab5-4909-948c-96b03c53b09c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:17.722180 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-19f4b3f6-fab5-4909-948c-96b03c53b09c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:17.730809 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-19f4b3f6-fab5-4909-948c-96b03c53b09c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.083022 Dec 15 13:09:17.731373 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1306/2627] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:17 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:18.747614 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-dda4ee39-c1cc-4dc0-b3bc-d063fdb0788b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:18.748246 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-dda4ee39-c1cc-4dc0-b3bc-d063fdb0788b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:18.754572 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dda4ee39-c1cc-4dc0-b3bc-d063fdb0788b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:18.755015 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dda4ee39-c1cc-4dc0-b3bc-d063fdb0788b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:18.755784 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dda4ee39-c1cc-4dc0-b3bc-d063fdb0788b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:18.756839 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dda4ee39-c1cc-4dc0-b3bc-d063fdb0788b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:18.816498 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-dda4ee39-c1cc-4dc0-b3bc-d063fdb0788b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:18.824778 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-dda4ee39-c1cc-4dc0-b3bc-d063fdb0788b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080928 Dec 15 13:09:18.825334 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1322/2628] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:18 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:19.841321 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bbeb1638-b941-41a2-9f1a-4bc522955d06 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:19.841984 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bbeb1638-b941-41a2-9f1a-4bc522955d06 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:19.848758 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bbeb1638-b941-41a2-9f1a-4bc522955d06 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:19.849208 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bbeb1638-b941-41a2-9f1a-4bc522955d06 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:19.850097 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bbeb1638-b941-41a2-9f1a-4bc522955d06 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:19.850624 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bbeb1638-b941-41a2-9f1a-4bc522955d06 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:19.910759 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bbeb1638-b941-41a2-9f1a-4bc522955d06 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:19.918625 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bbeb1638-b941-41a2-9f1a-4bc522955d06 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081089 Dec 15 13:09:19.919182 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1307/2629] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:19 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:20.937858 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-77366f6f-5361-4bf1-8667-692b8b942a2f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:20.938858 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-77366f6f-5361-4bf1-8667-692b8b942a2f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:20.946808 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-77366f6f-5361-4bf1-8667-692b8b942a2f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:20.947260 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-77366f6f-5361-4bf1-8667-692b8b942a2f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:20.948052 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-77366f6f-5361-4bf1-8667-692b8b942a2f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:20.948494 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-77366f6f-5361-4bf1-8667-692b8b942a2f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:21.010525 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-77366f6f-5361-4bf1-8667-692b8b942a2f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:21.018835 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-77366f6f-5361-4bf1-8667-692b8b942a2f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.086776 Dec 15 13:09:21.019415 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1323/2630] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:20 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:22.035897 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ea18c8ee-0566-40f7-8c23-a5018cf4fb1e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:22.036500 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ea18c8ee-0566-40f7-8c23-a5018cf4fb1e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:22.043508 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ea18c8ee-0566-40f7-8c23-a5018cf4fb1e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:22.043954 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ea18c8ee-0566-40f7-8c23-a5018cf4fb1e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:22.044735 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ea18c8ee-0566-40f7-8c23-a5018cf4fb1e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:22.045171 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ea18c8ee-0566-40f7-8c23-a5018cf4fb1e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:22.104070 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ea18c8ee-0566-40f7-8c23-a5018cf4fb1e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:22.111847 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ea18c8ee-0566-40f7-8c23-a5018cf4fb1e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.079628 Dec 15 13:09:22.112449 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1308/2631] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:22 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:23.128547 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c130d476-4666-4118-bc35-24724db0f125 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:23.129167 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c130d476-4666-4118-bc35-24724db0f125 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:23.135832 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c130d476-4666-4118-bc35-24724db0f125 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:23.136276 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c130d476-4666-4118-bc35-24724db0f125 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:23.137056 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c130d476-4666-4118-bc35-24724db0f125 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:23.137490 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c130d476-4666-4118-bc35-24724db0f125 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:23.201570 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c130d476-4666-4118-bc35-24724db0f125 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:23.210072 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c130d476-4666-4118-bc35-24724db0f125 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.084508 Dec 15 13:09:23.210649 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1324/2632] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:23 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:24.226467 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b6222da1-a11b-4f7e-838b-d5bbe5ab7a87 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:24.227523 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b6222da1-a11b-4f7e-838b-d5bbe5ab7a87 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:24.233964 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b6222da1-a11b-4f7e-838b-d5bbe5ab7a87 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:24.234395 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b6222da1-a11b-4f7e-838b-d5bbe5ab7a87 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:24.235176 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b6222da1-a11b-4f7e-838b-d5bbe5ab7a87 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:24.235607 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b6222da1-a11b-4f7e-838b-d5bbe5ab7a87 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:24.297439 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b6222da1-a11b-4f7e-838b-d5bbe5ab7a87 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:24.306512 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b6222da1-a11b-4f7e-838b-d5bbe5ab7a87 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.083841 Dec 15 13:09:24.307086 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1309/2633] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:24 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:25.328037 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8439b7f3-6b80-4b74-b12f-3b059a5b4771 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:25.328809 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8439b7f3-6b80-4b74-b12f-3b059a5b4771 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:25.335161 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8439b7f3-6b80-4b74-b12f-3b059a5b4771 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:25.335614 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8439b7f3-6b80-4b74-b12f-3b059a5b4771 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:25.336403 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8439b7f3-6b80-4b74-b12f-3b059a5b4771 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:25.336846 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8439b7f3-6b80-4b74-b12f-3b059a5b4771 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:25.401044 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-8439b7f3-6b80-4b74-b12f-3b059a5b4771 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:25.416960 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8439b7f3-6b80-4b74-b12f-3b059a5b4771 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.092511 Dec 15 13:09:25.417561 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1325/2634] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:25 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:26.434338 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8db7f174-fc90-43e6-b3b6-53dac3d2f7dd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:26.434942 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8db7f174-fc90-43e6-b3b6-53dac3d2f7dd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:26.441278 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8db7f174-fc90-43e6-b3b6-53dac3d2f7dd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:26.441760 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8db7f174-fc90-43e6-b3b6-53dac3d2f7dd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:26.442561 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8db7f174-fc90-43e6-b3b6-53dac3d2f7dd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:26.442999 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8db7f174-fc90-43e6-b3b6-53dac3d2f7dd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:26.508040 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8db7f174-fc90-43e6-b3b6-53dac3d2f7dd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:26.516823 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8db7f174-fc90-43e6-b3b6-53dac3d2f7dd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.086204 Dec 15 13:09:26.517393 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1310/2635] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:26 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:27.532897 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4f108874-2d14-48c6-81ec-5a13bea69d86 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:27.533491 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4f108874-2d14-48c6-81ec-5a13bea69d86 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:27.540200 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4f108874-2d14-48c6-81ec-5a13bea69d86 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:27.540646 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4f108874-2d14-48c6-81ec-5a13bea69d86 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:27.541411 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4f108874-2d14-48c6-81ec-5a13bea69d86 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:27.541879 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4f108874-2d14-48c6-81ec-5a13bea69d86 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:27.600265 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4f108874-2d14-48c6-81ec-5a13bea69d86 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:27.607906 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4f108874-2d14-48c6-81ec-5a13bea69d86 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.078639 Dec 15 13:09:27.608463 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1326/2636] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:27 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:28.625822 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-18c116f4-873e-4dfe-9449-7657115d0287 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:28.626390 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-18c116f4-873e-4dfe-9449-7657115d0287 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:28.632411 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-18c116f4-873e-4dfe-9449-7657115d0287 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:28.632861 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-18c116f4-873e-4dfe-9449-7657115d0287 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:28.633663 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-18c116f4-873e-4dfe-9449-7657115d0287 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:28.634104 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-18c116f4-873e-4dfe-9449-7657115d0287 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:28.697695 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-18c116f4-873e-4dfe-9449-7657115d0287 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:28.706067 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-18c116f4-873e-4dfe-9449-7657115d0287 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.084099 Dec 15 13:09:28.706660 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1311/2637] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:28 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:29.723893 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3b72ba04-9954-4cf1-9458-4c182ab1f7ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:29.724523 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3b72ba04-9954-4cf1-9458-4c182ab1f7ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:29.730558 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3b72ba04-9954-4cf1-9458-4c182ab1f7ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:29.731007 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3b72ba04-9954-4cf1-9458-4c182ab1f7ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:29.731791 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3b72ba04-9954-4cf1-9458-4c182ab1f7ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:29.732229 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3b72ba04-9954-4cf1-9458-4c182ab1f7ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:29.847684 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3b72ba04-9954-4cf1-9458-4c182ab1f7ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:29.859590 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3b72ba04-9954-4cf1-9458-4c182ab1f7ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.139205 Dec 15 13:09:29.860172 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1327/2638] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:29 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:30.876174 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1a087d09-03fe-4e17-b064-a9b7f4b1f35f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:30.876798 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1a087d09-03fe-4e17-b064-a9b7f4b1f35f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:30.883550 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1a087d09-03fe-4e17-b064-a9b7f4b1f35f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:30.884005 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1a087d09-03fe-4e17-b064-a9b7f4b1f35f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:30.884788 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1a087d09-03fe-4e17-b064-a9b7f4b1f35f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:30.885226 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1a087d09-03fe-4e17-b064-a9b7f4b1f35f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:30.950051 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1a087d09-03fe-4e17-b064-a9b7f4b1f35f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:30.954884 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1a087d09-03fe-4e17-b064-a9b7f4b1f35f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082284 Dec 15 13:09:30.955469 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1312/2639] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:30 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:31.971826 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1166fa13-806a-48b0-baf8-a17a9ee29d39 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:31.972476 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1166fa13-806a-48b0-baf8-a17a9ee29d39 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:31.979254 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1166fa13-806a-48b0-baf8-a17a9ee29d39 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:31.979707 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1166fa13-806a-48b0-baf8-a17a9ee29d39 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:31.980514 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1166fa13-806a-48b0-baf8-a17a9ee29d39 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:31.980949 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1166fa13-806a-48b0-baf8-a17a9ee29d39 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:32.041059 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1166fa13-806a-48b0-baf8-a17a9ee29d39 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:32.049245 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1166fa13-806a-48b0-baf8-a17a9ee29d39 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081046 Dec 15 13:09:32.049861 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1328/2640] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:31 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:33.066453 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-151ef432-286b-4e0b-8654-e4c25465ef4d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:33.067201 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-151ef432-286b-4e0b-8654-e4c25465ef4d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:33.074061 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-151ef432-286b-4e0b-8654-e4c25465ef4d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:33.074512 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-151ef432-286b-4e0b-8654-e4c25465ef4d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:33.075274 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-151ef432-286b-4e0b-8654-e4c25465ef4d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:33.075706 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-151ef432-286b-4e0b-8654-e4c25465ef4d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:33.135092 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-151ef432-286b-4e0b-8654-e4c25465ef4d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:33.145413 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-151ef432-286b-4e0b-8654-e4c25465ef4d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082452 Dec 15 13:09:33.146434 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1313/2641] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:33 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:34.162511 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fb12dd38-b84f-472e-91b5-e3f8333d20a4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:34.163152 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fb12dd38-b84f-472e-91b5-e3f8333d20a4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:34.169399 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fb12dd38-b84f-472e-91b5-e3f8333d20a4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:34.169885 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fb12dd38-b84f-472e-91b5-e3f8333d20a4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:34.170669 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fb12dd38-b84f-472e-91b5-e3f8333d20a4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:34.171108 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fb12dd38-b84f-472e-91b5-e3f8333d20a4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:34.235845 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-fb12dd38-b84f-472e-91b5-e3f8333d20a4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:34.244238 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fb12dd38-b84f-472e-91b5-e3f8333d20a4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.085456 Dec 15 13:09:34.244822 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1329/2642] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:34 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:35.260935 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-123dd855-6719-4c34-acf6-d2a46ba6d463 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:35.261594 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-123dd855-6719-4c34-acf6-d2a46ba6d463 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:35.268305 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-123dd855-6719-4c34-acf6-d2a46ba6d463 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:35.268757 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-123dd855-6719-4c34-acf6-d2a46ba6d463 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:35.269564 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-123dd855-6719-4c34-acf6-d2a46ba6d463 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:35.270004 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-123dd855-6719-4c34-acf6-d2a46ba6d463 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:35.329894 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-123dd855-6719-4c34-acf6-d2a46ba6d463 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:35.345803 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-123dd855-6719-4c34-acf6-d2a46ba6d463 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.088365 Dec 15 13:09:35.346405 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1314/2643] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:35 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:36.363107 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1d2371ab-b5d9-431e-bef0-2096b8a030ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:36.363747 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1d2371ab-b5d9-431e-bef0-2096b8a030ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:36.371077 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1d2371ab-b5d9-431e-bef0-2096b8a030ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:36.371560 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1d2371ab-b5d9-431e-bef0-2096b8a030ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:36.373113 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1d2371ab-b5d9-431e-bef0-2096b8a030ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:36.373113 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1d2371ab-b5d9-431e-bef0-2096b8a030ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:36.440774 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1d2371ab-b5d9-431e-bef0-2096b8a030ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:36.448815 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1d2371ab-b5d9-431e-bef0-2096b8a030ce tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.089343 Dec 15 13:09:36.449385 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1330/2644] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:36 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:37.465405 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6c2b2ca7-e904-4052-a6af-467e7861653a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:37.466063 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6c2b2ca7-e904-4052-a6af-467e7861653a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:37.472360 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6c2b2ca7-e904-4052-a6af-467e7861653a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:37.472817 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6c2b2ca7-e904-4052-a6af-467e7861653a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:37.473626 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6c2b2ca7-e904-4052-a6af-467e7861653a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:37.474062 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6c2b2ca7-e904-4052-a6af-467e7861653a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:37.534887 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6c2b2ca7-e904-4052-a6af-467e7861653a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:37.543264 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6c2b2ca7-e904-4052-a6af-467e7861653a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081437 Dec 15 13:09:37.543853 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1315/2645] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:37 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:38.425590 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:09:38.425880 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 13:09:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:09:38.559635 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-132dba8e-2b70-4371-b502-81007a7117d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:38.560175 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-132dba8e-2b70-4371-b502-81007a7117d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:38.566439 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-132dba8e-2b70-4371-b502-81007a7117d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:38.566883 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-132dba8e-2b70-4371-b502-81007a7117d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:38.567644 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-132dba8e-2b70-4371-b502-81007a7117d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:38.568612 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-132dba8e-2b70-4371-b502-81007a7117d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:38.634612 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-132dba8e-2b70-4371-b502-81007a7117d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:38.642742 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-132dba8e-2b70-4371-b502-81007a7117d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.086742 Dec 15 13:09:38.643325 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1331/2646] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:38 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:39.660048 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-94df31b8-97ce-4ffc-a452-52579aea6078 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:39.660665 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-94df31b8-97ce-4ffc-a452-52579aea6078 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:39.668147 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-94df31b8-97ce-4ffc-a452-52579aea6078 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:39.668605 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-94df31b8-97ce-4ffc-a452-52579aea6078 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:39.669450 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-94df31b8-97ce-4ffc-a452-52579aea6078 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:39.669907 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-94df31b8-97ce-4ffc-a452-52579aea6078 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:39.731168 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-94df31b8-97ce-4ffc-a452-52579aea6078 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:39.738965 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-94df31b8-97ce-4ffc-a452-52579aea6078 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082651 Dec 15 13:09:39.739524 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1316/2647] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:39 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:40.755088 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0198c93a-3095-425b-ae7c-9f296e057b93 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:40.755734 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0198c93a-3095-425b-ae7c-9f296e057b93 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:40.762761 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0198c93a-3095-425b-ae7c-9f296e057b93 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:40.763461 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0198c93a-3095-425b-ae7c-9f296e057b93 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:40.764234 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0198c93a-3095-425b-ae7c-9f296e057b93 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:40.764669 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0198c93a-3095-425b-ae7c-9f296e057b93 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:40.825459 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0198c93a-3095-425b-ae7c-9f296e057b93 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:40.833481 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0198c93a-3095-425b-ae7c-9f296e057b93 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082123 Dec 15 13:09:40.834080 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1332/2648] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:40 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:41.850380 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1c4d871f-4170-459d-902c-42b047e0ddd8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:41.851038 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1c4d871f-4170-459d-902c-42b047e0ddd8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:41.857529 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1c4d871f-4170-459d-902c-42b047e0ddd8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:41.857995 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1c4d871f-4170-459d-902c-42b047e0ddd8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:41.858776 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1c4d871f-4170-459d-902c-42b047e0ddd8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:41.859216 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1c4d871f-4170-459d-902c-42b047e0ddd8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:41.920276 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1c4d871f-4170-459d-902c-42b047e0ddd8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:41.928893 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1c4d871f-4170-459d-902c-42b047e0ddd8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082146 Dec 15 13:09:41.929456 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1317/2649] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:41 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:42.948092 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-25e78bd5-0ad5-4497-8dce-eb768a212fcb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:42.948700 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-25e78bd5-0ad5-4497-8dce-eb768a212fcb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:42.955146 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-25e78bd5-0ad5-4497-8dce-eb768a212fcb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:42.955613 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-25e78bd5-0ad5-4497-8dce-eb768a212fcb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:42.956411 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-25e78bd5-0ad5-4497-8dce-eb768a212fcb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:42.956847 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-25e78bd5-0ad5-4497-8dce-eb768a212fcb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:43.020332 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-25e78bd5-0ad5-4497-8dce-eb768a212fcb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:43.028620 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-25e78bd5-0ad5-4497-8dce-eb768a212fcb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.084183 Dec 15 13:09:43.029189 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1333/2650] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:42 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:44.046058 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bc65d822-42b3-49f7-a08d-7b11fb97971b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:44.046705 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bc65d822-42b3-49f7-a08d-7b11fb97971b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:44.053852 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc65d822-42b3-49f7-a08d-7b11fb97971b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:44.054303 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc65d822-42b3-49f7-a08d-7b11fb97971b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:44.055094 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc65d822-42b3-49f7-a08d-7b11fb97971b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:44.055526 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc65d822-42b3-49f7-a08d-7b11fb97971b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:44.116165 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bc65d822-42b3-49f7-a08d-7b11fb97971b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:44.124241 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bc65d822-42b3-49f7-a08d-7b11fb97971b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081988 Dec 15 13:09:44.124802 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1318/2651] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:44 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:45.140715 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7c035b0c-9e3c-49da-8e73-b3108be4775c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:45.141424 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7c035b0c-9e3c-49da-8e73-b3108be4775c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:45.149061 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7c035b0c-9e3c-49da-8e73-b3108be4775c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:45.149525 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7c035b0c-9e3c-49da-8e73-b3108be4775c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:45.150357 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7c035b0c-9e3c-49da-8e73-b3108be4775c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:45.150801 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7c035b0c-9e3c-49da-8e73-b3108be4775c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:45.213100 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7c035b0c-9e3c-49da-8e73-b3108be4775c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:45.221196 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7c035b0c-9e3c-49da-8e73-b3108be4775c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.084422 Dec 15 13:09:45.221916 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1334/2652] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:45 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:46.308284 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ac33a750-9b7e-4999-8948-a391317ed167 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:46.308903 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ac33a750-9b7e-4999-8948-a391317ed167 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:46.314783 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ac33a750-9b7e-4999-8948-a391317ed167 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:46.315235 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ac33a750-9b7e-4999-8948-a391317ed167 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:46.316018 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ac33a750-9b7e-4999-8948-a391317ed167 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:46.316456 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ac33a750-9b7e-4999-8948-a391317ed167 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:46.376497 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ac33a750-9b7e-4999-8948-a391317ed167 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:46.384564 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ac33a750-9b7e-4999-8948-a391317ed167 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.149296 Dec 15 13:09:46.385158 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1319/2653] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:46 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:47.406339 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-93313231-6a3b-4584-b020-6023e8539ec1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:47.406956 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-93313231-6a3b-4584-b020-6023e8539ec1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:47.413429 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-93313231-6a3b-4584-b020-6023e8539ec1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:47.413935 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-93313231-6a3b-4584-b020-6023e8539ec1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:47.414715 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-93313231-6a3b-4584-b020-6023e8539ec1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:47.415156 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-93313231-6a3b-4584-b020-6023e8539ec1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:47.474975 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-93313231-6a3b-4584-b020-6023e8539ec1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:47.490778 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-93313231-6a3b-4584-b020-6023e8539ec1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.087493 Dec 15 13:09:47.491367 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1335/2654] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:47 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:48.508382 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-079ed7a2-b71e-4e82-a4fa-bdfd1b2665a1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:48.508997 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-079ed7a2-b71e-4e82-a4fa-bdfd1b2665a1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:48.515772 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-079ed7a2-b71e-4e82-a4fa-bdfd1b2665a1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:48.516224 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-079ed7a2-b71e-4e82-a4fa-bdfd1b2665a1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:48.517001 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-079ed7a2-b71e-4e82-a4fa-bdfd1b2665a1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:48.517440 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-079ed7a2-b71e-4e82-a4fa-bdfd1b2665a1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:48.579631 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-079ed7a2-b71e-4e82-a4fa-bdfd1b2665a1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:48.588437 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-079ed7a2-b71e-4e82-a4fa-bdfd1b2665a1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.084438 Dec 15 13:09:48.588997 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1320/2655] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:48 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:49.605467 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5fc66b05-2acc-481e-bbf2-22f57b7cb7c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:49.606068 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5fc66b05-2acc-481e-bbf2-22f57b7cb7c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:49.612468 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5fc66b05-2acc-481e-bbf2-22f57b7cb7c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:49.612923 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5fc66b05-2acc-481e-bbf2-22f57b7cb7c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:49.613738 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5fc66b05-2acc-481e-bbf2-22f57b7cb7c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:49.614178 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5fc66b05-2acc-481e-bbf2-22f57b7cb7c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:49.678471 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5fc66b05-2acc-481e-bbf2-22f57b7cb7c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:49.686665 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5fc66b05-2acc-481e-bbf2-22f57b7cb7c1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.084808 Dec 15 13:09:49.687249 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1336/2656] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:49 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:09:50.703490 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6f948c2f-cf0a-4f8a-a376-ea3ba561fcc6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:50.704104 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6f948c2f-cf0a-4f8a-a376-ea3ba561fcc6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:50.718981 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6f948c2f-cf0a-4f8a-a376-ea3ba561fcc6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:50.719465 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6f948c2f-cf0a-4f8a-a376-ea3ba561fcc6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:50.720268 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6f948c2f-cf0a-4f8a-a376-ea3ba561fcc6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:50.720709 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6f948c2f-cf0a-4f8a-a376-ea3ba561fcc6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:50.790842 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6f948c2f-cf0a-4f8a-a376-ea3ba561fcc6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:50.800249 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6f948c2f-cf0a-4f8a-a376-ea3ba561fcc6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.100319 Dec 15 13:09:50.801068 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1321/2657] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:50 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:09:51.819472 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9d25f0df-7a6e-488e-82d3-6638fb6a6a7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:51.820126 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9d25f0df-7a6e-488e-82d3-6638fb6a6a7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:51.827578 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9d25f0df-7a6e-488e-82d3-6638fb6a6a7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:51.828022 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9d25f0df-7a6e-488e-82d3-6638fb6a6a7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:51.828814 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9d25f0df-7a6e-488e-82d3-6638fb6a6a7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:51.829249 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9d25f0df-7a6e-488e-82d3-6638fb6a6a7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:51.889414 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9d25f0df-7a6e-488e-82d3-6638fb6a6a7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:51.897393 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9d25f0df-7a6e-488e-82d3-6638fb6a6a7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081717 Dec 15 13:09:51.897990 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1337/2658] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:51 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:52.914630 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-40bac9a9-9b62-40e5-b92c-a263bf61b868 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:52.915290 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-40bac9a9-9b62-40e5-b92c-a263bf61b868 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:52.921870 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-40bac9a9-9b62-40e5-b92c-a263bf61b868 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:52.922367 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-40bac9a9-9b62-40e5-b92c-a263bf61b868 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:52.923158 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-40bac9a9-9b62-40e5-b92c-a263bf61b868 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:52.923599 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-40bac9a9-9b62-40e5-b92c-a263bf61b868 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:52.983018 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-40bac9a9-9b62-40e5-b92c-a263bf61b868 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:52.991490 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-40bac9a9-9b62-40e5-b92c-a263bf61b868 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081179 Dec 15 13:09:52.992052 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1322/2659] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:52 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:54.008717 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8b8a32a7-c411-46d7-8876-e8a470346240 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:54.009361 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8b8a32a7-c411-46d7-8876-e8a470346240 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:54.016419 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8b8a32a7-c411-46d7-8876-e8a470346240 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:54.016869 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8b8a32a7-c411-46d7-8876-e8a470346240 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:54.017697 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8b8a32a7-c411-46d7-8876-e8a470346240 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:54.018134 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8b8a32a7-c411-46d7-8876-e8a470346240 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:54.077208 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-8b8a32a7-c411-46d7-8876-e8a470346240 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:54.085223 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8b8a32a7-c411-46d7-8876-e8a470346240 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080954 Dec 15 13:09:54.085815 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1338/2660] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:54 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:55.102378 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-865e9e7b-b4bb-4646-8cbd-305ad7a252b2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:55.103045 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-865e9e7b-b4bb-4646-8cbd-305ad7a252b2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:55.109849 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-865e9e7b-b4bb-4646-8cbd-305ad7a252b2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:55.110296 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-865e9e7b-b4bb-4646-8cbd-305ad7a252b2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:55.111089 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-865e9e7b-b4bb-4646-8cbd-305ad7a252b2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:55.111528 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-865e9e7b-b4bb-4646-8cbd-305ad7a252b2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:55.173957 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-865e9e7b-b4bb-4646-8cbd-305ad7a252b2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:55.181894 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-865e9e7b-b4bb-4646-8cbd-305ad7a252b2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.083480 Dec 15 13:09:55.182476 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1323/2661] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:55 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:56.198572 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-89adef86-9013-4651-8fb1-451c20fcc2f5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:56.199205 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-89adef86-9013-4651-8fb1-451c20fcc2f5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:56.205625 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-89adef86-9013-4651-8fb1-451c20fcc2f5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:56.206079 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-89adef86-9013-4651-8fb1-451c20fcc2f5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:56.206865 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-89adef86-9013-4651-8fb1-451c20fcc2f5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:56.207298 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-89adef86-9013-4651-8fb1-451c20fcc2f5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:56.270103 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-89adef86-9013-4651-8fb1-451c20fcc2f5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:56.278944 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-89adef86-9013-4651-8fb1-451c20fcc2f5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.084136 Dec 15 13:09:56.279505 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1339/2662] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:56 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:57.296124 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2450258c-8e77-45c0-8de6-71b7688039bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:57.297354 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2450258c-8e77-45c0-8de6-71b7688039bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:57.304328 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2450258c-8e77-45c0-8de6-71b7688039bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:57.304771 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2450258c-8e77-45c0-8de6-71b7688039bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:57.305595 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2450258c-8e77-45c0-8de6-71b7688039bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:57.306032 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2450258c-8e77-45c0-8de6-71b7688039bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:57.372841 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2450258c-8e77-45c0-8de6-71b7688039bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:57.380911 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2450258c-8e77-45c0-8de6-71b7688039bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.088285 Dec 15 13:09:57.381488 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1324/2663] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:57 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:58.398576 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ec8cb74b-0973-40b1-9d20-9ec64df8d7c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:58.399181 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ec8cb74b-0973-40b1-9d20-9ec64df8d7c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:58.405470 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ec8cb74b-0973-40b1-9d20-9ec64df8d7c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:58.405950 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ec8cb74b-0973-40b1-9d20-9ec64df8d7c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:58.406729 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ec8cb74b-0973-40b1-9d20-9ec64df8d7c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:58.407166 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ec8cb74b-0973-40b1-9d20-9ec64df8d7c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:58.466355 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ec8cb74b-0973-40b1-9d20-9ec64df8d7c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:58.474377 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ec8cb74b-0973-40b1-9d20-9ec64df8d7c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.079922 Dec 15 13:09:58.475122 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1340/2664] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:58 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:09:59.491714 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-55c1c07b-67e2-4aa5-ad8b-3ba6b860b727 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:09:59.492333 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-55c1c07b-67e2-4aa5-ad8b-3ba6b860b727 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:09:59.498592 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-55c1c07b-67e2-4aa5-ad8b-3ba6b860b727 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:59.499027 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-55c1c07b-67e2-4aa5-ad8b-3ba6b860b727 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:59.499810 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-55c1c07b-67e2-4aa5-ad8b-3ba6b860b727 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:09:59.500249 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-55c1c07b-67e2-4aa5-ad8b-3ba6b860b727 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:09:59.561458 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-55c1c07b-67e2-4aa5-ad8b-3ba6b860b727 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:09:59.569797 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-55c1c07b-67e2-4aa5-ad8b-3ba6b860b727 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082204 Dec 15 13:09:59.570369 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1325/2665] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:09:59 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:00.060958 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:10:00.061246 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 13:10:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:10:00.586731 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6657810c-5baa-48d0-b343-13a78cd861d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:00.587328 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6657810c-5baa-48d0-b343-13a78cd861d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:00.593102 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6657810c-5baa-48d0-b343-13a78cd861d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:00.593568 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6657810c-5baa-48d0-b343-13a78cd861d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:00.594330 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6657810c-5baa-48d0-b343-13a78cd861d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:00.594757 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6657810c-5baa-48d0-b343-13a78cd861d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:00.653461 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6657810c-5baa-48d0-b343-13a78cd861d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:00.661247 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6657810c-5baa-48d0-b343-13a78cd861d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.079297 Dec 15 13:10:00.662000 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1341/2666] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:00 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:01.683643 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fb2abef8-8036-48da-9bf9-f1aec93e6610 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:01.684244 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fb2abef8-8036-48da-9bf9-f1aec93e6610 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:01.690761 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fb2abef8-8036-48da-9bf9-f1aec93e6610 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:01.691214 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fb2abef8-8036-48da-9bf9-f1aec93e6610 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:01.691998 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fb2abef8-8036-48da-9bf9-f1aec93e6610 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:01.692439 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fb2abef8-8036-48da-9bf9-f1aec93e6610 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:01.754893 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fb2abef8-8036-48da-9bf9-f1aec93e6610 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:01.763988 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fb2abef8-8036-48da-9bf9-f1aec93e6610 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.083624 Dec 15 13:10:01.764576 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1326/2667] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:01 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:02.781040 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fcedbb54-a1f7-40c5-b262-9d0dacdcee21 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:02.781668 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fcedbb54-a1f7-40c5-b262-9d0dacdcee21 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:02.788286 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fcedbb54-a1f7-40c5-b262-9d0dacdcee21 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:02.788736 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fcedbb54-a1f7-40c5-b262-9d0dacdcee21 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:02.789533 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fcedbb54-a1f7-40c5-b262-9d0dacdcee21 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:02.789978 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fcedbb54-a1f7-40c5-b262-9d0dacdcee21 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:02.853393 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-fcedbb54-a1f7-40c5-b262-9d0dacdcee21 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:02.861778 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fcedbb54-a1f7-40c5-b262-9d0dacdcee21 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.084405 Dec 15 13:10:02.862370 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1342/2668] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:02 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:03.879159 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8071b180-e50b-4f0d-9acb-729e6a1559bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:03.879765 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8071b180-e50b-4f0d-9acb-729e6a1559bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:03.886299 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8071b180-e50b-4f0d-9acb-729e6a1559bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:03.886760 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8071b180-e50b-4f0d-9acb-729e6a1559bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:03.887540 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8071b180-e50b-4f0d-9acb-729e6a1559bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:03.887980 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8071b180-e50b-4f0d-9acb-729e6a1559bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:03.948050 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8071b180-e50b-4f0d-9acb-729e6a1559bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:03.956271 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8071b180-e50b-4f0d-9acb-729e6a1559bd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080756 Dec 15 13:10:03.956864 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1327/2669] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:03 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:04.973924 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-057ca49c-1b59-469d-aa7b-43b3589fdb4c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:04.974766 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-057ca49c-1b59-469d-aa7b-43b3589fdb4c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:04.981133 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-057ca49c-1b59-469d-aa7b-43b3589fdb4c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:04.981617 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-057ca49c-1b59-469d-aa7b-43b3589fdb4c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:04.982391 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-057ca49c-1b59-469d-aa7b-43b3589fdb4c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:04.982821 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-057ca49c-1b59-469d-aa7b-43b3589fdb4c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:05.045855 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-057ca49c-1b59-469d-aa7b-43b3589fdb4c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:05.055149 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-057ca49c-1b59-469d-aa7b-43b3589fdb4c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.085238 Dec 15 13:10:05.055735 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1343/2670] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:04 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:06.072011 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1d1ea267-635b-45d7-9384-a528fd3870a7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:06.072669 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1d1ea267-635b-45d7-9384-a528fd3870a7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:06.078983 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1d1ea267-635b-45d7-9384-a528fd3870a7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:06.079426 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1d1ea267-635b-45d7-9384-a528fd3870a7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:06.080222 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1d1ea267-635b-45d7-9384-a528fd3870a7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:06.080652 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1d1ea267-635b-45d7-9384-a528fd3870a7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:06.150987 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1d1ea267-635b-45d7-9384-a528fd3870a7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:06.160569 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1d1ea267-635b-45d7-9384-a528fd3870a7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.092254 Dec 15 13:10:06.161130 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1328/2671] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:06 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:07.180773 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2839ff2f-4897-47ee-97bf-b6b2028c3135 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:07.181372 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2839ff2f-4897-47ee-97bf-b6b2028c3135 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:07.193069 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2839ff2f-4897-47ee-97bf-b6b2028c3135 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:07.193572 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2839ff2f-4897-47ee-97bf-b6b2028c3135 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:07.194379 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2839ff2f-4897-47ee-97bf-b6b2028c3135 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:07.194820 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2839ff2f-4897-47ee-97bf-b6b2028c3135 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:07.408496 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2839ff2f-4897-47ee-97bf-b6b2028c3135 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:07.418193 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2839ff2f-4897-47ee-97bf-b6b2028c3135 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.241768 Dec 15 13:10:07.419077 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1344/2672] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:07 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:10:08.436000 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-740e5a0a-97b5-42d2-9d97-b5b8ac362a67 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:08.436660 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-740e5a0a-97b5-42d2-9d97-b5b8ac362a67 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:08.443908 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-740e5a0a-97b5-42d2-9d97-b5b8ac362a67 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:08.444361 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-740e5a0a-97b5-42d2-9d97-b5b8ac362a67 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:08.445155 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-740e5a0a-97b5-42d2-9d97-b5b8ac362a67 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:08.445628 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-740e5a0a-97b5-42d2-9d97-b5b8ac362a67 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:08.506993 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-740e5a0a-97b5-42d2-9d97-b5b8ac362a67 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:08.514988 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-740e5a0a-97b5-42d2-9d97-b5b8ac362a67 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082720 Dec 15 13:10:08.515549 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1329/2673] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:08 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:09.532045 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-da86b6e1-6254-43b0-97ae-915f8d19e046 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:09.532613 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-da86b6e1-6254-43b0-97ae-915f8d19e046 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:09.539207 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-da86b6e1-6254-43b0-97ae-915f8d19e046 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:09.539659 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-da86b6e1-6254-43b0-97ae-915f8d19e046 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:09.540444 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-da86b6e1-6254-43b0-97ae-915f8d19e046 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:09.540886 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-da86b6e1-6254-43b0-97ae-915f8d19e046 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:09.602778 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-da86b6e1-6254-43b0-97ae-915f8d19e046 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:09.610455 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-da86b6e1-6254-43b0-97ae-915f8d19e046 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082157 Dec 15 13:10:09.610994 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1345/2674] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:09 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:10.627021 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b4503abc-9271-49ac-ae7b-e56354ecb4a5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:10.627596 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b4503abc-9271-49ac-ae7b-e56354ecb4a5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:10.634231 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b4503abc-9271-49ac-ae7b-e56354ecb4a5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:10.634684 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b4503abc-9271-49ac-ae7b-e56354ecb4a5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:10.635466 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b4503abc-9271-49ac-ae7b-e56354ecb4a5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:10.635903 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b4503abc-9271-49ac-ae7b-e56354ecb4a5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:10.697254 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b4503abc-9271-49ac-ae7b-e56354ecb4a5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:10.705092 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b4503abc-9271-49ac-ae7b-e56354ecb4a5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081842 Dec 15 13:10:10.705691 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1330/2675] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:10 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:11.722606 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-cf1a464d-76b9-4a5a-99e6-bba200e77472 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:11.723266 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-cf1a464d-76b9-4a5a-99e6-bba200e77472 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:11.730679 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cf1a464d-76b9-4a5a-99e6-bba200e77472 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:11.731127 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cf1a464d-76b9-4a5a-99e6-bba200e77472 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:11.731907 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cf1a464d-76b9-4a5a-99e6-bba200e77472 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:11.732338 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cf1a464d-76b9-4a5a-99e6-bba200e77472 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:11.791634 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-cf1a464d-76b9-4a5a-99e6-bba200e77472 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:11.799416 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-cf1a464d-76b9-4a5a-99e6-bba200e77472 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080602 Dec 15 13:10:11.800037 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1346/2676] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:11 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:12.816068 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6fc8019b-832b-4af0-8082-1c5dd2623a44 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:12.816701 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6fc8019b-832b-4af0-8082-1c5dd2623a44 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:12.823202 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6fc8019b-832b-4af0-8082-1c5dd2623a44 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:12.823647 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6fc8019b-832b-4af0-8082-1c5dd2623a44 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:12.824438 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6fc8019b-832b-4af0-8082-1c5dd2623a44 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:12.824865 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6fc8019b-832b-4af0-8082-1c5dd2623a44 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:12.884924 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6fc8019b-832b-4af0-8082-1c5dd2623a44 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:12.893009 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6fc8019b-832b-4af0-8082-1c5dd2623a44 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080733 Dec 15 13:10:12.893598 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1331/2677] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:12 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:13.910137 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-359aa840-be81-44b7-8149-122b6ac25ede tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:13.910778 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-359aa840-be81-44b7-8149-122b6ac25ede tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:13.918442 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-359aa840-be81-44b7-8149-122b6ac25ede tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:13.918735 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-359aa840-be81-44b7-8149-122b6ac25ede tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:13.919552 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-359aa840-be81-44b7-8149-122b6ac25ede tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:13.919962 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-359aa840-be81-44b7-8149-122b6ac25ede tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:13.979363 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-359aa840-be81-44b7-8149-122b6ac25ede tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:13.987076 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-359aa840-be81-44b7-8149-122b6ac25ede tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080763 Dec 15 13:10:13.987632 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1347/2678] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:13 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:15.004196 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ad4e807a-a094-4651-81be-276acf39443e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:15.004960 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ad4e807a-a094-4651-81be-276acf39443e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:15.011423 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad4e807a-a094-4651-81be-276acf39443e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:15.011873 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad4e807a-a094-4651-81be-276acf39443e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:15.012637 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad4e807a-a094-4651-81be-276acf39443e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:15.013072 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad4e807a-a094-4651-81be-276acf39443e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:15.074534 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ad4e807a-a094-4651-81be-276acf39443e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:15.082335 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ad4e807a-a094-4651-81be-276acf39443e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081878 Dec 15 13:10:15.083465 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1332/2679] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:14 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:10:16.099862 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6aed0808-583a-484f-bc34-91cfd6ffb525 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:16.100531 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6aed0808-583a-484f-bc34-91cfd6ffb525 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:16.107020 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6aed0808-583a-484f-bc34-91cfd6ffb525 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:16.107469 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6aed0808-583a-484f-bc34-91cfd6ffb525 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:16.108250 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6aed0808-583a-484f-bc34-91cfd6ffb525 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:16.108684 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6aed0808-583a-484f-bc34-91cfd6ffb525 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:16.170936 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6aed0808-583a-484f-bc34-91cfd6ffb525 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:16.179622 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6aed0808-583a-484f-bc34-91cfd6ffb525 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.084046 Dec 15 13:10:16.180180 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1348/2680] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:16 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:17.196169 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c5c93efb-aaf8-4736-b08e-35e64c817d11 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:17.196942 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c5c93efb-aaf8-4736-b08e-35e64c817d11 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:17.203279 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c5c93efb-aaf8-4736-b08e-35e64c817d11 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:17.203723 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c5c93efb-aaf8-4736-b08e-35e64c817d11 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:17.204489 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c5c93efb-aaf8-4736-b08e-35e64c817d11 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:17.204918 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c5c93efb-aaf8-4736-b08e-35e64c817d11 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:17.267672 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c5c93efb-aaf8-4736-b08e-35e64c817d11 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:17.276269 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c5c93efb-aaf8-4736-b08e-35e64c817d11 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.083878 Dec 15 13:10:17.276835 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1333/2681] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:17 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:18.293427 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-df7408ed-84c1-4fa5-9d24-087df9295370 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:18.294262 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-df7408ed-84c1-4fa5-9d24-087df9295370 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:18.300623 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df7408ed-84c1-4fa5-9d24-087df9295370 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:18.301130 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df7408ed-84c1-4fa5-9d24-087df9295370 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:18.301965 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df7408ed-84c1-4fa5-9d24-087df9295370 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:18.302409 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-df7408ed-84c1-4fa5-9d24-087df9295370 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:18.361142 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-df7408ed-84c1-4fa5-9d24-087df9295370 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:18.370426 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-df7408ed-84c1-4fa5-9d24-087df9295370 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080168 Dec 15 13:10:18.370979 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1349/2682] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:18 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:19.387022 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-cc07ccd9-8720-42ff-a036-88c8767fc6de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:19.387636 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-cc07ccd9-8720-42ff-a036-88c8767fc6de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:19.394534 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc07ccd9-8720-42ff-a036-88c8767fc6de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:19.394990 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc07ccd9-8720-42ff-a036-88c8767fc6de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:19.395766 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc07ccd9-8720-42ff-a036-88c8767fc6de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:19.396202 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-cc07ccd9-8720-42ff-a036-88c8767fc6de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:19.461808 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-cc07ccd9-8720-42ff-a036-88c8767fc6de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:19.469558 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cc07ccd9-8720-42ff-a036-88c8767fc6de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.086259 Dec 15 13:10:19.470130 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1334/2683] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:19 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:20.486743 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d43f188f-2a5c-4fa0-8552-8e01283e7713 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:20.487363 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d43f188f-2a5c-4fa0-8552-8e01283e7713 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:20.493698 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d43f188f-2a5c-4fa0-8552-8e01283e7713 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:20.494154 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d43f188f-2a5c-4fa0-8552-8e01283e7713 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:20.494939 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d43f188f-2a5c-4fa0-8552-8e01283e7713 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:20.495380 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d43f188f-2a5c-4fa0-8552-8e01283e7713 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:20.556862 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d43f188f-2a5c-4fa0-8552-8e01283e7713 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:20.564701 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d43f188f-2a5c-4fa0-8552-8e01283e7713 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081620 Dec 15 13:10:20.565270 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1350/2684] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:20 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:10:21.582211 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-59dfb8f2-4c6d-45dd-8ec8-35f3a6a2ef74 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:21.582804 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-59dfb8f2-4c6d-45dd-8ec8-35f3a6a2ef74 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:21.589751 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-59dfb8f2-4c6d-45dd-8ec8-35f3a6a2ef74 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:21.590210 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-59dfb8f2-4c6d-45dd-8ec8-35f3a6a2ef74 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:21.590990 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-59dfb8f2-4c6d-45dd-8ec8-35f3a6a2ef74 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:21.591429 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-59dfb8f2-4c6d-45dd-8ec8-35f3a6a2ef74 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:21.652205 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-59dfb8f2-4c6d-45dd-8ec8-35f3a6a2ef74 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:21.660174 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-59dfb8f2-4c6d-45dd-8ec8-35f3a6a2ef74 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081791 Dec 15 13:10:21.660739 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1335/2685] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:21 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:22.677066 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1c17ead1-262f-4540-97b7-d589ce29895a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:22.677850 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1c17ead1-262f-4540-97b7-d589ce29895a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:22.684314 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1c17ead1-262f-4540-97b7-d589ce29895a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:22.684776 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1c17ead1-262f-4540-97b7-d589ce29895a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:22.685600 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1c17ead1-262f-4540-97b7-d589ce29895a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:22.686065 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1c17ead1-262f-4540-97b7-d589ce29895a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:22.748052 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1c17ead1-262f-4540-97b7-d589ce29895a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:22.756061 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1c17ead1-262f-4540-97b7-d589ce29895a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082605 Dec 15 13:10:22.756648 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1351/2686] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:22 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:10:23.774206 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-663ab7c8-84c9-4662-b635-5c8d8d8a63fd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:23.774825 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-663ab7c8-84c9-4662-b635-5c8d8d8a63fd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:23.781015 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-663ab7c8-84c9-4662-b635-5c8d8d8a63fd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:23.781460 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-663ab7c8-84c9-4662-b635-5c8d8d8a63fd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:23.782270 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-663ab7c8-84c9-4662-b635-5c8d8d8a63fd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:23.782700 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-663ab7c8-84c9-4662-b635-5c8d8d8a63fd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:23.841756 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-663ab7c8-84c9-4662-b635-5c8d8d8a63fd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:23.849464 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-663ab7c8-84c9-4662-b635-5c8d8d8a63fd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.079557 Dec 15 13:10:23.850052 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1336/2687] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:23 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:24.866894 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-12530fa6-5409-40da-86d4-c832143cf505 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:24.867512 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-12530fa6-5409-40da-86d4-c832143cf505 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:24.874553 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-12530fa6-5409-40da-86d4-c832143cf505 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:24.875007 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-12530fa6-5409-40da-86d4-c832143cf505 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:24.875790 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-12530fa6-5409-40da-86d4-c832143cf505 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:24.876232 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-12530fa6-5409-40da-86d4-c832143cf505 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:24.936357 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-12530fa6-5409-40da-86d4-c832143cf505 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:24.944232 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-12530fa6-5409-40da-86d4-c832143cf505 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081009 Dec 15 13:10:24.944831 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1352/2688] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:24 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:25.961865 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c68569d6-da4c-4015-9e18-9de087bc6ed6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:25.962462 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c68569d6-da4c-4015-9e18-9de087bc6ed6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:25.968695 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c68569d6-da4c-4015-9e18-9de087bc6ed6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:25.969141 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c68569d6-da4c-4015-9e18-9de087bc6ed6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:25.969957 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c68569d6-da4c-4015-9e18-9de087bc6ed6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:25.970396 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c68569d6-da4c-4015-9e18-9de087bc6ed6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:26.033738 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c68569d6-da4c-4015-9e18-9de087bc6ed6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:26.042660 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c68569d6-da4c-4015-9e18-9de087bc6ed6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.084533 Dec 15 13:10:26.043236 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1337/2689] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:25 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:27.059896 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2368bcf1-2423-4797-86b4-4d5c8d3233b5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:27.060507 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2368bcf1-2423-4797-86b4-4d5c8d3233b5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:27.066808 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2368bcf1-2423-4797-86b4-4d5c8d3233b5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:27.067271 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2368bcf1-2423-4797-86b4-4d5c8d3233b5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:27.068054 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2368bcf1-2423-4797-86b4-4d5c8d3233b5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:27.068495 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2368bcf1-2423-4797-86b4-4d5c8d3233b5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:27.128925 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2368bcf1-2423-4797-86b4-4d5c8d3233b5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:27.137083 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2368bcf1-2423-4797-86b4-4d5c8d3233b5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080892 Dec 15 13:10:27.137642 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1353/2690] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:27 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:28.161079 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b6bdf449-827d-42e1-a10d-5bc32fac4e43 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:28.161708 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b6bdf449-827d-42e1-a10d-5bc32fac4e43 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:28.168324 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b6bdf449-827d-42e1-a10d-5bc32fac4e43 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:28.168766 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b6bdf449-827d-42e1-a10d-5bc32fac4e43 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:28.169550 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b6bdf449-827d-42e1-a10d-5bc32fac4e43 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:28.169983 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b6bdf449-827d-42e1-a10d-5bc32fac4e43 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:28.230127 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b6bdf449-827d-42e1-a10d-5bc32fac4e43 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:28.238025 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b6bdf449-827d-42e1-a10d-5bc32fac4e43 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080481 Dec 15 13:10:28.238616 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1338/2691] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:28 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:29.255460 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-dacaec32-bf58-4f37-a839-453f2735d3c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:29.256158 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-dacaec32-bf58-4f37-a839-453f2735d3c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:29.262851 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dacaec32-bf58-4f37-a839-453f2735d3c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:29.263302 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dacaec32-bf58-4f37-a839-453f2735d3c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:29.264402 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dacaec32-bf58-4f37-a839-453f2735d3c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:29.264842 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dacaec32-bf58-4f37-a839-453f2735d3c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:29.327842 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-dacaec32-bf58-4f37-a839-453f2735d3c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:29.336289 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-dacaec32-bf58-4f37-a839-453f2735d3c7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.084440 Dec 15 13:10:29.336866 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1354/2692] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:29 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:30.353847 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e483f31f-f7f3-4273-874d-0c732468f68a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:30.354475 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e483f31f-f7f3-4273-874d-0c732468f68a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:30.360689 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e483f31f-f7f3-4273-874d-0c732468f68a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:30.361139 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e483f31f-f7f3-4273-874d-0c732468f68a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:30.361955 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e483f31f-f7f3-4273-874d-0c732468f68a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:30.362395 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e483f31f-f7f3-4273-874d-0c732468f68a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:30.425706 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e483f31f-f7f3-4273-874d-0c732468f68a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:30.434862 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e483f31f-f7f3-4273-874d-0c732468f68a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.085077 Dec 15 13:10:30.435439 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1339/2693] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:30 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:31.451415 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b93a4581-029a-4eaa-9251-691deb1f4b13 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:31.452060 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b93a4581-029a-4eaa-9251-691deb1f4b13 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:31.457993 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b93a4581-029a-4eaa-9251-691deb1f4b13 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:31.458448 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b93a4581-029a-4eaa-9251-691deb1f4b13 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:31.459227 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b93a4581-029a-4eaa-9251-691deb1f4b13 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:31.459740 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b93a4581-029a-4eaa-9251-691deb1f4b13 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:31.520670 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b93a4581-029a-4eaa-9251-691deb1f4b13 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:31.529627 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b93a4581-029a-4eaa-9251-691deb1f4b13 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081738 Dec 15 13:10:31.530210 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1355/2694] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:31 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:32.546694 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-137b1d16-ed57-4c97-80fc-ac74e100d618 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:32.547320 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-137b1d16-ed57-4c97-80fc-ac74e100d618 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:32.553615 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-137b1d16-ed57-4c97-80fc-ac74e100d618 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:32.554026 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-137b1d16-ed57-4c97-80fc-ac74e100d618 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:32.554803 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-137b1d16-ed57-4c97-80fc-ac74e100d618 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:32.555238 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-137b1d16-ed57-4c97-80fc-ac74e100d618 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:32.618209 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-137b1d16-ed57-4c97-80fc-ac74e100d618 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:32.624591 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-137b1d16-ed57-4c97-80fc-ac74e100d618 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081481 Dec 15 13:10:32.625178 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1340/2695] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:32 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:33.642725 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fbac35ac-d1c8-40fa-9f06-9635113c9bc1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:33.643329 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fbac35ac-d1c8-40fa-9f06-9635113c9bc1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:33.650551 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fbac35ac-d1c8-40fa-9f06-9635113c9bc1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:33.651011 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fbac35ac-d1c8-40fa-9f06-9635113c9bc1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:33.651805 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fbac35ac-d1c8-40fa-9f06-9635113c9bc1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:33.652247 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fbac35ac-d1c8-40fa-9f06-9635113c9bc1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:33.713720 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-fbac35ac-d1c8-40fa-9f06-9635113c9bc1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:33.721928 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fbac35ac-d1c8-40fa-9f06-9635113c9bc1 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.083011 Dec 15 13:10:33.722520 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1356/2696] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:33 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:34.739630 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a2b18501-61ee-4f8b-8892-a6eaa701351f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:34.740305 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a2b18501-61ee-4f8b-8892-a6eaa701351f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:34.747143 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a2b18501-61ee-4f8b-8892-a6eaa701351f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:34.747601 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a2b18501-61ee-4f8b-8892-a6eaa701351f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:34.748386 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a2b18501-61ee-4f8b-8892-a6eaa701351f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:34.748823 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a2b18501-61ee-4f8b-8892-a6eaa701351f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:34.809609 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a2b18501-61ee-4f8b-8892-a6eaa701351f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:34.817538 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a2b18501-61ee-4f8b-8892-a6eaa701351f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081490 Dec 15 13:10:34.818124 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1341/2697] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:34 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:35.834382 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f7c9b047-7f34-4f58-a3e8-00464c9ae9e9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:35.834985 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f7c9b047-7f34-4f58-a3e8-00464c9ae9e9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:35.841151 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f7c9b047-7f34-4f58-a3e8-00464c9ae9e9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:35.841639 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f7c9b047-7f34-4f58-a3e8-00464c9ae9e9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:35.842414 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f7c9b047-7f34-4f58-a3e8-00464c9ae9e9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:35.842847 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f7c9b047-7f34-4f58-a3e8-00464c9ae9e9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:35.906817 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f7c9b047-7f34-4f58-a3e8-00464c9ae9e9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:35.915557 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f7c9b047-7f34-4f58-a3e8-00464c9ae9e9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.084785 Dec 15 13:10:35.916148 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1357/2698] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:35 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:36.932917 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-40230c4b-6a5f-4d5c-8d46-094c30fe1669 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:36.933581 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-40230c4b-6a5f-4d5c-8d46-094c30fe1669 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:36.939925 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-40230c4b-6a5f-4d5c-8d46-094c30fe1669 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:36.940375 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-40230c4b-6a5f-4d5c-8d46-094c30fe1669 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:36.941146 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-40230c4b-6a5f-4d5c-8d46-094c30fe1669 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:36.941608 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-40230c4b-6a5f-4d5c-8d46-094c30fe1669 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:37.002084 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-40230c4b-6a5f-4d5c-8d46-094c30fe1669 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:37.013179 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-40230c4b-6a5f-4d5c-8d46-094c30fe1669 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.084342 Dec 15 13:10:37.014071 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1342/2699] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:36 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:38.029239 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a5a44c94-e6b5-4a53-8382-fe09c5c4684f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:38.029882 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a5a44c94-e6b5-4a53-8382-fe09c5c4684f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:38.036237 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a5a44c94-e6b5-4a53-8382-fe09c5c4684f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:38.036694 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a5a44c94-e6b5-4a53-8382-fe09c5c4684f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:38.037482 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a5a44c94-e6b5-4a53-8382-fe09c5c4684f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:38.038000 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a5a44c94-e6b5-4a53-8382-fe09c5c4684f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:38.098324 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a5a44c94-e6b5-4a53-8382-fe09c5c4684f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:38.106703 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a5a44c94-e6b5-4a53-8382-fe09c5c4684f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080973 Dec 15 13:10:38.107273 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1358/2700] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:38 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:39.123741 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-124ff521-11c5-4f54-81bd-99f6114fafe3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:39.124639 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-124ff521-11c5-4f54-81bd-99f6114fafe3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:39.130902 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-124ff521-11c5-4f54-81bd-99f6114fafe3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:39.131345 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-124ff521-11c5-4f54-81bd-99f6114fafe3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:39.132965 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-124ff521-11c5-4f54-81bd-99f6114fafe3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:39.133393 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-124ff521-11c5-4f54-81bd-99f6114fafe3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:39.195323 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-124ff521-11c5-4f54-81bd-99f6114fafe3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:39.203448 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-124ff521-11c5-4f54-81bd-99f6114fafe3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.083425 Dec 15 13:10:39.204048 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1343/2701] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:39 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:10:40.221679 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-92b71b48-1f61-47b0-95dd-9d61c57737bc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:40.222300 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-92b71b48-1f61-47b0-95dd-9d61c57737bc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:40.228793 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-92b71b48-1f61-47b0-95dd-9d61c57737bc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:40.229249 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-92b71b48-1f61-47b0-95dd-9d61c57737bc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:40.230064 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-92b71b48-1f61-47b0-95dd-9d61c57737bc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:40.230523 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-92b71b48-1f61-47b0-95dd-9d61c57737bc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:40.292690 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-92b71b48-1f61-47b0-95dd-9d61c57737bc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:40.300940 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-92b71b48-1f61-47b0-95dd-9d61c57737bc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082977 Dec 15 13:10:40.301791 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1359/2702] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:40 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:10:41.317983 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e9e11df9-e62c-4bb4-a402-2eb501c3b125 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:41.318595 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e9e11df9-e62c-4bb4-a402-2eb501c3b125 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:41.324963 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e9e11df9-e62c-4bb4-a402-2eb501c3b125 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:41.325407 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e9e11df9-e62c-4bb4-a402-2eb501c3b125 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:41.326204 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e9e11df9-e62c-4bb4-a402-2eb501c3b125 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:41.326640 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e9e11df9-e62c-4bb4-a402-2eb501c3b125 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:41.385331 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e9e11df9-e62c-4bb4-a402-2eb501c3b125 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:41.393835 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e9e11df9-e62c-4bb4-a402-2eb501c3b125 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.079404 Dec 15 13:10:41.394568 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1344/2703] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:41 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:42.410359 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-dc85bc47-b0cc-4110-b7a3-68db76d5df15 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:42.410954 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-dc85bc47-b0cc-4110-b7a3-68db76d5df15 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:42.417849 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dc85bc47-b0cc-4110-b7a3-68db76d5df15 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:42.418213 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dc85bc47-b0cc-4110-b7a3-68db76d5df15 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:42.418993 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dc85bc47-b0cc-4110-b7a3-68db76d5df15 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:42.419456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dc85bc47-b0cc-4110-b7a3-68db76d5df15 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:42.492003 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-dc85bc47-b0cc-4110-b7a3-68db76d5df15 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:42.502322 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-dc85bc47-b0cc-4110-b7a3-68db76d5df15 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.095176 Dec 15 13:10:42.502905 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1360/2704] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:42 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:10:43.518802 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d9f6362f-4ff1-4c4e-8ffb-5af64a896e19 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:43.519445 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d9f6362f-4ff1-4c4e-8ffb-5af64a896e19 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:43.525821 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d9f6362f-4ff1-4c4e-8ffb-5af64a896e19 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:43.528532 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d9f6362f-4ff1-4c4e-8ffb-5af64a896e19 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:43.529428 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d9f6362f-4ff1-4c4e-8ffb-5af64a896e19 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:43.529894 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d9f6362f-4ff1-4c4e-8ffb-5af64a896e19 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:43.596680 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d9f6362f-4ff1-4c4e-8ffb-5af64a896e19 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:43.604772 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d9f6362f-4ff1-4c4e-8ffb-5af64a896e19 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.089593 Dec 15 13:10:43.605346 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1345/2705] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:43 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:44.623418 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0023a2f1-ea75-4b59-b1a8-a3140abdbf52 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:44.624030 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0023a2f1-ea75-4b59-b1a8-a3140abdbf52 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:44.630689 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0023a2f1-ea75-4b59-b1a8-a3140abdbf52 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:44.631141 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0023a2f1-ea75-4b59-b1a8-a3140abdbf52 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:44.632527 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0023a2f1-ea75-4b59-b1a8-a3140abdbf52 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:44.633137 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0023a2f1-ea75-4b59-b1a8-a3140abdbf52 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:44.693884 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0023a2f1-ea75-4b59-b1a8-a3140abdbf52 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:44.703049 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0023a2f1-ea75-4b59-b1a8-a3140abdbf52 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.083424 Dec 15 13:10:44.703613 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1361/2706] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:44 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:45.722895 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8402022d-51c4-4d15-b963-4c97ee49ea8c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:45.723662 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8402022d-51c4-4d15-b963-4c97ee49ea8c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:45.730907 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8402022d-51c4-4d15-b963-4c97ee49ea8c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:45.731366 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8402022d-51c4-4d15-b963-4c97ee49ea8c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:45.732159 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8402022d-51c4-4d15-b963-4c97ee49ea8c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:45.732596 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8402022d-51c4-4d15-b963-4c97ee49ea8c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:45.793050 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8402022d-51c4-4d15-b963-4c97ee49ea8c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:45.801039 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8402022d-51c4-4d15-b963-4c97ee49ea8c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081947 Dec 15 13:10:45.801642 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1346/2707] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:45 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:10:46.817906 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5a562cf6-1889-467a-a60c-948373050cb9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:46.818520 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5a562cf6-1889-467a-a60c-948373050cb9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:46.824932 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5a562cf6-1889-467a-a60c-948373050cb9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:46.825381 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5a562cf6-1889-467a-a60c-948373050cb9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:46.826283 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5a562cf6-1889-467a-a60c-948373050cb9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:46.826643 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5a562cf6-1889-467a-a60c-948373050cb9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:46.892513 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5a562cf6-1889-467a-a60c-948373050cb9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:46.900920 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5a562cf6-1889-467a-a60c-948373050cb9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.086674 Dec 15 13:10:46.901484 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1362/2708] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:46 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:47.917531 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-14937e07-0765-4de7-a8cf-ae9e02a182de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:47.918138 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-14937e07-0765-4de7-a8cf-ae9e02a182de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:47.924356 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-14937e07-0765-4de7-a8cf-ae9e02a182de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:47.924807 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-14937e07-0765-4de7-a8cf-ae9e02a182de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:47.925609 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-14937e07-0765-4de7-a8cf-ae9e02a182de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:47.926055 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-14937e07-0765-4de7-a8cf-ae9e02a182de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:47.985809 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-14937e07-0765-4de7-a8cf-ae9e02a182de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:47.994389 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-14937e07-0765-4de7-a8cf-ae9e02a182de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080595 Dec 15 13:10:47.994959 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1347/2709] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:47 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:49.011383 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-787ec180-dd3c-4f9d-b377-a48b074872c0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:49.012017 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-787ec180-dd3c-4f9d-b377-a48b074872c0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:49.018528 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-787ec180-dd3c-4f9d-b377-a48b074872c0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:49.019010 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-787ec180-dd3c-4f9d-b377-a48b074872c0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:49.019837 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-787ec180-dd3c-4f9d-b377-a48b074872c0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:49.020274 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-787ec180-dd3c-4f9d-b377-a48b074872c0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:49.090429 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-787ec180-dd3c-4f9d-b377-a48b074872c0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:49.098083 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-787ec180-dd3c-4f9d-b377-a48b074872c0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.090349 Dec 15 13:10:49.098639 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1363/2710] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:49 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:50.114403 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-75efce1e-0903-4431-866d-3ac5fac71e3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:50.115030 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-75efce1e-0903-4431-866d-3ac5fac71e3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:50.122425 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-75efce1e-0903-4431-866d-3ac5fac71e3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:50.122885 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-75efce1e-0903-4431-866d-3ac5fac71e3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:50.123705 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-75efce1e-0903-4431-866d-3ac5fac71e3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:50.124154 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-75efce1e-0903-4431-866d-3ac5fac71e3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:50.184887 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-75efce1e-0903-4431-866d-3ac5fac71e3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:50.193010 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-75efce1e-0903-4431-866d-3ac5fac71e3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082226 Dec 15 13:10:50.193596 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1348/2711] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:50 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:51.209639 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ccf306f0-6e58-4e39-8382-49dc7e04c10c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:51.210301 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ccf306f0-6e58-4e39-8382-49dc7e04c10c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:51.216990 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ccf306f0-6e58-4e39-8382-49dc7e04c10c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:51.217437 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ccf306f0-6e58-4e39-8382-49dc7e04c10c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:51.218252 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ccf306f0-6e58-4e39-8382-49dc7e04c10c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:51.218680 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ccf306f0-6e58-4e39-8382-49dc7e04c10c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:51.278218 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ccf306f0-6e58-4e39-8382-49dc7e04c10c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:51.286303 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ccf306f0-6e58-4e39-8382-49dc7e04c10c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080303 Dec 15 13:10:51.286881 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1364/2712] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:51 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:52.303596 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-840d1e88-8e87-4c5b-a9cd-d094fa09d21c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:52.304213 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-840d1e88-8e87-4c5b-a9cd-d094fa09d21c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:52.310758 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-840d1e88-8e87-4c5b-a9cd-d094fa09d21c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:52.311246 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-840d1e88-8e87-4c5b-a9cd-d094fa09d21c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:52.312318 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-840d1e88-8e87-4c5b-a9cd-d094fa09d21c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:52.313064 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-840d1e88-8e87-4c5b-a9cd-d094fa09d21c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:52.377624 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-840d1e88-8e87-4c5b-a9cd-d094fa09d21c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:52.386146 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-840d1e88-8e87-4c5b-a9cd-d094fa09d21c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.086369 Dec 15 13:10:52.386713 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1349/2713] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:52 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:53.404054 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4c396bbb-6b0b-4196-94b1-31bf3e5327a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:53.404687 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4c396bbb-6b0b-4196-94b1-31bf3e5327a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:53.416118 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4c396bbb-6b0b-4196-94b1-31bf3e5327a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:53.416568 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4c396bbb-6b0b-4196-94b1-31bf3e5327a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:53.417359 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4c396bbb-6b0b-4196-94b1-31bf3e5327a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:53.417835 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4c396bbb-6b0b-4196-94b1-31bf3e5327a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:53.476457 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4c396bbb-6b0b-4196-94b1-31bf3e5327a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:53.484301 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4c396bbb-6b0b-4196-94b1-31bf3e5327a9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.083947 Dec 15 13:10:53.484860 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1365/2714] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:53 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:54.501550 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7b977b4c-4dec-42ca-a304-c0c178f45dd6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:54.502173 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7b977b4c-4dec-42ca-a304-c0c178f45dd6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:54.509847 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7b977b4c-4dec-42ca-a304-c0c178f45dd6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:54.510348 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7b977b4c-4dec-42ca-a304-c0c178f45dd6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:54.511207 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7b977b4c-4dec-42ca-a304-c0c178f45dd6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:54.511719 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7b977b4c-4dec-42ca-a304-c0c178f45dd6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:54.574372 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7b977b4c-4dec-42ca-a304-c0c178f45dd6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:54.582842 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7b977b4c-4dec-42ca-a304-c0c178f45dd6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.085082 Dec 15 13:10:54.583452 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1350/2715] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:54 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:55.602052 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b96cfeb8-9518-428c-a47d-daae71063608 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:55.602684 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b96cfeb8-9518-428c-a47d-daae71063608 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:55.608917 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b96cfeb8-9518-428c-a47d-daae71063608 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:55.609361 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b96cfeb8-9518-428c-a47d-daae71063608 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:55.610395 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b96cfeb8-9518-428c-a47d-daae71063608 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:55.610833 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b96cfeb8-9518-428c-a47d-daae71063608 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:55.678903 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b96cfeb8-9518-428c-a47d-daae71063608 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:55.690997 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b96cfeb8-9518-428c-a47d-daae71063608 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.093415 Dec 15 13:10:55.691574 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1366/2716] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:55 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:56.709731 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1db795fd-b2d3-42ed-8acb-e796e2587f03 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:56.710403 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1db795fd-b2d3-42ed-8acb-e796e2587f03 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:56.717062 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1db795fd-b2d3-42ed-8acb-e796e2587f03 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:56.717563 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1db795fd-b2d3-42ed-8acb-e796e2587f03 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:56.718408 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1db795fd-b2d3-42ed-8acb-e796e2587f03 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:56.718880 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1db795fd-b2d3-42ed-8acb-e796e2587f03 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:56.781970 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1db795fd-b2d3-42ed-8acb-e796e2587f03 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:56.790931 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1db795fd-b2d3-42ed-8acb-e796e2587f03 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.085203 Dec 15 13:10:56.791585 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1351/2717] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:56 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:57.808480 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-19da7a79-3297-48e0-a2c2-f96296f560b2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:57.809115 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-19da7a79-3297-48e0-a2c2-f96296f560b2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:57.815539 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-19da7a79-3297-48e0-a2c2-f96296f560b2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:57.815995 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-19da7a79-3297-48e0-a2c2-f96296f560b2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:57.816838 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-19da7a79-3297-48e0-a2c2-f96296f560b2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:57.817281 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-19da7a79-3297-48e0-a2c2-f96296f560b2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:57.879599 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-19da7a79-3297-48e0-a2c2-f96296f560b2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:57.888931 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-19da7a79-3297-48e0-a2c2-f96296f560b2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.084249 Dec 15 13:10:57.889600 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1367/2718] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:57 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:10:58.906280 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3c16033a-9129-41bf-85d7-281b1b52351b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:10:58.906941 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3c16033a-9129-41bf-85d7-281b1b52351b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:10:58.912730 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c16033a-9129-41bf-85d7-281b1b52351b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:58.913171 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c16033a-9129-41bf-85d7-281b1b52351b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:58.913968 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c16033a-9129-41bf-85d7-281b1b52351b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:10:58.915105 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c16033a-9129-41bf-85d7-281b1b52351b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:10:58.974973 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3c16033a-9129-41bf-85d7-281b1b52351b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:10:58.983845 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3c16033a-9129-41bf-85d7-281b1b52351b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081353 Dec 15 13:10:58.984427 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1352/2719] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:58 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:00.001015 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-311b0258-02a1-4908-bcaf-6e22468ab13b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:00.001663 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-311b0258-02a1-4908-bcaf-6e22468ab13b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:00.008346 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-311b0258-02a1-4908-bcaf-6e22468ab13b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:00.008346 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-311b0258-02a1-4908-bcaf-6e22468ab13b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:00.009180 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-311b0258-02a1-4908-bcaf-6e22468ab13b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:00.009649 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-311b0258-02a1-4908-bcaf-6e22468ab13b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:00.073306 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-311b0258-02a1-4908-bcaf-6e22468ab13b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:00.081293 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-311b0258-02a1-4908-bcaf-6e22468ab13b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.083842 Dec 15 13:11:00.081888 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1368/2720] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:10:59 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:01.098553 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-24e6e213-06c1-4ee4-ab31-d08705c1b229 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:01.099174 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-24e6e213-06c1-4ee4-ab31-d08705c1b229 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:01.105941 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-24e6e213-06c1-4ee4-ab31-d08705c1b229 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:01.106535 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-24e6e213-06c1-4ee4-ab31-d08705c1b229 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:01.107301 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-24e6e213-06c1-4ee4-ab31-d08705c1b229 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:01.107737 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-24e6e213-06c1-4ee4-ab31-d08705c1b229 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:01.168939 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-24e6e213-06c1-4ee4-ab31-d08705c1b229 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:01.176769 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-24e6e213-06c1-4ee4-ab31-d08705c1b229 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081942 Dec 15 13:11:01.177333 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1353/2721] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:01 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:02.194015 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1657f171-2e4c-478b-95e6-1fdef2c05956 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:02.194605 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1657f171-2e4c-478b-95e6-1fdef2c05956 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:02.201567 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1657f171-2e4c-478b-95e6-1fdef2c05956 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:02.201977 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1657f171-2e4c-478b-95e6-1fdef2c05956 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:02.202832 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1657f171-2e4c-478b-95e6-1fdef2c05956 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:02.203287 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1657f171-2e4c-478b-95e6-1fdef2c05956 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:02.267015 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1657f171-2e4c-478b-95e6-1fdef2c05956 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:02.275087 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1657f171-2e4c-478b-95e6-1fdef2c05956 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.084706 Dec 15 13:11:02.275647 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1369/2722] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:02 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:03.292623 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-eb9874b6-fcb5-4c6e-8394-f0171cc99f69 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:03.293306 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-eb9874b6-fcb5-4c6e-8394-f0171cc99f69 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:03.300316 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eb9874b6-fcb5-4c6e-8394-f0171cc99f69 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:03.300536 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eb9874b6-fcb5-4c6e-8394-f0171cc99f69 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:03.301326 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eb9874b6-fcb5-4c6e-8394-f0171cc99f69 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:03.301798 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-eb9874b6-fcb5-4c6e-8394-f0171cc99f69 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:03.362967 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-eb9874b6-fcb5-4c6e-8394-f0171cc99f69 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:03.372155 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-eb9874b6-fcb5-4c6e-8394-f0171cc99f69 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.083828 Dec 15 13:11:03.372739 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1354/2723] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:03 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:04.388334 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-309055b6-1ed2-46e0-9d07-9b7e9904cdb0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:04.389195 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-309055b6-1ed2-46e0-9d07-9b7e9904cdb0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:04.396511 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-309055b6-1ed2-46e0-9d07-9b7e9904cdb0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:04.397027 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-309055b6-1ed2-46e0-9d07-9b7e9904cdb0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:04.398473 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-309055b6-1ed2-46e0-9d07-9b7e9904cdb0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:04.398932 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-309055b6-1ed2-46e0-9d07-9b7e9904cdb0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:04.459529 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-309055b6-1ed2-46e0-9d07-9b7e9904cdb0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:04.467377 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-309055b6-1ed2-46e0-9d07-9b7e9904cdb0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082663 Dec 15 13:11:04.467939 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1370/2724] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:04 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:05.483864 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e13e3a1e-f411-4cdf-8e84-9cd3e7197214 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:05.485130 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e13e3a1e-f411-4cdf-8e84-9cd3e7197214 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:05.491634 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e13e3a1e-f411-4cdf-8e84-9cd3e7197214 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:05.492899 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e13e3a1e-f411-4cdf-8e84-9cd3e7197214 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:05.493987 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e13e3a1e-f411-4cdf-8e84-9cd3e7197214 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:05.501531 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e13e3a1e-f411-4cdf-8e84-9cd3e7197214 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:05.564027 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e13e3a1e-f411-4cdf-8e84-9cd3e7197214 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:05.572350 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e13e3a1e-f411-4cdf-8e84-9cd3e7197214 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.092101 Dec 15 13:11:05.573110 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1355/2725] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:05 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:06.590793 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c7249b0c-3f52-4286-8290-627055d81e9c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:06.591591 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c7249b0c-3f52-4286-8290-627055d81e9c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:06.599798 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c7249b0c-3f52-4286-8290-627055d81e9c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:06.600259 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c7249b0c-3f52-4286-8290-627055d81e9c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:06.601050 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c7249b0c-3f52-4286-8290-627055d81e9c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:06.601548 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c7249b0c-3f52-4286-8290-627055d81e9c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:06.661273 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c7249b0c-3f52-4286-8290-627055d81e9c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:06.670214 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c7249b0c-3f52-4286-8290-627055d81e9c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.085039 Dec 15 13:11:06.671116 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1371/2726] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:06 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:07.687003 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f3890525-37fa-4d54-b72e-f9d5e60fb3b7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:07.687606 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f3890525-37fa-4d54-b72e-f9d5e60fb3b7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:07.694472 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f3890525-37fa-4d54-b72e-f9d5e60fb3b7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:07.694916 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f3890525-37fa-4d54-b72e-f9d5e60fb3b7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:07.696451 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f3890525-37fa-4d54-b72e-f9d5e60fb3b7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:07.696882 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f3890525-37fa-4d54-b72e-f9d5e60fb3b7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:07.764354 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-f3890525-37fa-4d54-b72e-f9d5e60fb3b7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:07.772118 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f3890525-37fa-4d54-b72e-f9d5e60fb3b7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.088946 Dec 15 13:11:07.772694 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1356/2727] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:07 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:08.789194 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-aeaab635-50e9-474a-9f3d-37bfe050536a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:08.790051 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-aeaab635-50e9-474a-9f3d-37bfe050536a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:08.796360 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aeaab635-50e9-474a-9f3d-37bfe050536a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:08.796823 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aeaab635-50e9-474a-9f3d-37bfe050536a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:08.797645 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aeaab635-50e9-474a-9f3d-37bfe050536a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:08.798081 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aeaab635-50e9-474a-9f3d-37bfe050536a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:08.815977 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:11:08.816528 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 13:11:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:11:08.861486 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-aeaab635-50e9-474a-9f3d-37bfe050536a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:08.870191 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-aeaab635-50e9-474a-9f3d-37bfe050536a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.084981 Dec 15 13:11:08.870762 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1372/2728] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:08 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:09.887275 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-925041ba-27a8-45fb-8f08-a2790f48728a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:09.887908 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-925041ba-27a8-45fb-8f08-a2790f48728a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:09.894702 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-925041ba-27a8-45fb-8f08-a2790f48728a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:09.895146 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-925041ba-27a8-45fb-8f08-a2790f48728a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:09.895934 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-925041ba-27a8-45fb-8f08-a2790f48728a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:09.896368 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-925041ba-27a8-45fb-8f08-a2790f48728a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:09.956132 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-925041ba-27a8-45fb-8f08-a2790f48728a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:09.964503 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-925041ba-27a8-45fb-8f08-a2790f48728a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081027 Dec 15 13:11:09.965065 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1357/2729] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:09 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:10.981366 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f20dba3a-32ea-43cf-8f1f-0f7246563793 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:10.982083 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f20dba3a-32ea-43cf-8f1f-0f7246563793 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:10.988446 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f20dba3a-32ea-43cf-8f1f-0f7246563793 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:10.988903 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f20dba3a-32ea-43cf-8f1f-0f7246563793 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:10.989729 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f20dba3a-32ea-43cf-8f1f-0f7246563793 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:10.990178 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f20dba3a-32ea-43cf-8f1f-0f7246563793 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:11.050421 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f20dba3a-32ea-43cf-8f1f-0f7246563793 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:11.058910 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f20dba3a-32ea-43cf-8f1f-0f7246563793 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081555 Dec 15 13:11:11.059505 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1373/2730] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:10 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:12.075637 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5ae427aa-f36a-41e8-a488-b2ebb11261f3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:12.076362 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5ae427aa-f36a-41e8-a488-b2ebb11261f3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:12.082831 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ae427aa-f36a-41e8-a488-b2ebb11261f3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:12.083285 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ae427aa-f36a-41e8-a488-b2ebb11261f3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:12.084080 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ae427aa-f36a-41e8-a488-b2ebb11261f3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:12.084520 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5ae427aa-f36a-41e8-a488-b2ebb11261f3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:12.144488 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5ae427aa-f36a-41e8-a488-b2ebb11261f3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:12.153220 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5ae427aa-f36a-41e8-a488-b2ebb11261f3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081314 Dec 15 13:11:12.153818 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1358/2731] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:12 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:13.170211 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9ad70a19-7c9f-4a7a-80ee-841436e03d78 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:13.170836 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9ad70a19-7c9f-4a7a-80ee-841436e03d78 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:13.177768 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9ad70a19-7c9f-4a7a-80ee-841436e03d78 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:13.178219 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9ad70a19-7c9f-4a7a-80ee-841436e03d78 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:13.179015 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9ad70a19-7c9f-4a7a-80ee-841436e03d78 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:13.179559 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9ad70a19-7c9f-4a7a-80ee-841436e03d78 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:13.244849 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9ad70a19-7c9f-4a7a-80ee-841436e03d78 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:13.252562 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9ad70a19-7c9f-4a7a-80ee-841436e03d78 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.086198 Dec 15 13:11:13.253118 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1374/2732] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:13 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:14.270104 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c22ccdbe-2f5d-41d8-a501-ddb21a65ed37 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:14.270768 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c22ccdbe-2f5d-41d8-a501-ddb21a65ed37 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:14.277525 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c22ccdbe-2f5d-41d8-a501-ddb21a65ed37 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:14.277978 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c22ccdbe-2f5d-41d8-a501-ddb21a65ed37 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:14.278744 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c22ccdbe-2f5d-41d8-a501-ddb21a65ed37 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:14.279173 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c22ccdbe-2f5d-41d8-a501-ddb21a65ed37 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:14.341394 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c22ccdbe-2f5d-41d8-a501-ddb21a65ed37 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:14.349635 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c22ccdbe-2f5d-41d8-a501-ddb21a65ed37 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.083198 Dec 15 13:11:14.350227 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1359/2733] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:14 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:15.366874 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-baf64cd6-44bf-46d2-aecd-31ffb0e50c5c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:15.368190 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-baf64cd6-44bf-46d2-aecd-31ffb0e50c5c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:15.374399 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-baf64cd6-44bf-46d2-aecd-31ffb0e50c5c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:15.374848 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-baf64cd6-44bf-46d2-aecd-31ffb0e50c5c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:15.375619 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-baf64cd6-44bf-46d2-aecd-31ffb0e50c5c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:15.376050 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-baf64cd6-44bf-46d2-aecd-31ffb0e50c5c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:15.438256 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-baf64cd6-44bf-46d2-aecd-31ffb0e50c5c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:15.447094 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-baf64cd6-44bf-46d2-aecd-31ffb0e50c5c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.083937 Dec 15 13:11:15.447712 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1375/2734] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:15 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:16.463886 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2e1c38f8-bf27-44ed-8079-8fb5853398b8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:16.464493 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2e1c38f8-bf27-44ed-8079-8fb5853398b8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:16.470699 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2e1c38f8-bf27-44ed-8079-8fb5853398b8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:16.471158 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2e1c38f8-bf27-44ed-8079-8fb5853398b8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:16.471937 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2e1c38f8-bf27-44ed-8079-8fb5853398b8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:16.472373 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2e1c38f8-bf27-44ed-8079-8fb5853398b8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:16.534022 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2e1c38f8-bf27-44ed-8079-8fb5853398b8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:16.541984 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2e1c38f8-bf27-44ed-8079-8fb5853398b8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081959 Dec 15 13:11:16.542558 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1360/2735] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:16 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:17.559398 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-886668dc-35e7-4889-9e10-db476655f941 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:17.559990 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-886668dc-35e7-4889-9e10-db476655f941 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:17.566182 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-886668dc-35e7-4889-9e10-db476655f941 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:17.566631 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-886668dc-35e7-4889-9e10-db476655f941 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:17.567395 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-886668dc-35e7-4889-9e10-db476655f941 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:17.567827 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-886668dc-35e7-4889-9e10-db476655f941 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:17.627133 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-886668dc-35e7-4889-9e10-db476655f941 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:17.635721 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-886668dc-35e7-4889-9e10-db476655f941 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080277 Dec 15 13:11:17.636286 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1376/2736] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:17 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:18.541452 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:11:18.541810 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 13:11:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:11:18.652989 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-07cfe7d2-c580-4354-bf37-4aa60a32de16 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:18.653637 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-07cfe7d2-c580-4354-bf37-4aa60a32de16 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:18.659990 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-07cfe7d2-c580-4354-bf37-4aa60a32de16 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:18.660438 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-07cfe7d2-c580-4354-bf37-4aa60a32de16 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:18.661230 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-07cfe7d2-c580-4354-bf37-4aa60a32de16 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:18.661704 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-07cfe7d2-c580-4354-bf37-4aa60a32de16 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:18.725136 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-07cfe7d2-c580-4354-bf37-4aa60a32de16 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:18.734109 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-07cfe7d2-c580-4354-bf37-4aa60a32de16 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.085314 Dec 15 13:11:18.734671 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1361/2737] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:18 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:19.750731 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a8db1ef7-beb0-4aa2-8ccf-f8b48505c1fd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:19.751338 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a8db1ef7-beb0-4aa2-8ccf-f8b48505c1fd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:19.757614 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a8db1ef7-beb0-4aa2-8ccf-f8b48505c1fd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:19.758068 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a8db1ef7-beb0-4aa2-8ccf-f8b48505c1fd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:19.758840 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a8db1ef7-beb0-4aa2-8ccf-f8b48505c1fd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:19.759282 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a8db1ef7-beb0-4aa2-8ccf-f8b48505c1fd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:19.821785 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a8db1ef7-beb0-4aa2-8ccf-f8b48505c1fd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:19.829611 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a8db1ef7-beb0-4aa2-8ccf-f8b48505c1fd tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082529 Dec 15 13:11:19.830192 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1377/2738] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:19 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:20.846299 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-96f1a594-022a-4ce6-b5c9-749e511005ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:20.846931 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-96f1a594-022a-4ce6-b5c9-749e511005ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:20.853658 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-96f1a594-022a-4ce6-b5c9-749e511005ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:20.854190 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-96f1a594-022a-4ce6-b5c9-749e511005ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:20.854972 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-96f1a594-022a-4ce6-b5c9-749e511005ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:20.855405 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-96f1a594-022a-4ce6-b5c9-749e511005ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:20.914323 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-96f1a594-022a-4ce6-b5c9-749e511005ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:20.922350 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-96f1a594-022a-4ce6-b5c9-749e511005ae tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.079688 Dec 15 13:11:20.922912 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1362/2739] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:20 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:21.939924 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f7b7671e-714e-4fd8-b1e4-76f356c0b531 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:21.940531 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f7b7671e-714e-4fd8-b1e4-76f356c0b531 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:21.946886 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f7b7671e-714e-4fd8-b1e4-76f356c0b531 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:21.947420 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f7b7671e-714e-4fd8-b1e4-76f356c0b531 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:21.948213 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f7b7671e-714e-4fd8-b1e4-76f356c0b531 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:21.948656 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f7b7671e-714e-4fd8-b1e4-76f356c0b531 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:22.010794 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f7b7671e-714e-4fd8-b1e4-76f356c0b531 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:22.018789 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f7b7671e-714e-4fd8-b1e4-76f356c0b531 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082550 Dec 15 13:11:22.019340 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1378/2740] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:21 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:23.035535 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c77ecb13-6028-4806-bba3-1f41a1d789fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:23.036133 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c77ecb13-6028-4806-bba3-1f41a1d789fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:23.042823 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c77ecb13-6028-4806-bba3-1f41a1d789fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:23.043584 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c77ecb13-6028-4806-bba3-1f41a1d789fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:23.044854 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c77ecb13-6028-4806-bba3-1f41a1d789fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:23.045576 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c77ecb13-6028-4806-bba3-1f41a1d789fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:23.106473 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c77ecb13-6028-4806-bba3-1f41a1d789fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:23.114159 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c77ecb13-6028-4806-bba3-1f41a1d789fc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082285 Dec 15 13:11:23.114716 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1363/2741] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:23 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:24.140204 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8183ee8e-13e4-4aec-b9a7-d8eff20e8476 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:24.140807 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8183ee8e-13e4-4aec-b9a7-d8eff20e8476 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:24.147009 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8183ee8e-13e4-4aec-b9a7-d8eff20e8476 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:24.147456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8183ee8e-13e4-4aec-b9a7-d8eff20e8476 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:24.148233 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8183ee8e-13e4-4aec-b9a7-d8eff20e8476 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:24.148667 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8183ee8e-13e4-4aec-b9a7-d8eff20e8476 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:24.207849 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-8183ee8e-13e4-4aec-b9a7-d8eff20e8476 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:24.215707 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8183ee8e-13e4-4aec-b9a7-d8eff20e8476 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.079465 Dec 15 13:11:24.216257 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1379/2742] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:24 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:24.275196 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:11:24.275486 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 13:11:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:11:25.238417 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5e2fe1e4-1e68-415f-9691-e037d0437b29 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:25.239057 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5e2fe1e4-1e68-415f-9691-e037d0437b29 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:25.245328 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5e2fe1e4-1e68-415f-9691-e037d0437b29 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:25.245815 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5e2fe1e4-1e68-415f-9691-e037d0437b29 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:25.246591 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5e2fe1e4-1e68-415f-9691-e037d0437b29 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:25.247031 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5e2fe1e4-1e68-415f-9691-e037d0437b29 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:25.306439 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5e2fe1e4-1e68-415f-9691-e037d0437b29 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:25.314734 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5e2fe1e4-1e68-415f-9691-e037d0437b29 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080037 Dec 15 13:11:25.315292 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1364/2743] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:25 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:26.332320 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7c58ad31-19a6-487d-9968-b7340da13fb2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:26.332913 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7c58ad31-19a6-487d-9968-b7340da13fb2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:26.339732 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7c58ad31-19a6-487d-9968-b7340da13fb2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:26.340220 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7c58ad31-19a6-487d-9968-b7340da13fb2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:26.341003 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7c58ad31-19a6-487d-9968-b7340da13fb2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:26.341447 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7c58ad31-19a6-487d-9968-b7340da13fb2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:26.401059 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7c58ad31-19a6-487d-9968-b7340da13fb2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:26.409325 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7c58ad31-19a6-487d-9968-b7340da13fb2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080597 Dec 15 13:11:26.409954 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1380/2744] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:26 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:27.427926 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-dd1fe4e6-d391-4eb6-b7b2-3dc60efa8207 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:27.428535 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-dd1fe4e6-d391-4eb6-b7b2-3dc60efa8207 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:27.434431 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dd1fe4e6-d391-4eb6-b7b2-3dc60efa8207 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:27.434887 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dd1fe4e6-d391-4eb6-b7b2-3dc60efa8207 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:27.435661 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dd1fe4e6-d391-4eb6-b7b2-3dc60efa8207 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:27.436100 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dd1fe4e6-d391-4eb6-b7b2-3dc60efa8207 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:27.502159 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-dd1fe4e6-d391-4eb6-b7b2-3dc60efa8207 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:27.510562 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-dd1fe4e6-d391-4eb6-b7b2-3dc60efa8207 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.086448 Dec 15 13:11:27.511121 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1365/2745] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:27 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:28.527607 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e30d3f7b-981b-4271-a693-285cbd457374 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:28.528258 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e30d3f7b-981b-4271-a693-285cbd457374 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:28.534462 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e30d3f7b-981b-4271-a693-285cbd457374 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:28.534917 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e30d3f7b-981b-4271-a693-285cbd457374 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:28.535694 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e30d3f7b-981b-4271-a693-285cbd457374 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:28.536132 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e30d3f7b-981b-4271-a693-285cbd457374 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:28.598669 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e30d3f7b-981b-4271-a693-285cbd457374 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:28.613435 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e30d3f7b-981b-4271-a693-285cbd457374 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082615 Dec 15 13:11:28.614116 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1381/2746] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:28 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:29.631098 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3445b892-792a-4327-8be7-fd9b9d47246b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:29.631717 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3445b892-792a-4327-8be7-fd9b9d47246b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:29.641946 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3445b892-792a-4327-8be7-fd9b9d47246b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:29.642396 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3445b892-792a-4327-8be7-fd9b9d47246b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:29.643194 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3445b892-792a-4327-8be7-fd9b9d47246b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:29.643630 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3445b892-792a-4327-8be7-fd9b9d47246b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:29.933221 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3445b892-792a-4327-8be7-fd9b9d47246b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:29.941067 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3445b892-792a-4327-8be7-fd9b9d47246b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.313739 Dec 15 13:11:29.941654 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1366/2747] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:29 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:30.958710 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0f69cdee-7898-4b0d-ba7e-8c1755305e3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:30.959318 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0f69cdee-7898-4b0d-ba7e-8c1755305e3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:30.966122 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0f69cdee-7898-4b0d-ba7e-8c1755305e3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:30.966579 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0f69cdee-7898-4b0d-ba7e-8c1755305e3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:30.967380 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0f69cdee-7898-4b0d-ba7e-8c1755305e3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:30.967827 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0f69cdee-7898-4b0d-ba7e-8c1755305e3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:31.027088 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0f69cdee-7898-4b0d-ba7e-8c1755305e3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:31.034884 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0f69cdee-7898-4b0d-ba7e-8c1755305e3a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080202 Dec 15 13:11:31.035454 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1382/2748] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:30 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:32.059603 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-86876f6d-4435-47c5-bdcb-cda070cc47f7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:32.060233 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-86876f6d-4435-47c5-bdcb-cda070cc47f7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:32.066640 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-86876f6d-4435-47c5-bdcb-cda070cc47f7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:32.067100 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-86876f6d-4435-47c5-bdcb-cda070cc47f7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:32.067899 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-86876f6d-4435-47c5-bdcb-cda070cc47f7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:32.068339 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-86876f6d-4435-47c5-bdcb-cda070cc47f7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:32.127554 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-86876f6d-4435-47c5-bdcb-cda070cc47f7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:32.136197 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-86876f6d-4435-47c5-bdcb-cda070cc47f7 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.087808 Dec 15 13:11:32.136772 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1367/2749] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:32 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:33.153709 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d6d64262-21f8-4291-8c0e-325b41f7d490 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:33.154318 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d6d64262-21f8-4291-8c0e-325b41f7d490 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:33.160465 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d6d64262-21f8-4291-8c0e-325b41f7d490 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:33.160911 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d6d64262-21f8-4291-8c0e-325b41f7d490 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:33.161713 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d6d64262-21f8-4291-8c0e-325b41f7d490 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:33.162150 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d6d64262-21f8-4291-8c0e-325b41f7d490 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:33.230258 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d6d64262-21f8-4291-8c0e-325b41f7d490 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:33.238125 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d6d64262-21f8-4291-8c0e-325b41f7d490 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.088796 Dec 15 13:11:33.238690 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1383/2750] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:33 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:34.254969 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-17ae0025-331e-483f-9439-f59fcf479446 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:34.255587 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-17ae0025-331e-483f-9439-f59fcf479446 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:34.261913 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-17ae0025-331e-483f-9439-f59fcf479446 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:34.262370 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-17ae0025-331e-483f-9439-f59fcf479446 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:34.263156 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-17ae0025-331e-483f-9439-f59fcf479446 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:34.263624 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-17ae0025-331e-483f-9439-f59fcf479446 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:34.324188 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-17ae0025-331e-483f-9439-f59fcf479446 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:34.332031 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-17ae0025-331e-483f-9439-f59fcf479446 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080797 Dec 15 13:11:34.332600 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1368/2751] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:34 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:35.349115 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d356748f-d6d7-45f1-a0af-a7238a560061 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:35.349752 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d356748f-d6d7-45f1-a0af-a7238a560061 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:35.358050 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d356748f-d6d7-45f1-a0af-a7238a560061 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:35.358855 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d356748f-d6d7-45f1-a0af-a7238a560061 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:35.360253 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d356748f-d6d7-45f1-a0af-a7238a560061 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:35.361056 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d356748f-d6d7-45f1-a0af-a7238a560061 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:35.424817 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d356748f-d6d7-45f1-a0af-a7238a560061 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:35.433221 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d356748f-d6d7-45f1-a0af-a7238a560061 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.087773 Dec 15 13:11:35.433808 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1384/2752] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:35 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:36.450618 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b3e11264-077c-4a7a-8911-62c8f5324823 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:36.451232 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b3e11264-077c-4a7a-8911-62c8f5324823 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:36.457724 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b3e11264-077c-4a7a-8911-62c8f5324823 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:36.458183 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b3e11264-077c-4a7a-8911-62c8f5324823 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:36.458965 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b3e11264-077c-4a7a-8911-62c8f5324823 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:36.459426 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b3e11264-077c-4a7a-8911-62c8f5324823 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:36.519757 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b3e11264-077c-4a7a-8911-62c8f5324823 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:36.527982 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b3e11264-077c-4a7a-8911-62c8f5324823 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081614 Dec 15 13:11:36.528545 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1369/2753] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:36 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:37.544237 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fb7861b5-4e4a-4183-a29f-4dd73dffe526 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:37.545451 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fb7861b5-4e4a-4183-a29f-4dd73dffe526 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:37.551804 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fb7861b5-4e4a-4183-a29f-4dd73dffe526 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:37.552204 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fb7861b5-4e4a-4183-a29f-4dd73dffe526 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:37.552987 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fb7861b5-4e4a-4183-a29f-4dd73dffe526 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:37.553427 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fb7861b5-4e4a-4183-a29f-4dd73dffe526 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:37.619812 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-fb7861b5-4e4a-4183-a29f-4dd73dffe526 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:37.627625 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fb7861b5-4e4a-4183-a29f-4dd73dffe526 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.087046 Dec 15 13:11:37.628196 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1385/2754] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:37 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:38.644873 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1a057f9b-2e28-4cdf-acea-c0e0d4964ddc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:38.645541 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1a057f9b-2e28-4cdf-acea-c0e0d4964ddc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:38.652862 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1a057f9b-2e28-4cdf-acea-c0e0d4964ddc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:38.653309 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1a057f9b-2e28-4cdf-acea-c0e0d4964ddc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:38.654127 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1a057f9b-2e28-4cdf-acea-c0e0d4964ddc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:38.654579 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1a057f9b-2e28-4cdf-acea-c0e0d4964ddc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:38.717933 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1a057f9b-2e28-4cdf-acea-c0e0d4964ddc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:38.725878 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1a057f9b-2e28-4cdf-acea-c0e0d4964ddc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.084637 Dec 15 13:11:38.726501 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1370/2755] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:38 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:39.749567 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9b40d978-27b2-424b-8578-bc3c78d94dad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:39.750176 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9b40d978-27b2-424b-8578-bc3c78d94dad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:39.756427 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9b40d978-27b2-424b-8578-bc3c78d94dad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:39.756882 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9b40d978-27b2-424b-8578-bc3c78d94dad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:39.757695 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9b40d978-27b2-424b-8578-bc3c78d94dad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:39.758136 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9b40d978-27b2-424b-8578-bc3c78d94dad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:39.827605 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9b40d978-27b2-424b-8578-bc3c78d94dad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:39.838134 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9b40d978-27b2-424b-8578-bc3c78d94dad tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.091598 Dec 15 13:11:39.838752 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1386/2756] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:39 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:40.855611 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e8a8f88e-867b-425a-9789-934a65581d31 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:40.856284 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e8a8f88e-867b-425a-9789-934a65581d31 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:40.862568 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e8a8f88e-867b-425a-9789-934a65581d31 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:40.863015 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e8a8f88e-867b-425a-9789-934a65581d31 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:40.863804 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e8a8f88e-867b-425a-9789-934a65581d31 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:40.864240 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e8a8f88e-867b-425a-9789-934a65581d31 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:40.925258 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e8a8f88e-867b-425a-9789-934a65581d31 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:40.933886 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e8a8f88e-867b-425a-9789-934a65581d31 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082876 Dec 15 13:11:40.934452 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1371/2757] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:40 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:41.950639 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-247cb53b-c0a3-4063-8b07-0b78fe2db226 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:41.951268 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-247cb53b-c0a3-4063-8b07-0b78fe2db226 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:41.957747 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-247cb53b-c0a3-4063-8b07-0b78fe2db226 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:41.958204 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-247cb53b-c0a3-4063-8b07-0b78fe2db226 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:41.958980 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-247cb53b-c0a3-4063-8b07-0b78fe2db226 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:41.959422 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-247cb53b-c0a3-4063-8b07-0b78fe2db226 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:42.023045 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-247cb53b-c0a3-4063-8b07-0b78fe2db226 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:42.031855 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-247cb53b-c0a3-4063-8b07-0b78fe2db226 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.084984 Dec 15 13:11:42.032438 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1387/2758] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:41 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:43.049649 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-487c44a3-7fe0-41ae-94ad-203b6750fdd5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:43.050255 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-487c44a3-7fe0-41ae-94ad-203b6750fdd5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:43.057308 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-487c44a3-7fe0-41ae-94ad-203b6750fdd5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:43.057785 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-487c44a3-7fe0-41ae-94ad-203b6750fdd5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:43.058723 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-487c44a3-7fe0-41ae-94ad-203b6750fdd5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:43.059175 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-487c44a3-7fe0-41ae-94ad-203b6750fdd5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:43.126293 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-487c44a3-7fe0-41ae-94ad-203b6750fdd5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:43.134124 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-487c44a3-7fe0-41ae-94ad-203b6750fdd5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.088226 Dec 15 13:11:43.135130 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1372/2759] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:43 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:44.151495 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c935e8d6-d3a9-4c96-8525-28cc760032e2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:44.152119 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c935e8d6-d3a9-4c96-8525-28cc760032e2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:44.158922 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c935e8d6-d3a9-4c96-8525-28cc760032e2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:44.159363 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c935e8d6-d3a9-4c96-8525-28cc760032e2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:44.160148 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c935e8d6-d3a9-4c96-8525-28cc760032e2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:44.160576 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c935e8d6-d3a9-4c96-8525-28cc760032e2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:44.219988 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c935e8d6-d3a9-4c96-8525-28cc760032e2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:44.227812 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c935e8d6-d3a9-4c96-8525-28cc760032e2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080168 Dec 15 13:11:44.228377 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1388/2760] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:44 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:45.244813 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a60f8be7-953c-4edc-9894-345d059cdd50 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:45.245454 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a60f8be7-953c-4edc-9894-345d059cdd50 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:45.252332 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a60f8be7-953c-4edc-9894-345d059cdd50 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:45.252779 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a60f8be7-953c-4edc-9894-345d059cdd50 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:45.253598 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a60f8be7-953c-4edc-9894-345d059cdd50 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:45.254036 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a60f8be7-953c-4edc-9894-345d059cdd50 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:45.317024 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a60f8be7-953c-4edc-9894-345d059cdd50 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:45.325487 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a60f8be7-953c-4edc-9894-345d059cdd50 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.084700 Dec 15 13:11:45.326079 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1373/2761] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:45 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:46.343400 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f285a76f-d545-43d7-b542-503698cec5e2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:46.344053 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f285a76f-d545-43d7-b542-503698cec5e2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:46.350488 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f285a76f-d545-43d7-b542-503698cec5e2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:46.350938 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f285a76f-d545-43d7-b542-503698cec5e2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:46.351721 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f285a76f-d545-43d7-b542-503698cec5e2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:46.352160 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f285a76f-d545-43d7-b542-503698cec5e2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:46.411338 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f285a76f-d545-43d7-b542-503698cec5e2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:46.420052 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f285a76f-d545-43d7-b542-503698cec5e2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080782 Dec 15 13:11:46.420478 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1389/2762] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:46 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:47.436426 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0ec259d8-ee99-49c9-a487-8e73c193dbd9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:47.437090 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0ec259d8-ee99-49c9-a487-8e73c193dbd9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:47.443441 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0ec259d8-ee99-49c9-a487-8e73c193dbd9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:47.443902 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0ec259d8-ee99-49c9-a487-8e73c193dbd9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:47.444690 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0ec259d8-ee99-49c9-a487-8e73c193dbd9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:47.445125 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0ec259d8-ee99-49c9-a487-8e73c193dbd9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:47.504434 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0ec259d8-ee99-49c9-a487-8e73c193dbd9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:47.512809 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0ec259d8-ee99-49c9-a487-8e73c193dbd9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080146 Dec 15 13:11:47.513374 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1374/2763] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:47 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:11:48.529482 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2f435baf-cb28-4faf-9125-5bccc7abd22a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:48.530228 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2f435baf-cb28-4faf-9125-5bccc7abd22a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:48.536514 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2f435baf-cb28-4faf-9125-5bccc7abd22a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:48.536971 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2f435baf-cb28-4faf-9125-5bccc7abd22a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:48.537794 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2f435baf-cb28-4faf-9125-5bccc7abd22a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:48.538240 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2f435baf-cb28-4faf-9125-5bccc7abd22a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:48.600105 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2f435baf-cb28-4faf-9125-5bccc7abd22a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:48.608167 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2f435baf-cb28-4faf-9125-5bccc7abd22a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.083054 Dec 15 13:11:48.608726 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1390/2764] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:48 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:49.624999 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c7ca3e27-3a1e-47a7-a6b0-61afb65ee56d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:49.625635 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c7ca3e27-3a1e-47a7-a6b0-61afb65ee56d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:49.631761 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c7ca3e27-3a1e-47a7-a6b0-61afb65ee56d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:49.632219 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c7ca3e27-3a1e-47a7-a6b0-61afb65ee56d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:49.632993 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c7ca3e27-3a1e-47a7-a6b0-61afb65ee56d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:49.633430 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c7ca3e27-3a1e-47a7-a6b0-61afb65ee56d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:49.694388 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c7ca3e27-3a1e-47a7-a6b0-61afb65ee56d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:49.702941 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c7ca3e27-3a1e-47a7-a6b0-61afb65ee56d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081710 Dec 15 13:11:49.703626 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1375/2765] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:49 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:50.720790 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b67801f1-cc37-4b63-9f98-23303dd941e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:50.721414 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b67801f1-cc37-4b63-9f98-23303dd941e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:50.728887 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b67801f1-cc37-4b63-9f98-23303dd941e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:50.729624 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b67801f1-cc37-4b63-9f98-23303dd941e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:50.731611 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b67801f1-cc37-4b63-9f98-23303dd941e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:50.732109 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b67801f1-cc37-4b63-9f98-23303dd941e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:50.791560 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b67801f1-cc37-4b63-9f98-23303dd941e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:50.799930 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b67801f1-cc37-4b63-9f98-23303dd941e4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082796 Dec 15 13:11:50.800465 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1391/2766] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:50 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:51.816229 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6e9decad-cabb-4e14-89d8-9abfd160ebfb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:51.816834 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6e9decad-cabb-4e14-89d8-9abfd160ebfb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:51.823031 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6e9decad-cabb-4e14-89d8-9abfd160ebfb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:51.823473 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6e9decad-cabb-4e14-89d8-9abfd160ebfb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:51.824851 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6e9decad-cabb-4e14-89d8-9abfd160ebfb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:51.825280 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6e9decad-cabb-4e14-89d8-9abfd160ebfb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:51.886618 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6e9decad-cabb-4e14-89d8-9abfd160ebfb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:51.894729 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6e9decad-cabb-4e14-89d8-9abfd160ebfb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082137 Dec 15 13:11:51.895280 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1376/2767] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:51 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:52.910892 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d57c8163-4630-468b-b127-92e4bd7c9b6c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:52.911551 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d57c8163-4630-468b-b127-92e4bd7c9b6c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:52.918060 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d57c8163-4630-468b-b127-92e4bd7c9b6c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:52.918358 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d57c8163-4630-468b-b127-92e4bd7c9b6c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:52.919250 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d57c8163-4630-468b-b127-92e4bd7c9b6c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:52.919686 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d57c8163-4630-468b-b127-92e4bd7c9b6c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:52.978754 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-d57c8163-4630-468b-b127-92e4bd7c9b6c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:52.986645 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d57c8163-4630-468b-b127-92e4bd7c9b6c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.079471 Dec 15 13:11:52.987199 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1392/2768] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:52 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:54.002955 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-839cc25e-bfcb-4020-bbd4-f7e669fff7d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:54.003591 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-839cc25e-bfcb-4020-bbd4-f7e669fff7d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:54.009936 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-839cc25e-bfcb-4020-bbd4-f7e669fff7d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:54.010441 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-839cc25e-bfcb-4020-bbd4-f7e669fff7d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:54.011258 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-839cc25e-bfcb-4020-bbd4-f7e669fff7d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:54.012260 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-839cc25e-bfcb-4020-bbd4-f7e669fff7d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:54.070881 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-839cc25e-bfcb-4020-bbd4-f7e669fff7d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:54.079432 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-839cc25e-bfcb-4020-bbd4-f7e669fff7d0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080336 Dec 15 13:11:54.079996 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1377/2769] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:53 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:55.096671 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6a903310-8361-4ea2-a189-5451ee9db468 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:55.097290 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6a903310-8361-4ea2-a189-5451ee9db468 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:55.103572 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6a903310-8361-4ea2-a189-5451ee9db468 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:55.104021 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6a903310-8361-4ea2-a189-5451ee9db468 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:55.104791 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6a903310-8361-4ea2-a189-5451ee9db468 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:55.105224 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6a903310-8361-4ea2-a189-5451ee9db468 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:55.167812 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6a903310-8361-4ea2-a189-5451ee9db468 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:55.175717 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6a903310-8361-4ea2-a189-5451ee9db468 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082750 Dec 15 13:11:55.176276 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1393/2770] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:55 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:11:56.192451 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c37cb0f3-cb71-45ed-b612-3ac3be4c3d7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:56.193076 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c37cb0f3-cb71-45ed-b612-3ac3be4c3d7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:56.200013 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c37cb0f3-cb71-45ed-b612-3ac3be4c3d7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:56.200482 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c37cb0f3-cb71-45ed-b612-3ac3be4c3d7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:56.201260 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c37cb0f3-cb71-45ed-b612-3ac3be4c3d7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:56.201733 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c37cb0f3-cb71-45ed-b612-3ac3be4c3d7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:56.262195 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c37cb0f3-cb71-45ed-b612-3ac3be4c3d7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:56.270337 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c37cb0f3-cb71-45ed-b612-3ac3be4c3d7b tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081526 Dec 15 13:11:56.270903 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1378/2771] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:56 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:57.287421 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-baffd773-54c4-42a2-88a2-a5a187bf238a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:57.288032 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-baffd773-54c4-42a2-88a2-a5a187bf238a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:57.295735 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-baffd773-54c4-42a2-88a2-a5a187bf238a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:57.296178 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-baffd773-54c4-42a2-88a2-a5a187bf238a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:57.296970 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-baffd773-54c4-42a2-88a2-a5a187bf238a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:57.297408 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-baffd773-54c4-42a2-88a2-a5a187bf238a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:57.357187 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-baffd773-54c4-42a2-88a2-a5a187bf238a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:57.364892 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-baffd773-54c4-42a2-88a2-a5a187bf238a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081145 Dec 15 13:11:57.365445 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1394/2772] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:57 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:58.382600 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3e43adbb-90d1-41d3-ae54-cb748c623c6e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:58.383212 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3e43adbb-90d1-41d3-ae54-cb748c623c6e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:58.390049 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3e43adbb-90d1-41d3-ae54-cb748c623c6e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:58.390500 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3e43adbb-90d1-41d3-ae54-cb748c623c6e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:58.391274 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3e43adbb-90d1-41d3-ae54-cb748c623c6e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:58.391707 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3e43adbb-90d1-41d3-ae54-cb748c623c6e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:58.450981 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3e43adbb-90d1-41d3-ae54-cb748c623c6e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:58.459030 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3e43adbb-90d1-41d3-ae54-cb748c623c6e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080208 Dec 15 13:11:58.459608 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1379/2773] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:58 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:11:59.476029 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e859b04a-a2d5-474e-a3a5-b542eac10bee tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:11:59.476658 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e859b04a-a2d5-474e-a3a5-b542eac10bee tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:11:59.482930 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e859b04a-a2d5-474e-a3a5-b542eac10bee tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:59.483388 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e859b04a-a2d5-474e-a3a5-b542eac10bee tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:59.484174 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e859b04a-a2d5-474e-a3a5-b542eac10bee tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:11:59.484613 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e859b04a-a2d5-474e-a3a5-b542eac10bee tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:11:59.543428 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e859b04a-a2d5-474e-a3a5-b542eac10bee tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:11:59.551476 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e859b04a-a2d5-474e-a3a5-b542eac10bee tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.079072 Dec 15 13:11:59.552089 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1395/2774] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:11:59 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:00.568365 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0f55215c-a2b2-4243-acf7-6712adcc5faa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:00.568976 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0f55215c-a2b2-4243-acf7-6712adcc5faa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:00.575901 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0f55215c-a2b2-4243-acf7-6712adcc5faa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:00.576354 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0f55215c-a2b2-4243-acf7-6712adcc5faa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:00.577135 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0f55215c-a2b2-4243-acf7-6712adcc5faa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:00.577602 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0f55215c-a2b2-4243-acf7-6712adcc5faa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:00.638536 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0f55215c-a2b2-4243-acf7-6712adcc5faa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:00.647452 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0f55215c-a2b2-4243-acf7-6712adcc5faa tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082924 Dec 15 13:12:00.648023 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1380/2775] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:00 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:01.664734 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e26adc9f-532a-48f2-9c6e-ab5dac3af806 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:01.665332 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e26adc9f-532a-48f2-9c6e-ab5dac3af806 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:01.671403 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e26adc9f-532a-48f2-9c6e-ab5dac3af806 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:01.671856 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e26adc9f-532a-48f2-9c6e-ab5dac3af806 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:01.672656 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e26adc9f-532a-48f2-9c6e-ab5dac3af806 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:01.673088 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e26adc9f-532a-48f2-9c6e-ab5dac3af806 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:01.736625 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e26adc9f-532a-48f2-9c6e-ab5dac3af806 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:01.744437 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e26adc9f-532a-48f2-9c6e-ab5dac3af806 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.083538 Dec 15 13:12:01.744989 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1396/2776] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:01 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:02.762107 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a8ef9a35-cb2f-4e45-be11-2b1e01c5520f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:02.762728 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a8ef9a35-cb2f-4e45-be11-2b1e01c5520f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:02.769200 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a8ef9a35-cb2f-4e45-be11-2b1e01c5520f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:02.769683 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a8ef9a35-cb2f-4e45-be11-2b1e01c5520f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:02.770466 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a8ef9a35-cb2f-4e45-be11-2b1e01c5520f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:02.770902 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a8ef9a35-cb2f-4e45-be11-2b1e01c5520f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:02.836674 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a8ef9a35-cb2f-4e45-be11-2b1e01c5520f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:02.845145 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a8ef9a35-cb2f-4e45-be11-2b1e01c5520f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.087241 Dec 15 13:12:02.845775 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1381/2777] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:02 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:12:03.861985 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-08d2b5c7-9757-4703-a0ee-d9a306b9b076 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:03.862616 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-08d2b5c7-9757-4703-a0ee-d9a306b9b076 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:03.868801 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-08d2b5c7-9757-4703-a0ee-d9a306b9b076 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:03.869253 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-08d2b5c7-9757-4703-a0ee-d9a306b9b076 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:03.870073 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-08d2b5c7-9757-4703-a0ee-d9a306b9b076 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:03.870558 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-08d2b5c7-9757-4703-a0ee-d9a306b9b076 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:03.931869 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-08d2b5c7-9757-4703-a0ee-d9a306b9b076 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:03.940106 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-08d2b5c7-9757-4703-a0ee-d9a306b9b076 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081682 Dec 15 13:12:03.940672 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1397/2778] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:03 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:04.957711 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3aea903a-b8c6-4030-bb68-737482a6ba66 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:04.958338 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3aea903a-b8c6-4030-bb68-737482a6ba66 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:04.965218 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3aea903a-b8c6-4030-bb68-737482a6ba66 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:04.965693 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3aea903a-b8c6-4030-bb68-737482a6ba66 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:04.966482 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3aea903a-b8c6-4030-bb68-737482a6ba66 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:04.966919 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3aea903a-b8c6-4030-bb68-737482a6ba66 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:05.040228 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3aea903a-b8c6-4030-bb68-737482a6ba66 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:05.049050 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3aea903a-b8c6-4030-bb68-737482a6ba66 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.094968 Dec 15 13:12:05.049696 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1382/2779] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:04 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:06.065937 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-aa9f03a4-5048-47d3-ad66-c7f0801ae430 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:06.066626 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-aa9f03a4-5048-47d3-ad66-c7f0801ae430 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:06.073296 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa9f03a4-5048-47d3-ad66-c7f0801ae430 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:06.073977 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa9f03a4-5048-47d3-ad66-c7f0801ae430 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:06.075062 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa9f03a4-5048-47d3-ad66-c7f0801ae430 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:06.075515 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa9f03a4-5048-47d3-ad66-c7f0801ae430 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:06.135054 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-aa9f03a4-5048-47d3-ad66-c7f0801ae430 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:06.143628 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-aa9f03a4-5048-47d3-ad66-c7f0801ae430 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081372 Dec 15 13:12:06.144183 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1398/2780] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:06 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:07.159977 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-67eea065-c35c-4687-b103-05fdde4a8767 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:07.160602 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-67eea065-c35c-4687-b103-05fdde4a8767 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:07.167948 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-67eea065-c35c-4687-b103-05fdde4a8767 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:07.168347 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-67eea065-c35c-4687-b103-05fdde4a8767 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:07.169173 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-67eea065-c35c-4687-b103-05fdde4a8767 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:07.169742 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-67eea065-c35c-4687-b103-05fdde4a8767 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:07.237459 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-67eea065-c35c-4687-b103-05fdde4a8767 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:07.245227 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-67eea065-c35c-4687-b103-05fdde4a8767 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.089023 Dec 15 13:12:07.245874 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1383/2781] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:07 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:08.263064 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4073497c-4e29-410b-af04-08ee6777efe2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:08.263709 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4073497c-4e29-410b-af04-08ee6777efe2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:08.270350 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4073497c-4e29-410b-af04-08ee6777efe2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:08.270805 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4073497c-4e29-410b-af04-08ee6777efe2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:08.271600 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4073497c-4e29-410b-af04-08ee6777efe2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:08.272040 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4073497c-4e29-410b-af04-08ee6777efe2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:08.335484 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4073497c-4e29-410b-af04-08ee6777efe2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:08.343510 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4073497c-4e29-410b-af04-08ee6777efe2 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.085053 Dec 15 13:12:08.344062 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1399/2782] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:08 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:09.360813 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-68551578-f642-4bd7-93fd-89ae9b8b1006 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:09.361480 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-68551578-f642-4bd7-93fd-89ae9b8b1006 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:09.368364 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-68551578-f642-4bd7-93fd-89ae9b8b1006 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:09.368810 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-68551578-f642-4bd7-93fd-89ae9b8b1006 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:09.369636 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-68551578-f642-4bd7-93fd-89ae9b8b1006 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:09.370072 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-68551578-f642-4bd7-93fd-89ae9b8b1006 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:09.429624 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-68551578-f642-4bd7-93fd-89ae9b8b1006 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:09.438063 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-68551578-f642-4bd7-93fd-89ae9b8b1006 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080995 Dec 15 13:12:09.438630 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1384/2783] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:09 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:12:10.455666 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-050298b1-3f40-4a36-8ff5-ae950d22d6c3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:10.456273 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-050298b1-3f40-4a36-8ff5-ae950d22d6c3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:10.463059 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-050298b1-3f40-4a36-8ff5-ae950d22d6c3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:10.463497 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-050298b1-3f40-4a36-8ff5-ae950d22d6c3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:10.464412 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-050298b1-3f40-4a36-8ff5-ae950d22d6c3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:10.464854 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-050298b1-3f40-4a36-8ff5-ae950d22d6c3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:10.529969 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-050298b1-3f40-4a36-8ff5-ae950d22d6c3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:10.537806 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-050298b1-3f40-4a36-8ff5-ae950d22d6c3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.085912 Dec 15 13:12:10.538363 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1400/2784] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:10 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:11.555973 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a805ac11-43b2-4213-b140-b5779087affb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:11.556780 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a805ac11-43b2-4213-b140-b5779087affb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:11.565960 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a805ac11-43b2-4213-b140-b5779087affb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:11.566409 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a805ac11-43b2-4213-b140-b5779087affb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:11.567209 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a805ac11-43b2-4213-b140-b5779087affb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:11.567649 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a805ac11-43b2-4213-b140-b5779087affb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:11.628579 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a805ac11-43b2-4213-b140-b5779087affb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:11.637208 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a805ac11-43b2-4213-b140-b5779087affb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.085347 Dec 15 13:12:11.637817 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1385/2785] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:11 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:12.655048 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-cd4e694c-1890-4653-a03a-680eff171bcc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:12.655682 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-cd4e694c-1890-4653-a03a-680eff171bcc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:12.662004 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cd4e694c-1890-4653-a03a-680eff171bcc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:12.662460 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cd4e694c-1890-4653-a03a-680eff171bcc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:12.663254 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cd4e694c-1890-4653-a03a-680eff171bcc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:12.663692 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cd4e694c-1890-4653-a03a-680eff171bcc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:12.723559 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-cd4e694c-1890-4653-a03a-680eff171bcc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:12.732226 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-cd4e694c-1890-4653-a03a-680eff171bcc tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081623 Dec 15 13:12:12.732795 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1401/2786] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:12 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:13.748575 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4d3b848f-17f8-491e-8821-814c39d22905 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:13.749207 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4d3b848f-17f8-491e-8821-814c39d22905 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:13.755591 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4d3b848f-17f8-491e-8821-814c39d22905 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:13.756038 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4d3b848f-17f8-491e-8821-814c39d22905 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:13.756820 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4d3b848f-17f8-491e-8821-814c39d22905 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:13.757254 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4d3b848f-17f8-491e-8821-814c39d22905 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:13.816956 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4d3b848f-17f8-491e-8821-814c39d22905 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:13.825537 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4d3b848f-17f8-491e-8821-814c39d22905 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080698 Dec 15 13:12:13.826096 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1386/2787] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:13 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:14.843183 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-94b52efb-b6cb-40c9-bd37-f50a52c10a42 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:14.843810 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-94b52efb-b6cb-40c9-bd37-f50a52c10a42 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:14.850292 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-94b52efb-b6cb-40c9-bd37-f50a52c10a42 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:14.850745 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-94b52efb-b6cb-40c9-bd37-f50a52c10a42 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:14.851534 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-94b52efb-b6cb-40c9-bd37-f50a52c10a42 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:14.851971 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-94b52efb-b6cb-40c9-bd37-f50a52c10a42 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:14.920237 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-94b52efb-b6cb-40c9-bd37-f50a52c10a42 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:14.928038 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-94b52efb-b6cb-40c9-bd37-f50a52c10a42 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.089518 Dec 15 13:12:14.928600 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1402/2788] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:14 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:12:15.943962 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-aa878a4d-022c-43f8-9a24-8d28659b5392 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:15.944572 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-aa878a4d-022c-43f8-9a24-8d28659b5392 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:15.950998 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aa878a4d-022c-43f8-9a24-8d28659b5392 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:15.951447 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aa878a4d-022c-43f8-9a24-8d28659b5392 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:15.952227 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aa878a4d-022c-43f8-9a24-8d28659b5392 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:15.952667 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-aa878a4d-022c-43f8-9a24-8d28659b5392 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:16.011994 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-aa878a4d-022c-43f8-9a24-8d28659b5392 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:16.019983 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-aa878a4d-022c-43f8-9a24-8d28659b5392 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.079689 Dec 15 13:12:16.020551 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1387/2789] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:15 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:17.036632 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-54bc6015-5e52-4a22-addd-90c53cf7d2ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:17.037268 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-54bc6015-5e52-4a22-addd-90c53cf7d2ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:17.043866 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-54bc6015-5e52-4a22-addd-90c53cf7d2ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:17.044324 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-54bc6015-5e52-4a22-addd-90c53cf7d2ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:17.045111 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-54bc6015-5e52-4a22-addd-90c53cf7d2ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:17.045580 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-54bc6015-5e52-4a22-addd-90c53cf7d2ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:17.112777 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-54bc6015-5e52-4a22-addd-90c53cf7d2ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:17.121144 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-54bc6015-5e52-4a22-addd-90c53cf7d2ed tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.087613 Dec 15 13:12:17.121823 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1403/2790] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:17 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:18.138986 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2e2263db-a246-479f-af6d-69ed542b55fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:18.139928 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2e2263db-a246-479f-af6d-69ed542b55fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:18.146227 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2e2263db-a246-479f-af6d-69ed542b55fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:18.146758 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2e2263db-a246-479f-af6d-69ed542b55fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:18.147470 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2e2263db-a246-479f-af6d-69ed542b55fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:18.147900 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2e2263db-a246-479f-af6d-69ed542b55fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:18.207432 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2e2263db-a246-479f-af6d-69ed542b55fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:18.215943 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2e2263db-a246-479f-af6d-69ed542b55fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081143 Dec 15 13:12:18.216445 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1388/2791] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:18 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:19.234348 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a7163e76-608c-41e4-ae50-d163bdaae2e6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:19.234964 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a7163e76-608c-41e4-ae50-d163bdaae2e6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:19.241201 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a7163e76-608c-41e4-ae50-d163bdaae2e6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:19.241698 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a7163e76-608c-41e4-ae50-d163bdaae2e6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:19.242493 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a7163e76-608c-41e4-ae50-d163bdaae2e6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:19.242935 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a7163e76-608c-41e4-ae50-d163bdaae2e6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:19.305009 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a7163e76-608c-41e4-ae50-d163bdaae2e6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:19.313106 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a7163e76-608c-41e4-ae50-d163bdaae2e6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.083160 Dec 15 13:12:19.313703 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1404/2792] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:19 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:20.330470 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-afa8b27b-78a6-434c-8643-3571552076de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:20.331140 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-afa8b27b-78a6-434c-8643-3571552076de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:20.337376 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afa8b27b-78a6-434c-8643-3571552076de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:20.337861 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afa8b27b-78a6-434c-8643-3571552076de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:20.338628 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afa8b27b-78a6-434c-8643-3571552076de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:20.339664 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-afa8b27b-78a6-434c-8643-3571552076de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:20.401003 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-afa8b27b-78a6-434c-8643-3571552076de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:20.409592 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-afa8b27b-78a6-434c-8643-3571552076de tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082609 Dec 15 13:12:20.410194 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1389/2793] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:20 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:21.427485 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f25d5d1b-b0e7-41dd-a4d5-3a9d521df870 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:21.428099 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f25d5d1b-b0e7-41dd-a4d5-3a9d521df870 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:21.434861 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f25d5d1b-b0e7-41dd-a4d5-3a9d521df870 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:21.435310 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f25d5d1b-b0e7-41dd-a4d5-3a9d521df870 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:21.436081 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f25d5d1b-b0e7-41dd-a4d5-3a9d521df870 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:21.436515 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f25d5d1b-b0e7-41dd-a4d5-3a9d521df870 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:21.498999 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f25d5d1b-b0e7-41dd-a4d5-3a9d521df870 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:21.507113 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f25d5d1b-b0e7-41dd-a4d5-3a9d521df870 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.083663 Dec 15 13:12:21.507737 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1405/2794] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:21 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:22.524201 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bc513427-6190-4250-b6e3-85c1828c8f7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:22.524797 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bc513427-6190-4250-b6e3-85c1828c8f7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:22.531690 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc513427-6190-4250-b6e3-85c1828c8f7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:22.532141 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc513427-6190-4250-b6e3-85c1828c8f7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:22.532919 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc513427-6190-4250-b6e3-85c1828c8f7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:22.533356 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc513427-6190-4250-b6e3-85c1828c8f7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:22.593961 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bc513427-6190-4250-b6e3-85c1828c8f7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:22.602425 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bc513427-6190-4250-b6e3-85c1828c8f7f tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081803 Dec 15 13:12:22.603015 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1390/2795] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:22 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:23.619200 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4acb8096-2203-467e-8174-1c7442727544 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:23.619766 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4acb8096-2203-467e-8174-1c7442727544 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:23.626111 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4acb8096-2203-467e-8174-1c7442727544 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:23.626568 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4acb8096-2203-467e-8174-1c7442727544 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:23.627353 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4acb8096-2203-467e-8174-1c7442727544 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:23.627796 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4acb8096-2203-467e-8174-1c7442727544 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:23.693876 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4acb8096-2203-467e-8174-1c7442727544 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:23.702628 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4acb8096-2203-467e-8174-1c7442727544 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.087145 Dec 15 13:12:23.703208 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1406/2796] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:23 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:24.720204 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-46cad497-7ff1-4e89-b2be-a83a94160b70 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:24.720809 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-46cad497-7ff1-4e89-b2be-a83a94160b70 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:24.727085 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-46cad497-7ff1-4e89-b2be-a83a94160b70 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:24.727525 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-46cad497-7ff1-4e89-b2be-a83a94160b70 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:24.728306 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-46cad497-7ff1-4e89-b2be-a83a94160b70 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:24.728924 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-46cad497-7ff1-4e89-b2be-a83a94160b70 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:24.796566 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-46cad497-7ff1-4e89-b2be-a83a94160b70 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:24.804357 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-46cad497-7ff1-4e89-b2be-a83a94160b70 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.087829 Dec 15 13:12:24.804918 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1391/2797] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:24 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:25.820521 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4ed645ff-fa03-44b5-9873-110bfeee98b0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:25.821134 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4ed645ff-fa03-44b5-9873-110bfeee98b0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:25.828591 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4ed645ff-fa03-44b5-9873-110bfeee98b0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:25.829047 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4ed645ff-fa03-44b5-9873-110bfeee98b0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:25.829890 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4ed645ff-fa03-44b5-9873-110bfeee98b0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:25.830333 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4ed645ff-fa03-44b5-9873-110bfeee98b0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:25.891419 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4ed645ff-fa03-44b5-9873-110bfeee98b0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:25.899133 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4ed645ff-fa03-44b5-9873-110bfeee98b0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082284 Dec 15 13:12:25.899682 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1407/2798] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:25 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:26.916249 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1f952e23-1a24-4246-825c-4dedfb1880a6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:26.916860 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1f952e23-1a24-4246-825c-4dedfb1880a6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:26.923161 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1f952e23-1a24-4246-825c-4dedfb1880a6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:26.923601 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1f952e23-1a24-4246-825c-4dedfb1880a6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:26.924371 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1f952e23-1a24-4246-825c-4dedfb1880a6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:26.924802 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1f952e23-1a24-4246-825c-4dedfb1880a6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:26.986440 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1f952e23-1a24-4246-825c-4dedfb1880a6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:26.994719 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1f952e23-1a24-4246-825c-4dedfb1880a6 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082018 Dec 15 13:12:26.995312 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1392/2799] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:26 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:28.011487 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-386a9d99-fb0d-40e7-b9e3-b8eb9415a313 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:28.012143 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-386a9d99-fb0d-40e7-b9e3-b8eb9415a313 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:28.018638 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-386a9d99-fb0d-40e7-b9e3-b8eb9415a313 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:28.019088 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-386a9d99-fb0d-40e7-b9e3-b8eb9415a313 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:28.019865 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-386a9d99-fb0d-40e7-b9e3-b8eb9415a313 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:28.020302 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-386a9d99-fb0d-40e7-b9e3-b8eb9415a313 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:28.083452 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-386a9d99-fb0d-40e7-b9e3-b8eb9415a313 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:28.091825 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-386a9d99-fb0d-40e7-b9e3-b8eb9415a313 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.084062 Dec 15 13:12:28.092392 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1408/2800] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:28 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:29.108861 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6536ce3e-17d5-4cba-acba-3f3787a96f2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:29.109485 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6536ce3e-17d5-4cba-acba-3f3787a96f2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:29.115552 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6536ce3e-17d5-4cba-acba-3f3787a96f2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:29.116009 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6536ce3e-17d5-4cba-acba-3f3787a96f2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:29.116793 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6536ce3e-17d5-4cba-acba-3f3787a96f2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:29.117229 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6536ce3e-17d5-4cba-acba-3f3787a96f2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:29.179726 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6536ce3e-17d5-4cba-acba-3f3787a96f2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:29.188304 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6536ce3e-17d5-4cba-acba-3f3787a96f2a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.083423 Dec 15 13:12:29.188885 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1393/2801] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:29 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:30.204746 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-faa2f79c-2b4f-4a53-a3b1-774d01568848 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:30.205289 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-faa2f79c-2b4f-4a53-a3b1-774d01568848 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:30.211189 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-faa2f79c-2b4f-4a53-a3b1-774d01568848 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:30.211644 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-faa2f79c-2b4f-4a53-a3b1-774d01568848 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:30.212442 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-faa2f79c-2b4f-4a53-a3b1-774d01568848 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:30.212880 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-faa2f79c-2b4f-4a53-a3b1-774d01568848 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:30.273198 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-faa2f79c-2b4f-4a53-a3b1-774d01568848 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:30.282475 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-faa2f79c-2b4f-4a53-a3b1-774d01568848 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081531 Dec 15 13:12:30.283064 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1409/2802] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:30 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:31.302891 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3d71d19b-9620-4f76-b8b2-4eab94c2bb9a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:31.304116 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3d71d19b-9620-4f76-b8b2-4eab94c2bb9a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:31.316795 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3d71d19b-9620-4f76-b8b2-4eab94c2bb9a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:31.317618 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3d71d19b-9620-4f76-b8b2-4eab94c2bb9a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:31.319059 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3d71d19b-9620-4f76-b8b2-4eab94c2bb9a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:31.319769 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3d71d19b-9620-4f76-b8b2-4eab94c2bb9a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:31.380579 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3d71d19b-9620-4f76-b8b2-4eab94c2bb9a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:31.389607 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3d71d19b-9620-4f76-b8b2-4eab94c2bb9a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.093381 Dec 15 13:12:31.390124 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1394/2803] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:31 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:32.405791 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a5104549-fe53-44ec-a81d-d77a2feefe5e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:32.406413 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a5104549-fe53-44ec-a81d-d77a2feefe5e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:32.413314 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a5104549-fe53-44ec-a81d-d77a2feefe5e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:32.414255 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a5104549-fe53-44ec-a81d-d77a2feefe5e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:32.415058 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a5104549-fe53-44ec-a81d-d77a2feefe5e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:32.415499 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a5104549-fe53-44ec-a81d-d77a2feefe5e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:32.475755 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a5104549-fe53-44ec-a81d-d77a2feefe5e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:32.484023 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a5104549-fe53-44ec-a81d-d77a2feefe5e tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082311 Dec 15 13:12:32.484583 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1410/2804] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:32 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:33.502197 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-961d186f-c7c3-425e-a77c-15834492d53c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:33.503030 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-961d186f-c7c3-425e-a77c-15834492d53c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:33.511911 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-961d186f-c7c3-425e-a77c-15834492d53c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:33.512364 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-961d186f-c7c3-425e-a77c-15834492d53c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:33.513162 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-961d186f-c7c3-425e-a77c-15834492d53c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:33.513712 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-961d186f-c7c3-425e-a77c-15834492d53c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:33.574138 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-961d186f-c7c3-425e-a77c-15834492d53c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:33.582576 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-961d186f-c7c3-425e-a77c-15834492d53c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.085789 Dec 15 13:12:33.583140 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1395/2805] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:33 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:34.599566 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-24fc024f-42cb-4dac-8c39-c427081882fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:34.600143 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-24fc024f-42cb-4dac-8c39-c427081882fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:34.606601 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-24fc024f-42cb-4dac-8c39-c427081882fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:34.607046 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-24fc024f-42cb-4dac-8c39-c427081882fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:34.607819 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-24fc024f-42cb-4dac-8c39-c427081882fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:34.608251 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-24fc024f-42cb-4dac-8c39-c427081882fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:34.671946 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-24fc024f-42cb-4dac-8c39-c427081882fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:34.679828 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-24fc024f-42cb-4dac-8c39-c427081882fb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.084046 Dec 15 13:12:34.680386 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1411/2806] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:34 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:35.696970 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6d98d37d-31e7-4c2b-85d2-d296fc336e0a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:35.697617 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6d98d37d-31e7-4c2b-85d2-d296fc336e0a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:35.704517 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d98d37d-31e7-4c2b-85d2-d296fc336e0a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:35.704968 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d98d37d-31e7-4c2b-85d2-d296fc336e0a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:35.705785 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d98d37d-31e7-4c2b-85d2-d296fc336e0a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:35.706234 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d98d37d-31e7-4c2b-85d2-d296fc336e0a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:35.766795 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6d98d37d-31e7-4c2b-85d2-d296fc336e0a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:35.774845 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6d98d37d-31e7-4c2b-85d2-d296fc336e0a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081637 Dec 15 13:12:35.775413 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1396/2807] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:35 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:36.796582 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-52828ead-ff71-48f9-b4c4-41c9f7b07df4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:36.797683 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-52828ead-ff71-48f9-b4c4-41c9f7b07df4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:36.808607 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-52828ead-ff71-48f9-b4c4-41c9f7b07df4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:36.809448 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-52828ead-ff71-48f9-b4c4-41c9f7b07df4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:36.810881 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-52828ead-ff71-48f9-b4c4-41c9f7b07df4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:36.811687 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-52828ead-ff71-48f9-b4c4-41c9f7b07df4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:36.874343 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-52828ead-ff71-48f9-b4c4-41c9f7b07df4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:36.882213 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-52828ead-ff71-48f9-b4c4-41c9f7b07df4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.093498 Dec 15 13:12:36.882777 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1412/2808] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:36 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:37.899453 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a658ab98-1fd1-47d1-8453-9298ed11b164 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:37.900061 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a658ab98-1fd1-47d1-8453-9298ed11b164 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:37.907040 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a658ab98-1fd1-47d1-8453-9298ed11b164 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:37.907484 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a658ab98-1fd1-47d1-8453-9298ed11b164 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:37.908251 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a658ab98-1fd1-47d1-8453-9298ed11b164 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:37.908679 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a658ab98-1fd1-47d1-8453-9298ed11b164 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:37.967617 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a658ab98-1fd1-47d1-8453-9298ed11b164 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:37.975384 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a658ab98-1fd1-47d1-8453-9298ed11b164 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.079588 Dec 15 13:12:37.975954 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1397/2809] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:37 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:38.992175 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ffb76e80-60cf-42b8-a542-a057c5742ed3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:38.992808 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ffb76e80-60cf-42b8-a542-a057c5742ed3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:38.999255 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ffb76e80-60cf-42b8-a542-a057c5742ed3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:38.999711 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ffb76e80-60cf-42b8-a542-a057c5742ed3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:39.000492 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ffb76e80-60cf-42b8-a542-a057c5742ed3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:39.000933 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ffb76e80-60cf-42b8-a542-a057c5742ed3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:39.061718 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ffb76e80-60cf-42b8-a542-a057c5742ed3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:39.069646 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ffb76e80-60cf-42b8-a542-a057c5742ed3 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081140 Dec 15 13:12:39.070208 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1413/2810] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:38 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:40.086879 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e0d50d12-a704-4a3e-969b-9b7350841aef tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:40.087496 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e0d50d12-a704-4a3e-969b-9b7350841aef tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:40.094266 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0d50d12-a704-4a3e-969b-9b7350841aef tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:40.094693 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0d50d12-a704-4a3e-969b-9b7350841aef tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:40.095471 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0d50d12-a704-4a3e-969b-9b7350841aef tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:40.095904 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e0d50d12-a704-4a3e-969b-9b7350841aef tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:40.157202 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e0d50d12-a704-4a3e-969b-9b7350841aef tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:40.165121 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e0d50d12-a704-4a3e-969b-9b7350841aef tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081869 Dec 15 13:12:40.165715 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1398/2811] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:40 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:41.184061 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4bc07432-61e0-4394-8a77-4d5a9943c95a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:41.184701 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4bc07432-61e0-4394-8a77-4d5a9943c95a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:41.191063 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4bc07432-61e0-4394-8a77-4d5a9943c95a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:41.191521 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4bc07432-61e0-4394-8a77-4d5a9943c95a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:41.192307 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4bc07432-61e0-4394-8a77-4d5a9943c95a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:41.192749 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4bc07432-61e0-4394-8a77-4d5a9943c95a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:41.255953 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4bc07432-61e0-4394-8a77-4d5a9943c95a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:41.264836 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4bc07432-61e0-4394-8a77-4d5a9943c95a tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.084800 Dec 15 13:12:41.265402 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1414/2812] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:41 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:42.282246 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-36a09117-d081-48c0-bf2d-0fb6edefda42 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:42.282854 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-36a09117-d081-48c0-bf2d-0fb6edefda42 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:42.289066 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-36a09117-d081-48c0-bf2d-0fb6edefda42 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:42.289531 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-36a09117-d081-48c0-bf2d-0fb6edefda42 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:42.290306 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-36a09117-d081-48c0-bf2d-0fb6edefda42 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:42.290734 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-36a09117-d081-48c0-bf2d-0fb6edefda42 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:42.350803 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-36a09117-d081-48c0-bf2d-0fb6edefda42 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:42.359032 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-36a09117-d081-48c0-bf2d-0fb6edefda42 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080405 Dec 15 13:12:42.359597 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1399/2813] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:42 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:43.374895 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c42b0a3e-4aac-469d-8d69-6634002ebd79 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:43.375487 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c42b0a3e-4aac-469d-8d69-6634002ebd79 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:43.381763 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c42b0a3e-4aac-469d-8d69-6634002ebd79 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:43.382225 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c42b0a3e-4aac-469d-8d69-6634002ebd79 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:43.383003 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c42b0a3e-4aac-469d-8d69-6634002ebd79 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:43.383438 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c42b0a3e-4aac-469d-8d69-6634002ebd79 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:43.443298 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c42b0a3e-4aac-469d-8d69-6634002ebd79 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:43.451650 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c42b0a3e-4aac-469d-8d69-6634002ebd79 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080445 Dec 15 13:12:43.452215 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1415/2814] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:43 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:12:44.468504 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c3d661a8-9b45-4aa2-ae9c-93c81d181c2d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:44.469107 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c3d661a8-9b45-4aa2-ae9c-93c81d181c2d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:44.475363 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c3d661a8-9b45-4aa2-ae9c-93c81d181c2d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:44.475805 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c3d661a8-9b45-4aa2-ae9c-93c81d181c2d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:44.476573 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c3d661a8-9b45-4aa2-ae9c-93c81d181c2d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:44.477001 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c3d661a8-9b45-4aa2-ae9c-93c81d181c2d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:44.536593 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c3d661a8-9b45-4aa2-ae9c-93c81d181c2d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:44.544384 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c3d661a8-9b45-4aa2-ae9c-93c81d181c2d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080453 Dec 15 13:12:44.544959 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1400/2815] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:44 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:45.560328 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5107eed5-27ad-40db-ba08-a762563a5ed4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:45.560930 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5107eed5-27ad-40db-ba08-a762563a5ed4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:45.567105 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5107eed5-27ad-40db-ba08-a762563a5ed4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:45.567554 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5107eed5-27ad-40db-ba08-a762563a5ed4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:45.568332 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5107eed5-27ad-40db-ba08-a762563a5ed4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:45.568769 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5107eed5-27ad-40db-ba08-a762563a5ed4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:45.627298 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5107eed5-27ad-40db-ba08-a762563a5ed4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:45.635069 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5107eed5-27ad-40db-ba08-a762563a5ed4 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.078689 Dec 15 13:12:45.635750 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1416/2816] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:45 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:46.653032 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d2830f8b-b3e6-4801-81eb-620c1c55c96d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:46.653694 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d2830f8b-b3e6-4801-81eb-620c1c55c96d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:46.660146 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d2830f8b-b3e6-4801-81eb-620c1c55c96d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:46.660601 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d2830f8b-b3e6-4801-81eb-620c1c55c96d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:46.661395 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d2830f8b-b3e6-4801-81eb-620c1c55c96d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:46.661857 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d2830f8b-b3e6-4801-81eb-620c1c55c96d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:46.721879 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d2830f8b-b3e6-4801-81eb-620c1c55c96d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:46.734631 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d2830f8b-b3e6-4801-81eb-620c1c55c96d tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.085876 Dec 15 13:12:46.735209 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1401/2817] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:46 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:47.752208 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-769ecaa0-73a8-4419-a357-3424a6b93415 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:47.752933 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-769ecaa0-73a8-4419-a357-3424a6b93415 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:47.759166 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-769ecaa0-73a8-4419-a357-3424a6b93415 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:47.759611 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-769ecaa0-73a8-4419-a357-3424a6b93415 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:47.760375 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-769ecaa0-73a8-4419-a357-3424a6b93415 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:47.761704 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-769ecaa0-73a8-4419-a357-3424a6b93415 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:47.825795 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-769ecaa0-73a8-4419-a357-3424a6b93415 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:47.833477 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-769ecaa0-73a8-4419-a357-3424a6b93415 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.085041 Dec 15 13:12:47.834064 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1417/2818] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:47 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:48.850471 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e2300bbd-428c-4f05-a1b1-5ac9937c4dd0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:48.851157 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e2300bbd-428c-4f05-a1b1-5ac9937c4dd0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:48.857398 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e2300bbd-428c-4f05-a1b1-5ac9937c4dd0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:48.857916 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e2300bbd-428c-4f05-a1b1-5ac9937c4dd0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:48.858699 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e2300bbd-428c-4f05-a1b1-5ac9937c4dd0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:48.859140 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e2300bbd-428c-4f05-a1b1-5ac9937c4dd0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:48.919272 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e2300bbd-428c-4f05-a1b1-5ac9937c4dd0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:48.927023 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e2300bbd-428c-4f05-a1b1-5ac9937c4dd0 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080185 Dec 15 13:12:48.927583 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1402/2819] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:48 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:12:49.943748 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-21348a37-dcfa-4de3-afd2-3b46cbb786f8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:49.944403 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-21348a37-dcfa-4de3-afd2-3b46cbb786f8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:49.950862 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-21348a37-dcfa-4de3-afd2-3b46cbb786f8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:49.951317 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-21348a37-dcfa-4de3-afd2-3b46cbb786f8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:49.952100 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-21348a37-dcfa-4de3-afd2-3b46cbb786f8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:49.952544 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-21348a37-dcfa-4de3-afd2-3b46cbb786f8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:50.011504 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-21348a37-dcfa-4de3-afd2-3b46cbb786f8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:50.019431 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-21348a37-dcfa-4de3-afd2-3b46cbb786f8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.079366 Dec 15 13:12:50.019986 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1418/2820] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:49 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:51.036660 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-458afdc5-2af1-4bd2-a398-30edf7e86052 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:51.037276 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-458afdc5-2af1-4bd2-a398-30edf7e86052 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:51.043991 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-458afdc5-2af1-4bd2-a398-30edf7e86052 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:51.044445 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-458afdc5-2af1-4bd2-a398-30edf7e86052 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:51.045235 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-458afdc5-2af1-4bd2-a398-30edf7e86052 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:51.045707 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-458afdc5-2af1-4bd2-a398-30edf7e86052 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:51.107000 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-458afdc5-2af1-4bd2-a398-30edf7e86052 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:51.114821 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-458afdc5-2af1-4bd2-a398-30edf7e86052 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081796 Dec 15 13:12:51.115393 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1403/2821] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:51 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:52.132047 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7da1833f-9af7-4e6e-91f4-741e0cc250d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:52.132671 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7da1833f-9af7-4e6e-91f4-741e0cc250d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:52.139763 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7da1833f-9af7-4e6e-91f4-741e0cc250d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:52.140219 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7da1833f-9af7-4e6e-91f4-741e0cc250d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:52.141007 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7da1833f-9af7-4e6e-91f4-741e0cc250d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:52.141444 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7da1833f-9af7-4e6e-91f4-741e0cc250d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:52.201453 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7da1833f-9af7-4e6e-91f4-741e0cc250d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:52.209205 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7da1833f-9af7-4e6e-91f4-741e0cc250d9 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.080855 Dec 15 13:12:52.209788 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1419/2822] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:52 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:53.227182 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0bb8a1d0-84cb-4edb-b6fc-cb3c44112385 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:53.227814 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0bb8a1d0-84cb-4edb-b6fc-cb3c44112385 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:53.234769 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0bb8a1d0-84cb-4edb-b6fc-cb3c44112385 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:53.235221 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0bb8a1d0-84cb-4edb-b6fc-cb3c44112385 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:53.236003 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0bb8a1d0-84cb-4edb-b6fc-cb3c44112385 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:53.236442 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0bb8a1d0-84cb-4edb-b6fc-cb3c44112385 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:53.303118 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0bb8a1d0-84cb-4edb-b6fc-cb3c44112385 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:53.311197 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0bb8a1d0-84cb-4edb-b6fc-cb3c44112385 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.087566 Dec 15 13:12:53.311789 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1404/2823] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:53 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:54.328358 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1f0b68b0-ebbd-4809-993a-e1f73122acb5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:54.329002 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1f0b68b0-ebbd-4809-993a-e1f73122acb5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:54.335328 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1f0b68b0-ebbd-4809-993a-e1f73122acb5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:54.335788 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1f0b68b0-ebbd-4809-993a-e1f73122acb5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:54.336568 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1f0b68b0-ebbd-4809-993a-e1f73122acb5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:54.337007 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1f0b68b0-ebbd-4809-993a-e1f73122acb5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:54.402084 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1f0b68b0-ebbd-4809-993a-e1f73122acb5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:54.411436 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1f0b68b0-ebbd-4809-993a-e1f73122acb5 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.086699 Dec 15 13:12:54.412023 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1420/2824] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:54 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:12:55.428179 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0787c3d2-708b-497a-b73d-c3e8bfa3f1ee tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:55.428798 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0787c3d2-708b-497a-b73d-c3e8bfa3f1ee tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:55.435647 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0787c3d2-708b-497a-b73d-c3e8bfa3f1ee tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:55.436099 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0787c3d2-708b-497a-b73d-c3e8bfa3f1ee tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:55.436886 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0787c3d2-708b-497a-b73d-c3e8bfa3f1ee tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:55.437322 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0787c3d2-708b-497a-b73d-c3e8bfa3f1ee tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:55.505236 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0787c3d2-708b-497a-b73d-c3e8bfa3f1ee tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:55.513860 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0787c3d2-708b-497a-b73d-c3e8bfa3f1ee tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.089240 Dec 15 13:12:55.514750 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1405/2825] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:55 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:56.531272 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-351b2a80-8c70-4830-8243-a9a9f4ecc9d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:56.531951 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-351b2a80-8c70-4830-8243-a9a9f4ecc9d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:56.538503 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-351b2a80-8c70-4830-8243-a9a9f4ecc9d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:56.539004 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-351b2a80-8c70-4830-8243-a9a9f4ecc9d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:56.539855 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-351b2a80-8c70-4830-8243-a9a9f4ecc9d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:56.540306 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-351b2a80-8c70-4830-8243-a9a9f4ecc9d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:56.604540 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-351b2a80-8c70-4830-8243-a9a9f4ecc9d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:56.612634 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-351b2a80-8c70-4830-8243-a9a9f4ecc9d8 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.085366 Dec 15 13:12:56.613206 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1421/2826] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:56 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:57.630250 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3a648ac4-fd89-4fbf-b6bc-94599640f9eb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:57.630883 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3a648ac4-fd89-4fbf-b6bc-94599640f9eb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:57.637836 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3a648ac4-fd89-4fbf-b6bc-94599640f9eb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:57.638290 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3a648ac4-fd89-4fbf-b6bc-94599640f9eb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:57.639090 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3a648ac4-fd89-4fbf-b6bc-94599640f9eb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:57.639789 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3a648ac4-fd89-4fbf-b6bc-94599640f9eb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:57.700788 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-3a648ac4-fd89-4fbf-b6bc-94599640f9eb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:57.708878 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3a648ac4-fd89-4fbf-b6bc-94599640f9eb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082435 Dec 15 13:12:57.709455 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1406/2827] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:57 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:58.442821 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:12:58.443093 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 13:12:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:12:58.726834 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ba669b44-89fb-495d-a81e-907dce4b15eb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:58.727998 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ba669b44-89fb-495d-a81e-907dce4b15eb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:58.735004 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ba669b44-89fb-495d-a81e-907dce4b15eb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:58.735455 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ba669b44-89fb-495d-a81e-907dce4b15eb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:58.736245 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ba669b44-89fb-495d-a81e-907dce4b15eb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:58.736676 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ba669b44-89fb-495d-a81e-907dce4b15eb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:58.809322 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ba669b44-89fb-495d-a81e-907dce4b15eb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:58.821418 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ba669b44-89fb-495d-a81e-907dce4b15eb tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.098161 Dec 15 13:12:58.822095 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1422/2828] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:58 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:12:59.840151 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0e499282-d80b-48df-98ae-59484a848e74 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:12:59.840779 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0e499282-d80b-48df-98ae-59484a848e74 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:12:59.847133 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e499282-d80b-48df-98ae-59484a848e74 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:59.847581 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e499282-d80b-48df-98ae-59484a848e74 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:59.848367 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e499282-d80b-48df-98ae-59484a848e74 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:12:59.848805 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0e499282-d80b-48df-98ae-59484a848e74 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:12:59.909742 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0e499282-d80b-48df-98ae-59484a848e74 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:12:59.918398 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0e499282-d80b-48df-98ae-59484a848e74 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.082563 Dec 15 13:12:59.918966 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1407/2829] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:12:59 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:13:00.935531 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-295239ea-43a2-41bb-9e8a-f2154421305c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:00.936465 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-295239ea-43a2-41bb-9e8a-f2154421305c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:00.942887 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-295239ea-43a2-41bb-9e8a-f2154421305c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:00.943431 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-295239ea-43a2-41bb-9e8a-f2154421305c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:00.944298 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-295239ea-43a2-41bb-9e8a-f2154421305c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:00.944811 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-295239ea-43a2-41bb-9e8a-f2154421305c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:01.008205 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-295239ea-43a2-41bb-9e8a-f2154421305c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:01.016908 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-295239ea-43a2-41bb-9e8a-f2154421305c tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.085687 Dec 15 13:13:01.017464 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1423/2830] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:00 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:02.034064 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f7823936-0e97-4b29-b853-5ab3fb097509 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:02.034665 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f7823936-0e97-4b29-b853-5ab3fb097509 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] [instance: 2824788a-14d6-488d-8af1-2df6b3de771a] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:02.041068 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f7823936-0e97-4b29-b853-5ab3fb097509 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:02.042235 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f7823936-0e97-4b29-b853-5ab3fb097509 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:02.043031 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f7823936-0e97-4b29-b853-5ab3fb097509 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:02.043476 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f7823936-0e97-4b29-b853-5ab3fb097509 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:02.102956 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-f7823936-0e97-4b29-b853-5ab3fb097509 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b484644498409ca36d9bb7e0f8554f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05491d815914935aff3735da7c30031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:02.111438 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f7823936-0e97-4b29-b853-5ab3fb097509 tempest-ServerRescueNegativeTestJSON-1769752350 tempest-ServerRescueNegativeTestJSON-1769752350-project] 10.222.0.76 "GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a" status: 200 len: 1352 microversion: 2.1 time: 0.081037 Dec 15 13:13:02.112195 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1408/2831] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:02 2021] GET /compute/v2.1/servers/2824788a-14d6-488d-8af1-2df6b3de771a => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:04.987322 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e56d9fba-0f61-4b57-9647-70930ef9ba9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-673825906", "imageRef": "d302555e-2bff-4492-b57d-d59c0097a278", "flavorRef": "452", "networks": [{"uuid": "0e6f9adc-0704-4c6a-95ca-a377df4c943a"}]}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:13:05.044937 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.network.neutron [None req-e56d9fba-0f61-4b57-9647-70930ef9ba9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] validate_networks() for [('0e6f9adc-0704-4c6a-95ca-a377df4c943a', None, None, None, None, None)] {{(pid=122614) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:13:05.676667 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3c8a794b-69ba-4f1b-8061-8756e81c0d6d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:05.679521 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3c8a794b-69ba-4f1b-8061-8756e81c0d6d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:05.700229 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c8a794b-69ba-4f1b-8061-8756e81c0d6d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:05.700790 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c8a794b-69ba-4f1b-8061-8756e81c0d6d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:05.703372 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c8a794b-69ba-4f1b-8061-8756e81c0d6d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:05.704995 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c8a794b-69ba-4f1b-8061-8756e81c0d6d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:05.769572 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3c8a794b-69ba-4f1b-8061-8756e81c0d6d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Going to try to terminate instance {{(pid=122615) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:13:05.849192 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3c8a794b-69ba-4f1b-8061-8756e81c0d6d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [5521733b-381e-4bb7-b9f8-c7330d0594e2] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 15 13:13:05.864117 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-e56d9fba-0f61-4b57-9647-70930ef9ba9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Flavor limits 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:13:05.864742 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-e56d9fba-0f61-4b57-9647-70930ef9ba9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Image limits 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:13:05.865397 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-e56d9fba-0f61-4b57-9647-70930ef9ba9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Flavor pref 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:13:05.866188 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-e56d9fba-0f61-4b57-9647-70930ef9ba9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Image pref 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:13:05.866607 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-e56d9fba-0f61-4b57-9647-70930ef9ba9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:13:05.886330 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e56d9fba-0f61-4b57-9647-70930ef9ba9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:05.886774 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e56d9fba-0f61-4b57-9647-70930ef9ba9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:05.887589 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e56d9fba-0f61-4b57-9647-70930ef9ba9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:05.888016 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e56d9fba-0f61-4b57-9647-70930ef9ba9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:05.915035 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-e56d9fba-0f61-4b57-9647-70930ef9ba9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Getting quotas for project d960d0a2e2574caab44c82c717868b06. Resources: {'instances', 'cores', 'ram'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:13:05.920845 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-e56d9fba-0f61-4b57-9647-70930ef9ba9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Getting quotas for user 2438a8e630b743cfb83d57236a266cf8 and project d960d0a2e2574caab44c82c717868b06. Resources: {'instances', 'cores', 'ram'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:13:05.936872 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e56d9fba-0f61-4b57-9647-70930ef9ba9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Going to run 1 instances... {{(pid=122614) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:13:05.939494 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e56d9fba-0f61-4b57-9647-70930ef9ba9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: f2dd28d2-09ee-4933-a465-635e1fce0623] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d302555e-2bff-4492-b57d-d59c0097a278',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:13:06.031874 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e56d9fba-0f61-4b57-9647-70930ef9ba9d tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.048037 Dec 15 13:13:06.033401 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1424/2832] 10.222.0.76 () {60 vars in 1146 bytes} [Wed Dec 15 13:13:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:13:06.048582 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6784b1db-004e-4d81-8b2f-7192b4ade958 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:06.049731 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6784b1db-004e-4d81-8b2f-7192b4ade958 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: f2dd28d2-09ee-4933-a465-635e1fce0623] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:06.122722 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6784b1db-004e-4d81-8b2f-7192b4ade958 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:06.133492 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6784b1db-004e-4d81-8b2f-7192b4ade958 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623" status: 200 len: 1218 microversion: 2.1 time: 0.091826 Dec 15 13:13:06.134255 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1425/2833] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:06 2021] GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:06.367328 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-96eb21ba-8913-47a0-a322-1d196d394828 req-41a1975d-3dae-4f8c-9bdc-c13a73d6443f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7081597f-acfc-473d-8e16-f7b52bcdd7c9", "name": "network-vif-deleted", "tag": "63e1b6fa-4807-4033-9813-10db2ee79bab"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:13:06.368904 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:13:06.368904 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 13:13:06.377009 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-96eb21ba-8913-47a0-a322-1d196d394828 req-41a1975d-3dae-4f8c-9bdc-c13a73d6443f service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:06.377450 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-96eb21ba-8913-47a0-a322-1d196d394828 req-41a1975d-3dae-4f8c-9bdc-c13a73d6443f service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:06.398766 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-96eb21ba-8913-47a0-a322-1d196d394828 req-41a1975d-3dae-4f8c-9bdc-c13a73d6443f service nova] Creating event network-vif-deleted:63e1b6fa-4807-4033-9813-10db2ee79bab for instance 7081597f-acfc-473d-8e16-f7b52bcdd7c9 on hv-cinder-81322 Dec 15 13:13:06.407192 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-96eb21ba-8913-47a0-a322-1d196d394828 req-41a1975d-3dae-4f8c-9bdc-c13a73d6443f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.270955 Dec 15 13:13:06.408185 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1426/2834] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:13:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:13:06.875291 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [None req-3c8a794b-69ba-4f1b-8061-8756e81c0d6d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [5521733b-381e-4bb7-b9f8-c7330d0594e2] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 37428. Dec 15 13:13:06.909428 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3c8a794b-69ba-4f1b-8061-8756e81c0d6d tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "DELETE /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18" status: 204 len: 0 microversion: 2.1 time: 1.244428 Dec 15 13:13:06.910877 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1409/2835] 10.222.0.76 () {58 vars in 1238 bytes} [Wed Dec 15 13:13:05 2021] DELETE /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18 => generated 0 bytes in 1247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:13:06.919917 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-89b42ab0-829d-47e9-98ea-068f365f4a12 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:06.920622 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-89b42ab0-829d-47e9-98ea-068f365f4a12 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:06.927051 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-89b42ab0-829d-47e9-98ea-068f365f4a12 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:06.927510 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-89b42ab0-829d-47e9-98ea-068f365f4a12 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:06.928306 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-89b42ab0-829d-47e9-98ea-068f365f4a12 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:06.928747 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-89b42ab0-829d-47e9-98ea-068f365f4a12 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:07.103057 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-89b42ab0-829d-47e9-98ea-068f365f4a12 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:07.110968 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-89b42ab0-829d-47e9-98ea-068f365f4a12 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18" status: 200 len: 1514 microversion: 2.1 time: 0.195886 Dec 15 13:13:07.111536 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1427/2836] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:06 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18 => generated 1514 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:13:07.152496 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-495d7cd7-47d8-4ce4-b2a6-a6c2e37698b2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:07.153395 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-495d7cd7-47d8-4ce4-b2a6-a6c2e37698b2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: f2dd28d2-09ee-4933-a465-635e1fce0623] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:07.159416 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-495d7cd7-47d8-4ce4-b2a6-a6c2e37698b2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:07.159905 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-495d7cd7-47d8-4ce4-b2a6-a6c2e37698b2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:07.160682 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-495d7cd7-47d8-4ce4-b2a6-a6c2e37698b2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:07.161115 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-495d7cd7-47d8-4ce4-b2a6-a6c2e37698b2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:07.239063 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-495d7cd7-47d8-4ce4-b2a6-a6c2e37698b2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:07.246983 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-495d7cd7-47d8-4ce4-b2a6-a6c2e37698b2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623" status: 200 len: 1270 microversion: 2.1 time: 0.099129 Dec 15 13:13:07.247622 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1410/2837] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:07 2021] GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623 => generated 1270 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:07.341884 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-72c5fcd7-1f36-475e-87e4-5137ff87a225 tempest-VolumesGetTestJSON-923659925 tempest-VolumesGetTestJSON-923659925-project] Action: 'create', calling method: .version_select at 0x7f3c689ea670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-630851339", "metadata": {"Type": "work"}}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:13:07.740171 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-72c5fcd7-1f36-475e-87e4-5137ff87a225 tempest-VolumesGetTestJSON-923659925 tempest-VolumesGetTestJSON-923659925-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.516264 Dec 15 13:13:07.741198 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1428/2838] 10.222.0.76 () {60 vars in 1155 bytes} [Wed Dec 15 13:13:07 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 518 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Dec 15 13:13:07.752935 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fcf475f0-0e93-49f4-862e-8957542a6779 tempest-VolumesGetTestJSON-923659925 tempest-VolumesGetTestJSON-923659925-project] Calling method '.version_select at 0x7f3c6931eaf0>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:07.808125 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fcf475f0-0e93-49f4-862e-8957542a6779 tempest-VolumesGetTestJSON-923659925 tempest-VolumesGetTestJSON-923659925-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/670918d6-987d-495b-8701-ecee33c4ebe5" status: 200 len: 352 microversion: 2.1 time: 0.058643 Dec 15 13:13:07.808708 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1411/2839] 10.222.0.76 () {58 vars in 1244 bytes} [Wed Dec 15 13:13:07 2021] GET /compute/v2.1/os-volumes/670918d6-987d-495b-8701-ecee33c4ebe5 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:13:08.127763 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9a6186ce-dfc1-43a9-a3e3-201036daa0aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:08.128385 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9a6186ce-dfc1-43a9-a3e3-201036daa0aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:08.134479 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9a6186ce-dfc1-43a9-a3e3-201036daa0aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:08.134930 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9a6186ce-dfc1-43a9-a3e3-201036daa0aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:08.136318 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9a6186ce-dfc1-43a9-a3e3-201036daa0aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:08.136758 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9a6186ce-dfc1-43a9-a3e3-201036daa0aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:08.267683 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b5192529-32eb-42df-8619-0854db3f6b0c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:08.269977 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b5192529-32eb-42df-8619-0854db3f6b0c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: f2dd28d2-09ee-4933-a465-635e1fce0623] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:08.279356 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b5192529-32eb-42df-8619-0854db3f6b0c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:08.279810 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b5192529-32eb-42df-8619-0854db3f6b0c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:08.280650 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b5192529-32eb-42df-8619-0854db3f6b0c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:08.281089 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b5192529-32eb-42df-8619-0854db3f6b0c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:08.283908 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9a6186ce-dfc1-43a9-a3e3-201036daa0aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:08.292968 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9a6186ce-dfc1-43a9-a3e3-201036daa0aa tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18" status: 200 len: 1514 microversion: 2.1 time: 0.169097 Dec 15 13:13:08.302836 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1429/2840] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:08 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18 => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:08.355013 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b5192529-32eb-42df-8619-0854db3f6b0c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:08.363998 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b5192529-32eb-42df-8619-0854db3f6b0c tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623" status: 200 len: 1276 microversion: 2.1 time: 0.103585 Dec 15 13:13:08.365156 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1412/2841] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:08 2021] GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623 => generated 1276 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:08.475089 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-98e90cb0-d197-436c-b134-7d50d3879f74 req-b075ef36-4bb4-42be-b29f-9c183cdd68f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83492504-2fc0-4ea0-adeb-387ceb971a18", "name": "network-vif-deleted", "tag": "a2b23d25-387c-46a4-a653-a1777ac34527"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:13:08.477190 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:13:08.477190 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 13:13:08.493794 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-98e90cb0-d197-436c-b134-7d50d3879f74 req-b075ef36-4bb4-42be-b29f-9c183cdd68f8 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:08.494234 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-98e90cb0-d197-436c-b134-7d50d3879f74 req-b075ef36-4bb4-42be-b29f-9c183cdd68f8 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:08.508396 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-98e90cb0-d197-436c-b134-7d50d3879f74 req-b075ef36-4bb4-42be-b29f-9c183cdd68f8 service nova] Creating event network-vif-deleted:a2b23d25-387c-46a4-a653-a1777ac34527 for instance 83492504-2fc0-4ea0-adeb-387ceb971a18 on hv-cinder-81322 Dec 15 13:13:08.516890 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-98e90cb0-d197-436c-b134-7d50d3879f74 req-b075ef36-4bb4-42be-b29f-9c183cdd68f8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045357 Dec 15 13:13:08.517986 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1430/2842] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:13:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:13:08.821823 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b6a727ed-1eaa-4b88-a8ee-8c8fff037d19 tempest-VolumesGetTestJSON-923659925 tempest-VolumesGetTestJSON-923659925-project] Calling method '.version_select at 0x7f3c6931eca0>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:08.871658 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b6a727ed-1eaa-4b88-a8ee-8c8fff037d19 tempest-VolumesGetTestJSON-923659925 tempest-VolumesGetTestJSON-923659925-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/670918d6-987d-495b-8701-ecee33c4ebe5" status: 200 len: 353 microversion: 2.1 time: 0.055067 Dec 15 13:13:08.872636 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1413/2843] 10.222.0.76 () {58 vars in 1244 bytes} [Wed Dec 15 13:13:08 2021] GET /compute/v2.1/os-volumes/670918d6-987d-495b-8701-ecee33c4ebe5 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:13:08.885763 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8ab12be9-fc65-4b0e-b389-d9e31007818a tempest-VolumesGetTestJSON-923659925 tempest-VolumesGetTestJSON-923659925-project] Calling method '.version_select at 0x7f3c68a433a0>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:08.939968 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8ab12be9-fc65-4b0e-b389-d9e31007818a tempest-VolumesGetTestJSON-923659925 tempest-VolumesGetTestJSON-923659925-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/670918d6-987d-495b-8701-ecee33c4ebe5" status: 200 len: 353 microversion: 2.1 time: 0.059976 Dec 15 13:13:08.953670 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1431/2844] 10.222.0.76 () {58 vars in 1244 bytes} [Wed Dec 15 13:13:08 2021] GET /compute/v2.1/os-volumes/670918d6-987d-495b-8701-ecee33c4ebe5 => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:13:08.958629 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-cecd6422-c190-4b42-8bfe-1eb7a1c8e350 tempest-VolumesGetTestJSON-923659925 tempest-VolumesGetTestJSON-923659925-project] Calling method '.version_select at 0x7f3c68868f70>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:09.029349 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cecd6422-c190-4b42-8bfe-1eb7a1c8e350 tempest-VolumesGetTestJSON-923659925 tempest-VolumesGetTestJSON-923659925-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/670918d6-987d-495b-8701-ecee33c4ebe5" status: 202 len: 0 microversion: 2.1 time: 0.074774 Dec 15 13:13:09.030085 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1414/2845] 10.222.0.76 () {58 vars in 1247 bytes} [Wed Dec 15 13:13:08 2021] DELETE /compute/v2.1/os-volumes/670918d6-987d-495b-8701-ecee33c4ebe5 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:13:09.038694 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-bcd80741-bc84-4b5a-9320-8c36ebcad21e tempest-VolumesGetTestJSON-923659925 tempest-VolumesGetTestJSON-923659925-project] Calling method '.version_select at 0x7f3c68903670>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:09.090770 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-bcd80741-bc84-4b5a-9320-8c36ebcad21e tempest-VolumesGetTestJSON-923659925 tempest-VolumesGetTestJSON-923659925-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/670918d6-987d-495b-8701-ecee33c4ebe5" status: 200 len: 352 microversion: 2.1 time: 0.056114 Dec 15 13:13:09.091362 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1432/2846] 10.222.0.76 () {58 vars in 1244 bytes} [Wed Dec 15 13:13:09 2021] GET /compute/v2.1/os-volumes/670918d6-987d-495b-8701-ecee33c4ebe5 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:13:09.309920 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b03adf8b-a734-4853-ab6b-fffa855e25b7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:09.310533 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b03adf8b-a734-4853-ab6b-fffa855e25b7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 83492504-2fc0-4ea0-adeb-387ceb971a18] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:09.317706 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b03adf8b-a734-4853-ab6b-fffa855e25b7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:09.318142 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b03adf8b-a734-4853-ab6b-fffa855e25b7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:09.319448 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b03adf8b-a734-4853-ab6b-fffa855e25b7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:09.319987 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b03adf8b-a734-4853-ab6b-fffa855e25b7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:09.335176 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.wsgi [None req-b03adf8b-a734-4853-ab6b-fffa855e25b7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] HTTP exception thrown: Instance 83492504-2fc0-4ea0-adeb-387ceb971a18 could not be found. Dec 15 13:13:09.335776 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b03adf8b-a734-4853-ab6b-fffa855e25b7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Returning 404 to user: Instance 83492504-2fc0-4ea0-adeb-387ceb971a18 could not be found. {{(pid=122615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:13:09.336602 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b03adf8b-a734-4853-ab6b-fffa855e25b7 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18" status: 404 len: 111 microversion: 2.1 time: 0.030536 Dec 15 13:13:09.337149 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1415/2847] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:09 2021] GET /compute/v2.1/servers/83492504-2fc0-4ea0-adeb-387ceb971a18 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:13:09.346259 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7314c704-dd8a-453d-842e-82fc4eecbc72 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:09.346869 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7314c704-dd8a-453d-842e-82fc4eecbc72 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 20da2f91-d326-43da-9c17-c3b21c20be17] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:09.353564 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7314c704-dd8a-453d-842e-82fc4eecbc72 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:09.354830 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7314c704-dd8a-453d-842e-82fc4eecbc72 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:09.355686 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7314c704-dd8a-453d-842e-82fc4eecbc72 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:09.356127 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7314c704-dd8a-453d-842e-82fc4eecbc72 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:09.381597 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-feafdb83-ad41-4f67-bfb2-bbad7a9d714a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:09.382321 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-feafdb83-ad41-4f67-bfb2-bbad7a9d714a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: f2dd28d2-09ee-4933-a465-635e1fce0623] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:09.388376 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-feafdb83-ad41-4f67-bfb2-bbad7a9d714a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:09.388878 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7314c704-dd8a-453d-842e-82fc4eecbc72 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 20da2f91-d326-43da-9c17-c3b21c20be17] Going to try to terminate instance {{(pid=122614) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:13:09.389386 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-feafdb83-ad41-4f67-bfb2-bbad7a9d714a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:09.390678 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-feafdb83-ad41-4f67-bfb2-bbad7a9d714a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:09.391415 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-feafdb83-ad41-4f67-bfb2-bbad7a9d714a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:09.484808 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7314c704-dd8a-453d-842e-82fc4eecbc72 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "DELETE /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17" status: 204 len: 0 microversion: 2.1 time: 0.142224 Dec 15 13:13:09.485724 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1433/2848] 10.222.0.76 () {58 vars in 1238 bytes} [Wed Dec 15 13:13:09 2021] DELETE /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:13:09.494290 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-52a92dfb-0ea8-4501-955f-e42c21f7f44f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:09.495131 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-52a92dfb-0ea8-4501-955f-e42c21f7f44f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 20da2f91-d326-43da-9c17-c3b21c20be17] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:09.503056 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-52a92dfb-0ea8-4501-955f-e42c21f7f44f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:09.503602 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-52a92dfb-0ea8-4501-955f-e42c21f7f44f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:09.504662 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-52a92dfb-0ea8-4501-955f-e42c21f7f44f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:09.505054 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-52a92dfb-0ea8-4501-955f-e42c21f7f44f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:09.570126 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-feafdb83-ad41-4f67-bfb2-bbad7a9d714a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:09.578081 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-feafdb83-ad41-4f67-bfb2-bbad7a9d714a tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623" status: 200 len: 1318 microversion: 2.1 time: 0.200222 Dec 15 13:13:09.578683 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1416/2849] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:09 2021] GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:13:09.667901 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-52a92dfb-0ea8-4501-955f-e42c21f7f44f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:09.675678 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-52a92dfb-0ea8-4501-955f-e42c21f7f44f tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17" status: 200 len: 1512 microversion: 2.1 time: 0.185865 Dec 15 13:13:09.676255 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1434/2850] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:09 2021] GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17 => generated 1512 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:10.102961 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-771f7e57-e682-4665-b3eb-89e923c843d5 tempest-VolumesGetTestJSON-923659925 tempest-VolumesGetTestJSON-923659925-project] Calling method '.version_select at 0x7f3c68868f70>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:10.130404 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.wsgi [None req-771f7e57-e682-4665-b3eb-89e923c843d5 tempest-VolumesGetTestJSON-923659925 tempest-VolumesGetTestJSON-923659925-project] HTTP exception thrown: Volume 670918d6-987d-495b-8701-ecee33c4ebe5 could not be found. Dec 15 13:13:10.131010 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-771f7e57-e682-4665-b3eb-89e923c843d5 tempest-VolumesGetTestJSON-923659925 tempest-VolumesGetTestJSON-923659925-project] Returning 404 to user: Volume 670918d6-987d-495b-8701-ecee33c4ebe5 could not be found. {{(pid=122615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:13:10.131841 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-771f7e57-e682-4665-b3eb-89e923c843d5 tempest-VolumesGetTestJSON-923659925 tempest-VolumesGetTestJSON-923659925-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/670918d6-987d-495b-8701-ecee33c4ebe5" status: 404 len: 109 microversion: 2.1 time: 0.033082 Dec 15 13:13:10.132402 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1417/2851] 10.222.0.76 () {58 vars in 1244 bytes} [Wed Dec 15 13:13:10 2021] GET /compute/v2.1/os-volumes/670918d6-987d-495b-8701-ecee33c4ebe5 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:13:10.534812 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-8a89dc61-f5b8-45d9-bc8f-6d8874c47e45 req-2e5b5f75-b9dd-471e-98ef-7ab3223006b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2dd28d2-09ee-4933-a465-635e1fce0623", "tag": "c8d4fb02-6820-47d2-8367-76556897a416"}, {"server_uuid": "20da2f91-d326-43da-9c17-c3b21c20be17", "name": "network-vif-deleted", "tag": "352de345-40ab-4c18-9b0d-4a086975638a"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:13:10.537695 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:13:10.537695 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 13:13:10.551021 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-8a89dc61-f5b8-45d9-bc8f-6d8874c47e45 req-2e5b5f75-b9dd-471e-98ef-7ab3223006b0 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:10.551539 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-8a89dc61-f5b8-45d9-bc8f-6d8874c47e45 req-2e5b5f75-b9dd-471e-98ef-7ab3223006b0 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:10.565453 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-8a89dc61-f5b8-45d9-bc8f-6d8874c47e45 req-2e5b5f75-b9dd-471e-98ef-7ab3223006b0 service nova] Creating event network-changed:c8d4fb02-6820-47d2-8367-76556897a416 for instance f2dd28d2-09ee-4933-a465-635e1fce0623 on hv-cinder-81322 Dec 15 13:13:10.566027 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-8a89dc61-f5b8-45d9-bc8f-6d8874c47e45 req-2e5b5f75-b9dd-471e-98ef-7ab3223006b0 service nova] Creating event network-vif-deleted:352de345-40ab-4c18-9b0d-4a086975638a for instance 20da2f91-d326-43da-9c17-c3b21c20be17 on hv-cinder-81322 Dec 15 13:13:10.579160 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-8a89dc61-f5b8-45d9-bc8f-6d8874c47e45 req-2e5b5f75-b9dd-471e-98ef-7ab3223006b0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.048752 Dec 15 13:13:10.579828 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1435/2852] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:13:10 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:13:10.598042 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b78440ba-408c-4984-b33c-ffd45eb42558 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:10.598662 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b78440ba-408c-4984-b33c-ffd45eb42558 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: f2dd28d2-09ee-4933-a465-635e1fce0623] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:10.606457 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b78440ba-408c-4984-b33c-ffd45eb42558 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:10.606940 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b78440ba-408c-4984-b33c-ffd45eb42558 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:10.607766 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b78440ba-408c-4984-b33c-ffd45eb42558 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:10.608226 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b78440ba-408c-4984-b33c-ffd45eb42558 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:10.693977 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8cbd50dc-b134-489a-9805-985c2b4e3bee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:10.694599 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8cbd50dc-b134-489a-9805-985c2b4e3bee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 20da2f91-d326-43da-9c17-c3b21c20be17] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:10.703278 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8cbd50dc-b134-489a-9805-985c2b4e3bee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:10.703810 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8cbd50dc-b134-489a-9805-985c2b4e3bee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:10.704387 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8cbd50dc-b134-489a-9805-985c2b4e3bee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:10.705033 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8cbd50dc-b134-489a-9805-985c2b4e3bee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:10.754979 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8cbd50dc-b134-489a-9805-985c2b4e3bee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:10.755899 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8cbd50dc-b134-489a-9805-985c2b4e3bee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:10.756739 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.objects.instance [None req-8cbd50dc-b134-489a-9805-985c2b4e3bee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lazy-loading 'fault' on Instance uuid 20da2f91-d326-43da-9c17-c3b21c20be17 {{(pid=122614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:13:10.811062 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-8cbd50dc-b134-489a-9805-985c2b4e3bee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:10.819341 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8cbd50dc-b134-489a-9805-985c2b4e3bee tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17" status: 200 len: 1307 microversion: 2.1 time: 0.129626 Dec 15 13:13:10.820092 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1436/2853] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:10 2021] GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17 => generated 1307 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:13:10.848570 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-b78440ba-408c-4984-b33c-ffd45eb42558 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:10.857658 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b78440ba-408c-4984-b33c-ffd45eb42558 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623" status: 200 len: 1318 microversion: 2.1 time: 0.265508 Dec 15 13:13:10.858429 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1418/2854] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:10 2021] GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:11.836300 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1422df8a-4d29-44cb-af61-9f05a9f80918 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:11.836922 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1422df8a-4d29-44cb-af61-9f05a9f80918 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: 20da2f91-d326-43da-9c17-c3b21c20be17] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:11.843483 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1422df8a-4d29-44cb-af61-9f05a9f80918 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:11.843937 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1422df8a-4d29-44cb-af61-9f05a9f80918 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:11.844718 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1422df8a-4d29-44cb-af61-9f05a9f80918 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:11.845153 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1422df8a-4d29-44cb-af61-9f05a9f80918 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:11.861743 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.wsgi [None req-1422df8a-4d29-44cb-af61-9f05a9f80918 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] HTTP exception thrown: Instance 20da2f91-d326-43da-9c17-c3b21c20be17 could not be found. Dec 15 13:13:11.862380 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1422df8a-4d29-44cb-af61-9f05a9f80918 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Returning 404 to user: Instance 20da2f91-d326-43da-9c17-c3b21c20be17 could not be found. {{(pid=122614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:13:11.863210 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1422df8a-4d29-44cb-af61-9f05a9f80918 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17" status: 404 len: 111 microversion: 2.1 time: 0.030549 Dec 15 13:13:11.863756 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1437/2855] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:11 2021] GET /compute/v2.1/servers/20da2f91-d326-43da-9c17-c3b21c20be17 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:13:11.876314 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9209b977-46ed-4196-ab87-240965b129f2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:11.877789 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9209b977-46ed-4196-ab87-240965b129f2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: f2dd28d2-09ee-4933-a465-635e1fce0623] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:11.884600 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9209b977-46ed-4196-ab87-240965b129f2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:11.885316 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9209b977-46ed-4196-ab87-240965b129f2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:11.886379 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9209b977-46ed-4196-ab87-240965b129f2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:11.887080 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9209b977-46ed-4196-ab87-240965b129f2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:12.044399 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9209b977-46ed-4196-ab87-240965b129f2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:12.052079 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9209b977-46ed-4196-ab87-240965b129f2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623" status: 200 len: 1318 microversion: 2.1 time: 0.181689 Dec 15 13:13:12.052760 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1419/2856] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:11 2021] GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:13.014453 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-28007bd6-728f-47dd-ae74-f04e3e9787a8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:13.015241 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-28007bd6-728f-47dd-ae74-f04e3e9787a8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:13.021388 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-28007bd6-728f-47dd-ae74-f04e3e9787a8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:13.021874 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-28007bd6-728f-47dd-ae74-f04e3e9787a8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:13.022678 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-28007bd6-728f-47dd-ae74-f04e3e9787a8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:13.023136 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-28007bd6-728f-47dd-ae74-f04e3e9787a8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:13.050188 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-28007bd6-728f-47dd-ae74-f04e3e9787a8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Going to try to terminate instance {{(pid=122614) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:13:13.068713 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6d8642ae-ee0c-43d4-9bd3-4d1f6f7e9c0e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:13.069328 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6d8642ae-ee0c-43d4-9bd3-4d1f6f7e9c0e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: f2dd28d2-09ee-4933-a465-635e1fce0623] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:13.083863 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d8642ae-ee0c-43d4-9bd3-4d1f6f7e9c0e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:13.084316 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d8642ae-ee0c-43d4-9bd3-4d1f6f7e9c0e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:13.085121 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d8642ae-ee0c-43d4-9bd3-4d1f6f7e9c0e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:13.085585 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6d8642ae-ee0c-43d4-9bd3-4d1f6f7e9c0e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:13.149956 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-28007bd6-728f-47dd-ae74-f04e3e9787a8 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 204 len: 0 microversion: 2.1 time: 0.139482 Dec 15 13:13:13.151425 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1438/2857] 10.222.0.76 () {58 vars in 1238 bytes} [Wed Dec 15 13:13:13 2021] DELETE /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:13:13.159352 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-eba01ca7-61fc-4b0e-8654-947736590a42 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:13.160046 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-eba01ca7-61fc-4b0e-8654-947736590a42 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:13.166319 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eba01ca7-61fc-4b0e-8654-947736590a42 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:13.167326 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eba01ca7-61fc-4b0e-8654-947736590a42 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:13.168112 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eba01ca7-61fc-4b0e-8654-947736590a42 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:13.168550 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eba01ca7-61fc-4b0e-8654-947736590a42 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:13.293722 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6d8642ae-ee0c-43d4-9bd3-4d1f6f7e9c0e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:13.303087 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6d8642ae-ee0c-43d4-9bd3-4d1f6f7e9c0e tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623" status: 200 len: 1318 microversion: 2.1 time: 0.237831 Dec 15 13:13:13.303670 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1420/2858] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:13 2021] GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:13:13.342086 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-eba01ca7-61fc-4b0e-8654-947736590a42 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:13.352589 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-eba01ca7-61fc-4b0e-8654-947736590a42 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1511 microversion: 2.1 time: 0.197120 Dec 15 13:13:13.353166 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1439/2859] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:13 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1511 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:13:14.080256 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [req-ca9876cd-bff9-47b4-958f-5382e9f3a82a req-e81ff214-84c6-464f-b14d-b08297df4b6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d089a72b-31ce-47c8-bb6c-ea26a1c4dde0", "name": "network-vif-deleted", "tag": "90461b16-9e90-4272-a714-ccf84be0bb08"}]} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:13:14.082330 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:13:14.082330 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: warnings.warn(msg) Dec 15 13:13:14.090358 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-ca9876cd-bff9-47b4-958f-5382e9f3a82a req-e81ff214-84c6-464f-b14d-b08297df4b6e service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:14.090804 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-ca9876cd-bff9-47b4-958f-5382e9f3a82a req-e81ff214-84c6-464f-b14d-b08297df4b6e service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:14.104568 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.compute.server_external_events [req-ca9876cd-bff9-47b4-958f-5382e9f3a82a req-e81ff214-84c6-464f-b14d-b08297df4b6e service nova] Creating event network-vif-deleted:90461b16-9e90-4272-a714-ccf84be0bb08 for instance d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 on hv-cinder-81322 Dec 15 13:13:14.111357 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [req-ca9876cd-bff9-47b4-958f-5382e9f3a82a req-e81ff214-84c6-464f-b14d-b08297df4b6e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035446 Dec 15 13:13:14.112124 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1421/2860] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:13:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:13:14.319933 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a03a626a-d2bf-44f3-9257-db2259a5e002 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:14.320552 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a03a626a-d2bf-44f3-9257-db2259a5e002 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: f2dd28d2-09ee-4933-a465-635e1fce0623] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:14.329143 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a03a626a-d2bf-44f3-9257-db2259a5e002 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:14.329822 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a03a626a-d2bf-44f3-9257-db2259a5e002 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:14.330969 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a03a626a-d2bf-44f3-9257-db2259a5e002 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:14.331601 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a03a626a-d2bf-44f3-9257-db2259a5e002 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:14.371187 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-05700c23-d8af-4050-8002-e1d187b1c995 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:14.371906 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-05700c23-d8af-4050-8002-e1d187b1c995 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:14.384443 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-05700c23-d8af-4050-8002-e1d187b1c995 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:14.384443 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-05700c23-d8af-4050-8002-e1d187b1c995 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:14.384443 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-05700c23-d8af-4050-8002-e1d187b1c995 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:14.384443 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-05700c23-d8af-4050-8002-e1d187b1c995 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:14.418317 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-05700c23-d8af-4050-8002-e1d187b1c995 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:14.418768 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-05700c23-d8af-4050-8002-e1d187b1c995 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:14.419219 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.objects.instance [None req-05700c23-d8af-4050-8002-e1d187b1c995 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lazy-loading 'fault' on Instance uuid d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 {{(pid=122615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:13:14.466705 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-05700c23-d8af-4050-8002-e1d187b1c995 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aef34cb7444687acf501f6aedca443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b04b03b8f94235be29043cfb8198ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:14.474570 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-05700c23-d8af-4050-8002-e1d187b1c995 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 200 len: 1306 microversion: 2.1 time: 0.107927 Dec 15 13:13:14.485970 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1422/2861] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:14 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 1306 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:13:14.504025 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a03a626a-d2bf-44f3-9257-db2259a5e002 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:14.513655 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a03a626a-d2bf-44f3-9257-db2259a5e002 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623" status: 200 len: 1318 microversion: 2.1 time: 0.197059 Dec 15 13:13:14.514830 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1440/2862] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:14 2021] GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:15.493092 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d34218f2-adf4-4e81-8a75-b9e29c234de6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:15.493760 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d34218f2-adf4-4e81-8a75-b9e29c234de6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] [instance: d089a72b-31ce-47c8-bb6c-ea26a1c4dde0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:15.500510 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d34218f2-adf4-4e81-8a75-b9e29c234de6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:15.500977 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d34218f2-adf4-4e81-8a75-b9e29c234de6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:15.501789 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d34218f2-adf4-4e81-8a75-b9e29c234de6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:15.502222 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d34218f2-adf4-4e81-8a75-b9e29c234de6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:15.518492 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.wsgi [None req-d34218f2-adf4-4e81-8a75-b9e29c234de6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] HTTP exception thrown: Instance d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 could not be found. Dec 15 13:13:15.519150 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d34218f2-adf4-4e81-8a75-b9e29c234de6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] Returning 404 to user: Instance d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 could not be found. {{(pid=122614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:13:15.519890 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d34218f2-adf4-4e81-8a75-b9e29c234de6 tempest-AttachVolumeNegativeTest-559295750 tempest-AttachVolumeNegativeTest-559295750-project] 10.222.0.76 "GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0" status: 404 len: 111 microversion: 2.1 time: 0.031583 Dec 15 13:13:15.520434 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1441/2863] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:15 2021] GET /compute/v2.1/servers/d089a72b-31ce-47c8-bb6c-ea26a1c4dde0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:13:15.536960 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-81a78c40-18dd-4269-9fce-761636b20345 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:15.537417 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [req-aa08e7b2-e7a3-4439-b3c3-f328d6e0b428 req-b707f639-6567-4672-9aa0-00b426f2ba99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2dd28d2-09ee-4933-a465-635e1fce0623", "name": "network-vif-plugged", "status": "completed", "tag": "c8d4fb02-6820-47d2-8367-76556897a416"}]} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:13:15.537894 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-81a78c40-18dd-4269-9fce-761636b20345 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: f2dd28d2-09ee-4933-a465-635e1fce0623] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:15.538974 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:13:15.538974 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: warnings.warn(msg) Dec 15 13:13:15.544389 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-81a78c40-18dd-4269-9fce-761636b20345 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:15.544845 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-81a78c40-18dd-4269-9fce-761636b20345 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:15.545689 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-81a78c40-18dd-4269-9fce-761636b20345 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:15.546133 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-81a78c40-18dd-4269-9fce-761636b20345 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:15.546248 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-aa08e7b2-e7a3-4439-b3c3-f328d6e0b428 req-b707f639-6567-4672-9aa0-00b426f2ba99 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:15.546649 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-aa08e7b2-e7a3-4439-b3c3-f328d6e0b428 req-b707f639-6567-4672-9aa0-00b426f2ba99 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:15.557994 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.compute.server_external_events [req-aa08e7b2-e7a3-4439-b3c3-f328d6e0b428 req-b707f639-6567-4672-9aa0-00b426f2ba99 service nova] Creating event network-vif-plugged:c8d4fb02-6820-47d2-8367-76556897a416 for instance f2dd28d2-09ee-4933-a465-635e1fce0623 on hv-cinder-81322 Dec 15 13:13:15.563078 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [req-aa08e7b2-e7a3-4439-b3c3-f328d6e0b428 req-b707f639-6567-4672-9aa0-00b426f2ba99 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165385 Dec 15 13:13:15.563704 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1423/2864] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:13:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:13:15.746337 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-81a78c40-18dd-4269-9fce-761636b20345 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:15.754159 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-81a78c40-18dd-4269-9fce-761636b20345 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623" status: 200 len: 1318 microversion: 2.1 time: 0.221123 Dec 15 13:13:15.754863 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1442/2865] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:15 2021] GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:16.773935 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7bc2711c-d84f-458d-80e3-76b486e43099 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:16.774767 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7bc2711c-d84f-458d-80e3-76b486e43099 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: f2dd28d2-09ee-4933-a465-635e1fce0623] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:16.782002 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7bc2711c-d84f-458d-80e3-76b486e43099 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:16.782781 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7bc2711c-d84f-458d-80e3-76b486e43099 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:16.783751 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7bc2711c-d84f-458d-80e3-76b486e43099 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:16.784200 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7bc2711c-d84f-458d-80e3-76b486e43099 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:16.966114 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7bc2711c-d84f-458d-80e3-76b486e43099 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:16.975764 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7bc2711c-d84f-458d-80e3-76b486e43099 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623" status: 200 len: 1318 microversion: 2.1 time: 0.207167 Dec 15 13:13:16.976399 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1424/2866] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:16 2021] GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:17.463755 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-572c1a77-698b-497e-8375-d04f590bcfc0 tempest-VolumesNegativeTest-1151417734 tempest-VolumesNegativeTest-1151417734-project] Action: 'create', calling method: .version_select at 0x7f3c68a03160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1647181955", "metadata": {"Type": "work"}}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:13:17.465219 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-572c1a77-698b-497e-8375-d04f590bcfc0 tempest-VolumesNegativeTest-1151417734 tempest-VolumesNegativeTest-1151417734-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:13:17.466131 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-572c1a77-698b-497e-8375-d04f590bcfc0 tempest-VolumesNegativeTest-1151417734 tempest-VolumesNegativeTest-1151417734-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.121459 Dec 15 13:13:17.466700 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1443/2867] 10.222.0.76 () {60 vars in 1155 bytes} [Wed Dec 15 13:13:17 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:13:17.475555 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0f4101a8-27a1-4946-9eba-69f013a0fccd tempest-VolumesNegativeTest-1151417734 tempest-VolumesNegativeTest-1151417734-project] Action: 'create', calling method: .version_select at 0x7f3c6940a700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1934436746", "metadata": {"Type": "work"}}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:13:17.477049 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0f4101a8-27a1-4946-9eba-69f013a0fccd tempest-VolumesNegativeTest-1151417734 tempest-VolumesNegativeTest-1151417734-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:13:17.477879 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0f4101a8-27a1-4946-9eba-69f013a0fccd tempest-VolumesNegativeTest-1151417734 tempest-VolumesNegativeTest-1151417734-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.005957 Dec 15 13:13:17.478393 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1425/2868] 10.222.0.76 () {60 vars in 1155 bytes} [Wed Dec 15 13:13:17 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:13:17.487138 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b6b0a6dc-dfdc-455c-993f-7fa92288e475 tempest-VolumesNegativeTest-1151417734 tempest-VolumesNegativeTest-1151417734-project] Action: 'create', calling method: .version_select at 0x7f3c68aa10d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1031553988", "metadata": {"Type": "work"}}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:13:17.488248 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b6b0a6dc-dfdc-455c-993f-7fa92288e475 tempest-VolumesNegativeTest-1151417734 tempest-VolumesNegativeTest-1151417734-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:13:17.489025 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b6b0a6dc-dfdc-455c-993f-7fa92288e475 tempest-VolumesNegativeTest-1151417734 tempest-VolumesNegativeTest-1151417734-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005448 Dec 15 13:13:17.489546 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1444/2869] 10.222.0.76 () {60 vars in 1155 bytes} [Wed Dec 15 13:13:17 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 6 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:13:17.498393 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d957e124-5d21-4897-8a5d-068b5bf320fb tempest-VolumesNegativeTest-1151417734 tempest-VolumesNegativeTest-1151417734-project] Calling method '.version_select at 0x7f3c692379d0>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:17.526266 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.wsgi [None req-d957e124-5d21-4897-8a5d-068b5bf320fb tempest-VolumesNegativeTest-1151417734 tempest-VolumesNegativeTest-1151417734-project] HTTP exception thrown: Volume tempest-invalid-438284669 could not be found. Dec 15 13:13:17.526866 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d957e124-5d21-4897-8a5d-068b5bf320fb tempest-VolumesNegativeTest-1151417734 tempest-VolumesNegativeTest-1151417734-project] Returning 404 to user: Volume tempest-invalid-438284669 could not be found. {{(pid=122615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:13:17.528570 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d957e124-5d21-4897-8a5d-068b5bf320fb tempest-VolumesNegativeTest-1151417734 tempest-VolumesNegativeTest-1151417734-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/tempest-invalid-438284669" status: 404 len: 98 microversion: 2.1 time: 0.033684 Dec 15 13:13:17.529154 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1426/2870] 10.222.0.76 () {58 vars in 1214 bytes} [Wed Dec 15 13:13:17 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-438284669 => generated 98 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 15 13:13:17.539149 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-64a2a046-4347-41d3-8ad3-481d5a54e639 tempest-VolumesNegativeTest-1151417734 tempest-VolumesNegativeTest-1151417734-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003457 Dec 15 13:13:17.539638 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1445/2871] 10.222.0.76 () {58 vars in 1139 bytes} [Wed Dec 15 13:13:17 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 15 13:13:17.548461 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cc7110a9-d42f-4108-8f88-1309c2b3b717 tempest-VolumesNegativeTest-1151417734 tempest-VolumesNegativeTest-1151417734-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003725 Dec 15 13:13:17.548944 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1427/2872] 10.222.0.76 () {58 vars in 1136 bytes} [Wed Dec 15 13:13:17 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 15 13:13:17.556603 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-83499faf-5992-4d56-bd65-1f4214784f3d tempest-VolumesNegativeTest-1151417734 tempest-VolumesNegativeTest-1151417734-project] Calling method '.version_select at 0x7f3c6888d280>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:17.584376 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.wsgi [None req-83499faf-5992-4d56-bd65-1f4214784f3d tempest-VolumesNegativeTest-1151417734 tempest-VolumesNegativeTest-1151417734-project] HTTP exception thrown: Volume 89270c9d-df6b-4b3e-b5c6-d80884d658fd could not be found. Dec 15 13:13:17.585070 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-83499faf-5992-4d56-bd65-1f4214784f3d tempest-VolumesNegativeTest-1151417734 tempest-VolumesNegativeTest-1151417734-project] Returning 404 to user: Volume 89270c9d-df6b-4b3e-b5c6-d80884d658fd could not be found. {{(pid=122614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:13:17.585855 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-83499faf-5992-4d56-bd65-1f4214784f3d tempest-VolumesNegativeTest-1151417734 tempest-VolumesNegativeTest-1151417734-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/89270c9d-df6b-4b3e-b5c6-d80884d658fd" status: 404 len: 109 microversion: 2.1 time: 0.032556 Dec 15 13:13:17.586398 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1446/2873] 10.222.0.76 () {58 vars in 1247 bytes} [Wed Dec 15 13:13:17 2021] DELETE /compute/v2.1/os-volumes/89270c9d-df6b-4b3e-b5c6-d80884d658fd => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:13:17.595367 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6b77f65e-575d-4b13-9faf-cd3d169a31fb tempest-VolumesNegativeTest-1151417734 tempest-VolumesNegativeTest-1151417734-project] Calling method '.version_select at 0x7f3c691ef670>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:17.623816 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.wsgi [None req-6b77f65e-575d-4b13-9faf-cd3d169a31fb tempest-VolumesNegativeTest-1151417734 tempest-VolumesNegativeTest-1151417734-project] HTTP exception thrown: Volume 44f3480c-40cc-459d-9d0d-5d5d253a3097 could not be found. Dec 15 13:13:17.624418 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6b77f65e-575d-4b13-9faf-cd3d169a31fb tempest-VolumesNegativeTest-1151417734 tempest-VolumesNegativeTest-1151417734-project] Returning 404 to user: Volume 44f3480c-40cc-459d-9d0d-5d5d253a3097 could not be found. {{(pid=122615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:13:17.625282 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6b77f65e-575d-4b13-9faf-cd3d169a31fb tempest-VolumesNegativeTest-1151417734 tempest-VolumesNegativeTest-1151417734-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/44f3480c-40cc-459d-9d0d-5d5d253a3097" status: 404 len: 109 microversion: 2.1 time: 0.033623 Dec 15 13:13:17.625908 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1428/2874] 10.222.0.76 () {58 vars in 1244 bytes} [Wed Dec 15 13:13:17 2021] GET /compute/v2.1/os-volumes/44f3480c-40cc-459d-9d0d-5d5d253a3097 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:13:17.994174 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-452d359e-91b1-42a6-b39d-50a97eec18bd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:17.994557 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-452d359e-91b1-42a6-b39d-50a97eec18bd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: f2dd28d2-09ee-4933-a465-635e1fce0623] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:18.002277 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-452d359e-91b1-42a6-b39d-50a97eec18bd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:18.002451 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-452d359e-91b1-42a6-b39d-50a97eec18bd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:18.003317 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-452d359e-91b1-42a6-b39d-50a97eec18bd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:18.003773 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-452d359e-91b1-42a6-b39d-50a97eec18bd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:18.152096 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-452d359e-91b1-42a6-b39d-50a97eec18bd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:18.160290 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-452d359e-91b1-42a6-b39d-50a97eec18bd tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623" status: 200 len: 1507 microversion: 2.1 time: 0.170124 Dec 15 13:13:18.160953 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1447/2875] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:17 2021] GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623 => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:18.178196 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8067c54a-1c3a-4565-82b8-d2d82d21e3bf tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6da15ac-c46d-4bdf-953c-26eb16fa3abe", "device": "/dev/sdb"}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:13:18.179293 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8067c54a-1c3a-4565-82b8-d2d82d21e3bf tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: f2dd28d2-09ee-4933-a465-635e1fce0623] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:18.186633 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8067c54a-1c3a-4565-82b8-d2d82d21e3bf tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:18.187039 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8067c54a-1c3a-4565-82b8-d2d82d21e3bf tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:18.188198 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8067c54a-1c3a-4565-82b8-d2d82d21e3bf tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:18.188654 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8067c54a-1c3a-4565-82b8-d2d82d21e3bf tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:18.450228 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8067c54a-1c3a-4565-82b8-d2d82d21e3bf tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "POST /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276458 Dec 15 13:13:18.450923 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1429/2876] 10.222.0.76 () {60 vars in 1322 bytes} [Wed Dec 15 13:13:18 2021] POST /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:13:37.906113 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4998bb69-0e8c-4b73-8b17-cdba83701bac tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:37.906737 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4998bb69-0e8c-4b73-8b17-cdba83701bac tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: f2dd28d2-09ee-4933-a465-635e1fce0623] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:37.912873 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4998bb69-0e8c-4b73-8b17-cdba83701bac tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:37.913316 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4998bb69-0e8c-4b73-8b17-cdba83701bac tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:37.914162 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4998bb69-0e8c-4b73-8b17-cdba83701bac tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:37.914609 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4998bb69-0e8c-4b73-8b17-cdba83701bac tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:37.994662 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.objects.instance [None req-4998bb69-0e8c-4b73-8b17-cdba83701bac tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lazy-loading 'services' on Instance uuid f2dd28d2-09ee-4933-a465-635e1fce0623 {{(pid=122614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:13:38.069490 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4998bb69-0e8c-4b73-8b17-cdba83701bac tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "DELETE /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623/os-volume_attachments/d6da15ac-c46d-4bdf-953c-26eb16fa3abe" status: 202 len: 0 microversion: 2.1 time: 0.167453 Dec 15 13:13:38.070134 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1448/2877] 10.222.0.76 () {58 vars in 1415 bytes} [Wed Dec 15 13:13:37 2021] DELETE /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623/os-volume_attachments/d6da15ac-c46d-4bdf-953c-26eb16fa3abe => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:13:39.220124 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0d304b17-c0d4-4d5b-a929-c0246e2d1052 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:39.220834 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0d304b17-c0d4-4d5b-a929-c0246e2d1052 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: f2dd28d2-09ee-4933-a465-635e1fce0623] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:39.227446 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0d304b17-c0d4-4d5b-a929-c0246e2d1052 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:39.227902 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0d304b17-c0d4-4d5b-a929-c0246e2d1052 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:39.228808 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0d304b17-c0d4-4d5b-a929-c0246e2d1052 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:39.229484 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0d304b17-c0d4-4d5b-a929-c0246e2d1052 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:39.255617 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0d304b17-c0d4-4d5b-a929-c0246e2d1052 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: f2dd28d2-09ee-4933-a465-635e1fce0623] Going to try to terminate instance {{(pid=122615) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:13:39.375433 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0d304b17-c0d4-4d5b-a929-c0246e2d1052 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "DELETE /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623" status: 204 len: 0 microversion: 2.1 time: 0.157967 Dec 15 13:13:39.376081 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1430/2878] 10.222.0.76 () {58 vars in 1238 bytes} [Wed Dec 15 13:13:39 2021] DELETE /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:13:39.386484 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-36f95f7b-a120-4a5e-9dbb-dff9656388e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:39.387239 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-36f95f7b-a120-4a5e-9dbb-dff9656388e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: f2dd28d2-09ee-4933-a465-635e1fce0623] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:39.394871 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-36f95f7b-a120-4a5e-9dbb-dff9656388e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:39.395619 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-36f95f7b-a120-4a5e-9dbb-dff9656388e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:39.396408 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-36f95f7b-a120-4a5e-9dbb-dff9656388e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:39.397019 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-36f95f7b-a120-4a5e-9dbb-dff9656388e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:39.587788 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-36f95f7b-a120-4a5e-9dbb-dff9656388e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:39.597854 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-36f95f7b-a120-4a5e-9dbb-dff9656388e2 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623" status: 200 len: 1513 microversion: 2.1 time: 0.216895 Dec 15 13:13:39.598739 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1449/2879] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:39 2021] GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623 => generated 1513 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:40.615676 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5c2b1963-fc05-45fa-ba82-4414f9032f92 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:40.616568 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5c2b1963-fc05-45fa-ba82-4414f9032f92 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: f2dd28d2-09ee-4933-a465-635e1fce0623] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:40.623722 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5c2b1963-fc05-45fa-ba82-4414f9032f92 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:40.624269 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5c2b1963-fc05-45fa-ba82-4414f9032f92 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:40.625152 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5c2b1963-fc05-45fa-ba82-4414f9032f92 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:40.625826 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5c2b1963-fc05-45fa-ba82-4414f9032f92 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:40.803815 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5c2b1963-fc05-45fa-ba82-4414f9032f92 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:40.812104 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5c2b1963-fc05-45fa-ba82-4414f9032f92 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623" status: 200 len: 1513 microversion: 2.1 time: 0.200544 Dec 15 13:13:40.812679 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1431/2880] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:40 2021] GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623 => generated 1513 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:41.828847 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ea606d74-4b1e-482c-986c-7e9cd014af40 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:41.829455 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ea606d74-4b1e-482c-986c-7e9cd014af40 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: f2dd28d2-09ee-4933-a465-635e1fce0623] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:41.839415 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea606d74-4b1e-482c-986c-7e9cd014af40 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:41.839871 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea606d74-4b1e-482c-986c-7e9cd014af40 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:41.840821 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea606d74-4b1e-482c-986c-7e9cd014af40 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:41.841088 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea606d74-4b1e-482c-986c-7e9cd014af40 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:41.870981 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [req-e935989c-0295-4bfc-a22f-2bc7e89b8daa req-8fc8a8d0-da77-4818-9e5d-1ad0ce177b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2dd28d2-09ee-4933-a465-635e1fce0623", "name": "network-vif-deleted", "tag": "c8d4fb02-6820-47d2-8367-76556897a416"}]} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:13:41.872747 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:13:41.872747 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: warnings.warn(msg) Dec 15 13:13:41.892403 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-e935989c-0295-4bfc-a22f-2bc7e89b8daa req-8fc8a8d0-da77-4818-9e5d-1ad0ce177b9f service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:41.893367 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-e935989c-0295-4bfc-a22f-2bc7e89b8daa req-8fc8a8d0-da77-4818-9e5d-1ad0ce177b9f service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:41.906900 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.compute.server_external_events [req-e935989c-0295-4bfc-a22f-2bc7e89b8daa req-8fc8a8d0-da77-4818-9e5d-1ad0ce177b9f service nova] Creating event network-vif-deleted:c8d4fb02-6820-47d2-8367-76556897a416 for instance f2dd28d2-09ee-4933-a465-635e1fce0623 on hv-cinder-81322 Dec 15 13:13:41.914218 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [req-e935989c-0295-4bfc-a22f-2bc7e89b8daa req-8fc8a8d0-da77-4818-9e5d-1ad0ce177b9f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047992 Dec 15 13:13:41.915325 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1432/2881] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:13:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:13:41.977920 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ea606d74-4b1e-482c-986c-7e9cd014af40 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2438a8e630b743cfb83d57236a266cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd960d0a2e2574caab44c82c717868b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:13:41.988040 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ea606d74-4b1e-482c-986c-7e9cd014af40 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623" status: 200 len: 1471 microversion: 2.1 time: 0.163145 Dec 15 13:13:41.989099 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1450/2882] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:41 2021] GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623 => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:13:43.013400 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a1661403-8c6f-4dab-a078-b24e27662490 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:13:43.016986 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a1661403-8c6f-4dab-a078-b24e27662490 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] [instance: f2dd28d2-09ee-4933-a465-635e1fce0623] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:13:43.036570 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1661403-8c6f-4dab-a078-b24e27662490 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:43.037497 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1661403-8c6f-4dab-a078-b24e27662490 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:43.039056 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1661403-8c6f-4dab-a078-b24e27662490 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:13:43.039711 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a1661403-8c6f-4dab-a078-b24e27662490 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:13:43.055502 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.wsgi [None req-a1661403-8c6f-4dab-a078-b24e27662490 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] HTTP exception thrown: Instance f2dd28d2-09ee-4933-a465-635e1fce0623 could not be found. Dec 15 13:13:43.056954 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a1661403-8c6f-4dab-a078-b24e27662490 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] Returning 404 to user: Instance f2dd28d2-09ee-4933-a465-635e1fce0623 could not be found. {{(pid=122615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:13:43.058029 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a1661403-8c6f-4dab-a078-b24e27662490 tempest-VolumesSnapshotTestJSON-1533117248 tempest-VolumesSnapshotTestJSON-1533117248-project] 10.222.0.76 "GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623" status: 404 len: 111 microversion: 2.1 time: 0.053911 Dec 15 13:13:43.059080 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1433/2883] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:13:43 2021] GET /compute/v2.1/servers/f2dd28d2-09ee-4933-a465-635e1fce0623 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:14:18.134564 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ea25bd42-2782-4043-a465-c7ceac2c09e7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1785761592", "imageRef": "d302555e-2bff-4492-b57d-d59c0097a278", "flavorRef": "452"}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:14:18.191593 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.network.neutron [None req-ea25bd42-2782-4043-a465-c7ceac2c09e7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] validate_networks() for None {{(pid=122614) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:14:18.727579 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-ea25bd42-2782-4043-a465-c7ceac2c09e7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Flavor limits 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:14:18.728181 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-ea25bd42-2782-4043-a465-c7ceac2c09e7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Image limits 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:14:18.729749 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-ea25bd42-2782-4043-a465-c7ceac2c09e7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Flavor pref 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:14:18.730356 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-ea25bd42-2782-4043-a465-c7ceac2c09e7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Image pref 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:14:18.730956 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-ea25bd42-2782-4043-a465-c7ceac2c09e7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:14:18.755617 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea25bd42-2782-4043-a465-c7ceac2c09e7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:18.756084 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea25bd42-2782-4043-a465-c7ceac2c09e7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:18.758290 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea25bd42-2782-4043-a465-c7ceac2c09e7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:18.760523 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ea25bd42-2782-4043-a465-c7ceac2c09e7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:18.810755 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-ea25bd42-2782-4043-a465-c7ceac2c09e7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Getting quotas for project aa263460f238436894d10b266e536f52. Resources: {'instances', 'cores', 'ram'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:14:18.818255 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-ea25bd42-2782-4043-a465-c7ceac2c09e7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Getting quotas for user 539a749e6b334aa28d9cbba18f84ac96 and project aa263460f238436894d10b266e536f52. Resources: {'instances', 'cores', 'ram'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:14:18.849365 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ea25bd42-2782-4043-a465-c7ceac2c09e7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Going to run 1 instances... {{(pid=122614) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:14:18.851812 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ea25bd42-2782-4043-a465-c7ceac2c09e7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d302555e-2bff-4492-b57d-d59c0097a278',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:14:18.934685 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ea25bd42-2782-4043-a465-c7ceac2c09e7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.804225 Dec 15 13:14:18.946408 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0e007fa7-8374-4d7b-880d-8d1e74b64086 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:18.948416 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0e007fa7-8374-4d7b-880d-8d1e74b64086 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:18.951884 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1451/2884] 10.222.0.76 () {60 vars in 1146 bytes} [Wed Dec 15 13:14:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:14:19.420036 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0e007fa7-8374-4d7b-880d-8d1e74b64086 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a749e6b334aa28d9cbba18f84ac96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa263460f238436894d10b266e536f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:19.437303 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0e007fa7-8374-4d7b-880d-8d1e74b64086 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 200 len: 1215 microversion: 2.1 time: 0.495602 Dec 15 13:14:19.437955 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1434/2885] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:18 2021] GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 1215 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:14:20.456023 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-72bea769-6333-400d-968d-fd595e3dfd1b tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:20.456645 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-72bea769-6333-400d-968d-fd595e3dfd1b tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:20.470600 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-72bea769-6333-400d-968d-fd595e3dfd1b tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:20.472325 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-72bea769-6333-400d-968d-fd595e3dfd1b tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:20.473371 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-72bea769-6333-400d-968d-fd595e3dfd1b tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:20.475697 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-72bea769-6333-400d-968d-fd595e3dfd1b tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:20.851984 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-72bea769-6333-400d-968d-fd595e3dfd1b tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a749e6b334aa28d9cbba18f84ac96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa263460f238436894d10b266e536f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:20.860341 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-72bea769-6333-400d-968d-fd595e3dfd1b tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 200 len: 1275 microversion: 2.1 time: 0.408592 Dec 15 13:14:20.878139 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1452/2886] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:20 2021] GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 1275 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:21.883994 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2bfe325f-5d93-47b3-98fb-386435a15f99 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:21.884930 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2bfe325f-5d93-47b3-98fb-386435a15f99 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:21.895569 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2bfe325f-5d93-47b3-98fb-386435a15f99 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:21.897959 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2bfe325f-5d93-47b3-98fb-386435a15f99 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:21.899085 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2bfe325f-5d93-47b3-98fb-386435a15f99 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:21.899749 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2bfe325f-5d93-47b3-98fb-386435a15f99 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:22.203385 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-2bfe325f-5d93-47b3-98fb-386435a15f99 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a749e6b334aa28d9cbba18f84ac96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa263460f238436894d10b266e536f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:22.213788 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2bfe325f-5d93-47b3-98fb-386435a15f99 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 200 len: 1315 microversion: 2.1 time: 0.333537 Dec 15 13:14:22.214700 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1435/2887] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:21 2021] GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:22.689125 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-75433f7f-6ba3-4411-a983-0dd1c8992051 req-02a6c3c4-4c1b-482f-b05d-4dd365cf073e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e82782a-891b-49aa-9231-36f7e2a41065", "tag": "2c120d8c-eb24-4098-b81d-279105b6cedb"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:14:22.694274 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:14:22.694274 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 13:14:22.718617 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-75433f7f-6ba3-4411-a983-0dd1c8992051 req-02a6c3c4-4c1b-482f-b05d-4dd365cf073e service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:22.719074 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-75433f7f-6ba3-4411-a983-0dd1c8992051 req-02a6c3c4-4c1b-482f-b05d-4dd365cf073e service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:22.745102 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-75433f7f-6ba3-4411-a983-0dd1c8992051 req-02a6c3c4-4c1b-482f-b05d-4dd365cf073e service nova] Creating event network-changed:2c120d8c-eb24-4098-b81d-279105b6cedb for instance 8e82782a-891b-49aa-9231-36f7e2a41065 on hv-cinder-81322 Dec 15 13:14:22.750975 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-75433f7f-6ba3-4411-a983-0dd1c8992051 req-02a6c3c4-4c1b-482f-b05d-4dd365cf073e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069319 Dec 15 13:14:22.754839 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1453/2888] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:14:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:14:23.231664 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-dd8efa88-b77b-4321-a968-a5bd812a2ab2 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:23.233655 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-dd8efa88-b77b-4321-a968-a5bd812a2ab2 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:23.245768 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dd8efa88-b77b-4321-a968-a5bd812a2ab2 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:23.246389 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dd8efa88-b77b-4321-a968-a5bd812a2ab2 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:23.247166 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dd8efa88-b77b-4321-a968-a5bd812a2ab2 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:23.247794 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-dd8efa88-b77b-4321-a968-a5bd812a2ab2 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:23.424726 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-dd8efa88-b77b-4321-a968-a5bd812a2ab2 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a749e6b334aa28d9cbba18f84ac96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa263460f238436894d10b266e536f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:23.437842 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-dd8efa88-b77b-4321-a968-a5bd812a2ab2 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 200 len: 1315 microversion: 2.1 time: 0.205831 Dec 15 13:14:23.437842 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1436/2889] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:23 2021] GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:24.451109 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-aae509d1-57ad-4842-aca5-6d2cbead52b7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:24.451724 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-aae509d1-57ad-4842-aca5-6d2cbead52b7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:24.458403 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aae509d1-57ad-4842-aca5-6d2cbead52b7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:24.459047 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aae509d1-57ad-4842-aca5-6d2cbead52b7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:24.463404 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aae509d1-57ad-4842-aca5-6d2cbead52b7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:24.464100 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aae509d1-57ad-4842-aca5-6d2cbead52b7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:24.679681 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-aae509d1-57ad-4842-aca5-6d2cbead52b7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a749e6b334aa28d9cbba18f84ac96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa263460f238436894d10b266e536f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:24.690545 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-aae509d1-57ad-4842-aca5-6d2cbead52b7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 200 len: 1315 microversion: 2.1 time: 0.243617 Dec 15 13:14:24.692412 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1454/2890] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:24 2021] GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:25.709901 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-59cbce8c-4d6f-4a6a-8f9c-c314bd695b65 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:25.711157 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-59cbce8c-4d6f-4a6a-8f9c-c314bd695b65 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:25.720792 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-59cbce8c-4d6f-4a6a-8f9c-c314bd695b65 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:25.721643 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-59cbce8c-4d6f-4a6a-8f9c-c314bd695b65 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:25.723565 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-59cbce8c-4d6f-4a6a-8f9c-c314bd695b65 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:25.724147 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-59cbce8c-4d6f-4a6a-8f9c-c314bd695b65 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:25.894700 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-59cbce8c-4d6f-4a6a-8f9c-c314bd695b65 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a749e6b334aa28d9cbba18f84ac96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa263460f238436894d10b266e536f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:25.903201 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-59cbce8c-4d6f-4a6a-8f9c-c314bd695b65 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 200 len: 1315 microversion: 2.1 time: 0.198818 Dec 15 13:14:25.904008 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1437/2891] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:25 2021] GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:26.921100 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1198cc17-503f-4494-8558-0435ba9910b4 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:26.922366 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1198cc17-503f-4494-8558-0435ba9910b4 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:26.931466 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1198cc17-503f-4494-8558-0435ba9910b4 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:26.932211 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1198cc17-503f-4494-8558-0435ba9910b4 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:26.934238 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1198cc17-503f-4494-8558-0435ba9910b4 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:26.934984 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1198cc17-503f-4494-8558-0435ba9910b4 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:27.101072 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1198cc17-503f-4494-8558-0435ba9910b4 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a749e6b334aa28d9cbba18f84ac96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa263460f238436894d10b266e536f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:27.110250 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1198cc17-503f-4494-8558-0435ba9910b4 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 200 len: 1315 microversion: 2.1 time: 0.193267 Dec 15 13:14:27.120062 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1455/2892] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:26 2021] GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:28.061982 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [req-6a8d94b9-e575-47c8-948d-94228e371c92 req-53f9ea6b-082c-4130-91b9-777facc627ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e82782a-891b-49aa-9231-36f7e2a41065", "name": "network-vif-plugged", "status": "completed", "tag": "2c120d8c-eb24-4098-b81d-279105b6cedb"}]} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:14:28.063746 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:14:28.063746 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: warnings.warn(msg) Dec 15 13:14:28.077955 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-6a8d94b9-e575-47c8-948d-94228e371c92 req-53f9ea6b-082c-4130-91b9-777facc627ec service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:28.078767 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-6a8d94b9-e575-47c8-948d-94228e371c92 req-53f9ea6b-082c-4130-91b9-777facc627ec service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:28.108083 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.compute.server_external_events [req-6a8d94b9-e575-47c8-948d-94228e371c92 req-53f9ea6b-082c-4130-91b9-777facc627ec service nova] Creating event network-vif-plugged:2c120d8c-eb24-4098-b81d-279105b6cedb for instance 8e82782a-891b-49aa-9231-36f7e2a41065 on hv-cinder-81322 Dec 15 13:14:28.115221 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [req-6a8d94b9-e575-47c8-948d-94228e371c92 req-53f9ea6b-082c-4130-91b9-777facc627ec service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056609 Dec 15 13:14:28.116173 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1438/2893] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:14:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:14:28.126978 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f57922ac-d8dd-44b1-9a0a-97a1fb2ff901 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:28.128379 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f57922ac-d8dd-44b1-9a0a-97a1fb2ff901 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:28.139990 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f57922ac-d8dd-44b1-9a0a-97a1fb2ff901 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:28.143044 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f57922ac-d8dd-44b1-9a0a-97a1fb2ff901 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:28.153829 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f57922ac-d8dd-44b1-9a0a-97a1fb2ff901 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:28.154510 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f57922ac-d8dd-44b1-9a0a-97a1fb2ff901 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:28.503647 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f57922ac-d8dd-44b1-9a0a-97a1fb2ff901 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a749e6b334aa28d9cbba18f84ac96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa263460f238436894d10b266e536f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:28.516383 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f57922ac-d8dd-44b1-9a0a-97a1fb2ff901 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 200 len: 1315 microversion: 2.1 time: 0.393360 Dec 15 13:14:28.517225 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1456/2894] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:28 2021] GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:28.840444 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:14:28.840677 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 13:14:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:14:29.534192 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4db694af-1f5f-49e8-b65c-5d709eb84866 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:29.535569 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4db694af-1f5f-49e8-b65c-5d709eb84866 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:29.542558 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4db694af-1f5f-49e8-b65c-5d709eb84866 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:29.543021 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4db694af-1f5f-49e8-b65c-5d709eb84866 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:29.543798 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4db694af-1f5f-49e8-b65c-5d709eb84866 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:29.544234 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4db694af-1f5f-49e8-b65c-5d709eb84866 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:29.713677 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4db694af-1f5f-49e8-b65c-5d709eb84866 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a749e6b334aa28d9cbba18f84ac96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa263460f238436894d10b266e536f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:29.721729 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4db694af-1f5f-49e8-b65c-5d709eb84866 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 200 len: 1315 microversion: 2.1 time: 0.191992 Dec 15 13:14:29.734796 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1439/2895] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:29 2021] GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:30.742115 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-853609ae-fc8c-4a0b-927a-e259e45a3deb tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:30.743416 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-853609ae-fc8c-4a0b-927a-e259e45a3deb tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:30.752557 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-853609ae-fc8c-4a0b-927a-e259e45a3deb tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:30.753811 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-853609ae-fc8c-4a0b-927a-e259e45a3deb tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:30.754697 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-853609ae-fc8c-4a0b-927a-e259e45a3deb tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:30.755345 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-853609ae-fc8c-4a0b-927a-e259e45a3deb tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:30.984022 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-853609ae-fc8c-4a0b-927a-e259e45a3deb tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a749e6b334aa28d9cbba18f84ac96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa263460f238436894d10b266e536f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:30.991841 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-853609ae-fc8c-4a0b-927a-e259e45a3deb tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 200 len: 1315 microversion: 2.1 time: 0.253694 Dec 15 13:14:30.993179 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1457/2896] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:30 2021] GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:32.011280 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a69f7b30-3047-475d-b424-d17500d64d76 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:32.012510 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a69f7b30-3047-475d-b424-d17500d64d76 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:32.019507 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a69f7b30-3047-475d-b424-d17500d64d76 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:32.020196 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a69f7b30-3047-475d-b424-d17500d64d76 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:32.021160 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a69f7b30-3047-475d-b424-d17500d64d76 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:32.021614 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a69f7b30-3047-475d-b424-d17500d64d76 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:32.172779 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-a69f7b30-3047-475d-b424-d17500d64d76 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a749e6b334aa28d9cbba18f84ac96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa263460f238436894d10b266e536f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:32.180942 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a69f7b30-3047-475d-b424-d17500d64d76 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 200 len: 1315 microversion: 2.1 time: 0.173285 Dec 15 13:14:32.190078 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1440/2897] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:32 2021] GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:33.198821 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ca7f6ebe-0df4-45df-8f58-40af085622ba tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:33.199495 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ca7f6ebe-0df4-45df-8f58-40af085622ba tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:33.206306 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ca7f6ebe-0df4-45df-8f58-40af085622ba tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:33.206848 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ca7f6ebe-0df4-45df-8f58-40af085622ba tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:33.207721 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ca7f6ebe-0df4-45df-8f58-40af085622ba tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:33.208268 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ca7f6ebe-0df4-45df-8f58-40af085622ba tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:33.358065 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ca7f6ebe-0df4-45df-8f58-40af085622ba tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a749e6b334aa28d9cbba18f84ac96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa263460f238436894d10b266e536f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:33.364048 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-56846775-2b74-41da-ab37-02ba3a790389 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Action: 'create', calling method: .version_select at 0x7f3c694171f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1860211279"}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:14:33.366387 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ca7f6ebe-0df4-45df-8f58-40af085622ba tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 200 len: 1465 microversion: 2.1 time: 0.172791 Dec 15 13:14:33.368456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1458/2898] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:33 2021] GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 1465 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:33.379581 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-56846775-2b74-41da-ab37-02ba3a790389 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Getting quotas for project d4a88aa79c93452296a538fae9d72a9d. Resources: {'key_pairs'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:14:33.384215 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-56846775-2b74-41da-ab37-02ba3a790389 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Getting quotas for user c111291a474d4a4c9fe72670b335544b and project d4a88aa79c93452296a538fae9d72a9d. Resources: {'key_pairs'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:14:33.407776 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e5528951-3509-47e0-962c-337664103570 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:33.408279 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e5528951-3509-47e0-962c-337664103570 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:33.414388 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e5528951-3509-47e0-962c-337664103570 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:33.414846 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e5528951-3509-47e0-962c-337664103570 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:33.415626 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e5528951-3509-47e0-962c-337664103570 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:33.416057 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e5528951-3509-47e0-962c-337664103570 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:33.441205 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e5528951-3509-47e0-962c-337664103570 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Going to try to terminate instance {{(pid=122614) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:14:33.526628 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e5528951-3509-47e0-962c-337664103570 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "DELETE /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 204 len: 0 microversion: 2.1 time: 0.121987 Dec 15 13:14:33.527592 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1459/2899] 10.222.0.76 () {58 vars in 1238 bytes} [Wed Dec 15 13:14:33 2021] DELETE /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 13:14:33.536177 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fb290fb5-3a8b-4616-9481-3f243a885542 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:33.536878 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fb290fb5-3a8b-4616-9481-3f243a885542 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:33.542732 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fb290fb5-3a8b-4616-9481-3f243a885542 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:33.543179 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fb290fb5-3a8b-4616-9481-3f243a885542 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:33.543959 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fb290fb5-3a8b-4616-9481-3f243a885542 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:33.544396 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fb290fb5-3a8b-4616-9481-3f243a885542 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:33.587599 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-56846775-2b74-41da-ab37-02ba3a790389 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Getting quotas for project d4a88aa79c93452296a538fae9d72a9d. Resources: {'key_pairs'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:14:33.591539 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-56846775-2b74-41da-ab37-02ba3a790389 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Getting quotas for user c111291a474d4a4c9fe72670b335544b and project d4a88aa79c93452296a538fae9d72a9d. Resources: {'key_pairs'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:14:33.604930 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-56846775-2b74-41da-ab37-02ba3a790389 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.245143 Dec 15 13:14:33.605558 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1441/2900] 10.222.0.76 () {60 vars in 1157 bytes} [Wed Dec 15 13:14:33 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:33.667174 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-18d3543d-c15a-40d6-a1e3-31be49d806ab tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-618627290", "imageRef": "4f7dac38-79f4-4402-bce6-cf51bafebec9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1860211279", "networks": [{"uuid": "42a6476d-9989-4792-913c-3a194f373016"}]}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:14:33.707082 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-fb290fb5-3a8b-4616-9481-3f243a885542 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a749e6b334aa28d9cbba18f84ac96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa263460f238436894d10b266e536f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:33.714721 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fb290fb5-3a8b-4616-9481-3f243a885542 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 200 len: 1471 microversion: 2.1 time: 0.182430 Dec 15 13:14:33.715297 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1460/2901] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:33 2021] GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 1471 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:33.731347 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.network.neutron [None req-18d3543d-c15a-40d6-a1e3-31be49d806ab tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] validate_networks() for [('42a6476d-9989-4792-913c-3a194f373016', None, None, None, None, None)] {{(pid=122615) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:14:34.194159 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-18d3543d-c15a-40d6-a1e3-31be49d806ab tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Flavor limits 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:14:34.194575 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-18d3543d-c15a-40d6-a1e3-31be49d806ab tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Image limits 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:14:34.195038 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-18d3543d-c15a-40d6-a1e3-31be49d806ab tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Flavor pref 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:14:34.195446 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-18d3543d-c15a-40d6-a1e3-31be49d806ab tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Image pref 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:14:34.195878 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-18d3543d-c15a-40d6-a1e3-31be49d806ab tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:14:34.204719 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-18d3543d-c15a-40d6-a1e3-31be49d806ab tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:34.205158 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-18d3543d-c15a-40d6-a1e3-31be49d806ab tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:34.205995 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-18d3543d-c15a-40d6-a1e3-31be49d806ab tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:34.206416 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-18d3543d-c15a-40d6-a1e3-31be49d806ab tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:34.222879 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-18d3543d-c15a-40d6-a1e3-31be49d806ab tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Getting quotas for project d4a88aa79c93452296a538fae9d72a9d. Resources: {'instances', 'cores', 'ram'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:14:34.226636 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-18d3543d-c15a-40d6-a1e3-31be49d806ab tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Getting quotas for user c111291a474d4a4c9fe72670b335544b and project d4a88aa79c93452296a538fae9d72a9d. Resources: {'instances', 'cores', 'ram'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:14:34.245931 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-18d3543d-c15a-40d6-a1e3-31be49d806ab tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Going to run 1 instances... {{(pid=122615) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:14:34.248408 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-18d3543d-c15a-40d6-a1e3-31be49d806ab tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f7dac38-79f4-4402-bce6-cf51bafebec9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:14:34.302510 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-18d3543d-c15a-40d6-a1e3-31be49d806ab tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.639462 Dec 15 13:14:34.307640 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1442/2902] 10.222.0.76 () {60 vars in 1146 bytes} [Wed Dec 15 13:14:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 13:14:34.313455 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ead3de81-66b6-49e6-8c7e-30ba67c6f502 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:34.314105 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ead3de81-66b6-49e6-8c7e-30ba67c6f502 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:34.368481 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ead3de81-66b6-49e6-8c7e-30ba67c6f502 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:34.375111 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ead3de81-66b6-49e6-8c7e-30ba67c6f502 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1258 microversion: 2.1 time: 0.065127 Dec 15 13:14:34.375777 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1461/2903] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:34 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:34.733022 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e253a413-0fcd-49cc-bc5d-d40d91f139ef tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:34.733864 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e253a413-0fcd-49cc-bc5d-d40d91f139ef tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:34.740009 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e253a413-0fcd-49cc-bc5d-d40d91f139ef tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:34.740465 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e253a413-0fcd-49cc-bc5d-d40d91f139ef tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:34.741252 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e253a413-0fcd-49cc-bc5d-d40d91f139ef tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:34.741739 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e253a413-0fcd-49cc-bc5d-d40d91f139ef tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:34.884189 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e253a413-0fcd-49cc-bc5d-d40d91f139ef tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a749e6b334aa28d9cbba18f84ac96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa263460f238436894d10b266e536f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:34.892117 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e253a413-0fcd-49cc-bc5d-d40d91f139ef tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 200 len: 1471 microversion: 2.1 time: 0.163401 Dec 15 13:14:34.892699 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1443/2904] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:34 2021] GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:35.398329 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-842b9184-9b4d-41c6-a11c-9a9e20f664d6 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:35.399961 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-842b9184-9b4d-41c6-a11c-9a9e20f664d6 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:35.407339 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-842b9184-9b4d-41c6-a11c-9a9e20f664d6 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:35.408073 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-842b9184-9b4d-41c6-a11c-9a9e20f664d6 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:35.409035 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-842b9184-9b4d-41c6-a11c-9a9e20f664d6 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:35.409646 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-842b9184-9b4d-41c6-a11c-9a9e20f664d6 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:35.483875 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-842b9184-9b4d-41c6-a11c-9a9e20f664d6 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:35.496529 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-842b9184-9b4d-41c6-a11c-9a9e20f664d6 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1328 microversion: 2.1 time: 0.104067 Dec 15 13:14:35.497127 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1462/2905] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:35 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1328 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:35.910428 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4b2c5fcd-c5bf-411d-b746-301c79b5bd7f tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:35.911146 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4b2c5fcd-c5bf-411d-b746-301c79b5bd7f tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:35.922267 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4b2c5fcd-c5bf-411d-b746-301c79b5bd7f tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:35.925882 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4b2c5fcd-c5bf-411d-b746-301c79b5bd7f tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:35.926865 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4b2c5fcd-c5bf-411d-b746-301c79b5bd7f tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:35.927353 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4b2c5fcd-c5bf-411d-b746-301c79b5bd7f tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:36.137772 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4b2c5fcd-c5bf-411d-b746-301c79b5bd7f tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a749e6b334aa28d9cbba18f84ac96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa263460f238436894d10b266e536f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:36.146246 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4b2c5fcd-c5bf-411d-b746-301c79b5bd7f tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 200 len: 1471 microversion: 2.1 time: 0.240286 Dec 15 13:14:36.148385 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1444/2906] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:35 2021] GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 1471 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:36.440205 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-1fe33d44-3dd6-4f39-ae33-21c25bdf6f37 req-feb88c2c-1cc1-4020-aeae-6e0d4f3891c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e82782a-891b-49aa-9231-36f7e2a41065", "name": "network-vif-deleted", "tag": "2c120d8c-eb24-4098-b81d-279105b6cedb"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:14:36.441733 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:14:36.441733 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 13:14:36.462797 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-1fe33d44-3dd6-4f39-ae33-21c25bdf6f37 req-feb88c2c-1cc1-4020-aeae-6e0d4f3891c1 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:36.493864 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-1fe33d44-3dd6-4f39-ae33-21c25bdf6f37 req-feb88c2c-1cc1-4020-aeae-6e0d4f3891c1 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:36.518383 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5d3ac8e5-c16e-4a1e-a579-6a619e440616 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:36.520380 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5d3ac8e5-c16e-4a1e-a579-6a619e440616 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:36.533260 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-1fe33d44-3dd6-4f39-ae33-21c25bdf6f37 req-feb88c2c-1cc1-4020-aeae-6e0d4f3891c1 service nova] Creating event network-vif-deleted:2c120d8c-eb24-4098-b81d-279105b6cedb for instance 8e82782a-891b-49aa-9231-36f7e2a41065 on hv-cinder-81322 Dec 15 13:14:36.542057 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-1fe33d44-3dd6-4f39-ae33-21c25bdf6f37 req-feb88c2c-1cc1-4020-aeae-6e0d4f3891c1 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105145 Dec 15 13:14:36.543196 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1463/2907] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:14:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:14:36.544290 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5d3ac8e5-c16e-4a1e-a579-6a619e440616 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:36.545204 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5d3ac8e5-c16e-4a1e-a579-6a619e440616 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:36.549558 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5d3ac8e5-c16e-4a1e-a579-6a619e440616 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:36.551913 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5d3ac8e5-c16e-4a1e-a579-6a619e440616 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:36.671764 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5d3ac8e5-c16e-4a1e-a579-6a619e440616 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:36.680434 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5d3ac8e5-c16e-4a1e-a579-6a619e440616 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1316 microversion: 2.1 time: 0.169154 Dec 15 13:14:36.692024 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1445/2908] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:36 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1316 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:37.168673 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-28edbdbe-bc90-4d3a-aa18-954154a6934c tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:37.169835 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-28edbdbe-bc90-4d3a-aa18-954154a6934c tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:37.176512 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-28edbdbe-bc90-4d3a-aa18-954154a6934c tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:37.178767 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-28edbdbe-bc90-4d3a-aa18-954154a6934c tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:37.180666 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-28edbdbe-bc90-4d3a-aa18-954154a6934c tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:37.181128 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-28edbdbe-bc90-4d3a-aa18-954154a6934c tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:37.245533 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-28edbdbe-bc90-4d3a-aa18-954154a6934c tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a749e6b334aa28d9cbba18f84ac96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa263460f238436894d10b266e536f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:37.252830 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-28edbdbe-bc90-4d3a-aa18-954154a6934c tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 200 len: 1429 microversion: 2.1 time: 0.089725 Dec 15 13:14:37.253418 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1464/2909] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:37 2021] GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 1429 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:37.699123 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8785027b-d383-4384-a499-d66972fe674c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:37.699798 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8785027b-d383-4384-a499-d66972fe674c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:37.706583 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8785027b-d383-4384-a499-d66972fe674c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:37.707031 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8785027b-d383-4384-a499-d66972fe674c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:37.707824 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8785027b-d383-4384-a499-d66972fe674c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:37.708261 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8785027b-d383-4384-a499-d66972fe674c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:37.868136 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8785027b-d383-4384-a499-d66972fe674c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:37.876508 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8785027b-d383-4384-a499-d66972fe674c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1358 microversion: 2.1 time: 0.181156 Dec 15 13:14:37.877086 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1446/2910] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:37 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:38.270904 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-70f776d3-69ef-4203-954c-338ebc0baedc tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:38.271701 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-70f776d3-69ef-4203-954c-338ebc0baedc tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:38.278756 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-70f776d3-69ef-4203-954c-338ebc0baedc tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:38.279217 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-70f776d3-69ef-4203-954c-338ebc0baedc tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:38.280017 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-70f776d3-69ef-4203-954c-338ebc0baedc tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:38.280465 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-70f776d3-69ef-4203-954c-338ebc0baedc tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:38.355209 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-70f776d3-69ef-4203-954c-338ebc0baedc tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a749e6b334aa28d9cbba18f84ac96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa263460f238436894d10b266e536f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:38.363319 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-70f776d3-69ef-4203-954c-338ebc0baedc tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 200 len: 1429 microversion: 2.1 time: 0.096675 Dec 15 13:14:38.363954 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1465/2911] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:38 2021] GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 1429 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:38.900790 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fc6f2d44-42e2-4fe6-9e6d-53f9d042924a tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:38.901405 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fc6f2d44-42e2-4fe6-9e6d-53f9d042924a tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:38.907951 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fc6f2d44-42e2-4fe6-9e6d-53f9d042924a tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:38.908431 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fc6f2d44-42e2-4fe6-9e6d-53f9d042924a tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:38.909217 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fc6f2d44-42e2-4fe6-9e6d-53f9d042924a tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:38.909679 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fc6f2d44-42e2-4fe6-9e6d-53f9d042924a tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:39.048000 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fc6f2d44-42e2-4fe6-9e6d-53f9d042924a tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:39.056085 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fc6f2d44-42e2-4fe6-9e6d-53f9d042924a tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1358 microversion: 2.1 time: 0.159213 Dec 15 13:14:39.056659 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1447/2912] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:38 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:39.381468 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-85791a9f-90e0-419c-a17e-ba7aa0ab4c55 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:39.382128 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-85791a9f-90e0-419c-a17e-ba7aa0ab4c55 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:39.388521 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-85791a9f-90e0-419c-a17e-ba7aa0ab4c55 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:39.388972 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-85791a9f-90e0-419c-a17e-ba7aa0ab4c55 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:39.389791 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-85791a9f-90e0-419c-a17e-ba7aa0ab4c55 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:39.390489 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-85791a9f-90e0-419c-a17e-ba7aa0ab4c55 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:39.459341 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-85791a9f-90e0-419c-a17e-ba7aa0ab4c55 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a749e6b334aa28d9cbba18f84ac96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa263460f238436894d10b266e536f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:39.472281 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-85791a9f-90e0-419c-a17e-ba7aa0ab4c55 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 200 len: 1429 microversion: 2.1 time: 0.094130 Dec 15 13:14:39.473248 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1466/2913] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:39 2021] GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 1429 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:40.074273 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-63da3cc9-19b1-462b-927d-e5cda6aee25d tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:40.074931 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-63da3cc9-19b1-462b-927d-e5cda6aee25d tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:40.081423 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-63da3cc9-19b1-462b-927d-e5cda6aee25d tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:40.081809 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-63da3cc9-19b1-462b-927d-e5cda6aee25d tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:40.082550 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-63da3cc9-19b1-462b-927d-e5cda6aee25d tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:40.082975 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-63da3cc9-19b1-462b-927d-e5cda6aee25d tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:40.238205 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-63da3cc9-19b1-462b-927d-e5cda6aee25d tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:40.246590 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-63da3cc9-19b1-462b-927d-e5cda6aee25d tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1358 microversion: 2.1 time: 0.177982 Dec 15 13:14:40.248313 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1448/2914] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:40 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:40.498178 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-827277b8-a913-42c6-9705-e7b4940b1109 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:40.498824 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-827277b8-a913-42c6-9705-e7b4940b1109 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:40.505378 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-827277b8-a913-42c6-9705-e7b4940b1109 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:40.505959 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-827277b8-a913-42c6-9705-e7b4940b1109 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:40.506754 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-827277b8-a913-42c6-9705-e7b4940b1109 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:40.507193 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-827277b8-a913-42c6-9705-e7b4940b1109 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:40.569648 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-827277b8-a913-42c6-9705-e7b4940b1109 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a749e6b334aa28d9cbba18f84ac96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa263460f238436894d10b266e536f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:40.577380 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-827277b8-a913-42c6-9705-e7b4940b1109 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 200 len: 1429 microversion: 2.1 time: 0.082999 Dec 15 13:14:40.577968 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1467/2915] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:40 2021] GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 1429 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:41.264130 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-94c75ea9-8967-4238-aa39-85433e8bcd31 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:41.264841 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-94c75ea9-8967-4238-aa39-85433e8bcd31 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:41.271636 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-94c75ea9-8967-4238-aa39-85433e8bcd31 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:41.272081 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-94c75ea9-8967-4238-aa39-85433e8bcd31 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:41.272864 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-94c75ea9-8967-4238-aa39-85433e8bcd31 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:41.273299 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-94c75ea9-8967-4238-aa39-85433e8bcd31 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:41.430711 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-94c75ea9-8967-4238-aa39-85433e8bcd31 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:41.439268 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-94c75ea9-8967-4238-aa39-85433e8bcd31 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1358 microversion: 2.1 time: 0.178714 Dec 15 13:14:41.439857 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1449/2916] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:41 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:41.595212 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7044839a-b800-40f2-81bc-f388d4e5a9e1 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:41.596003 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7044839a-b800-40f2-81bc-f388d4e5a9e1 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:41.604087 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7044839a-b800-40f2-81bc-f388d4e5a9e1 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:41.604554 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7044839a-b800-40f2-81bc-f388d4e5a9e1 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:41.605418 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7044839a-b800-40f2-81bc-f388d4e5a9e1 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:41.605897 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7044839a-b800-40f2-81bc-f388d4e5a9e1 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:41.678418 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7044839a-b800-40f2-81bc-f388d4e5a9e1 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a749e6b334aa28d9cbba18f84ac96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa263460f238436894d10b266e536f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:41.686161 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7044839a-b800-40f2-81bc-f388d4e5a9e1 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 200 len: 1429 microversion: 2.1 time: 0.094856 Dec 15 13:14:41.686730 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1468/2917] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:41 2021] GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 1429 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:42.456048 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-507ef17d-0591-4f42-9c1b-1d301912aac4 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:42.456709 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-507ef17d-0591-4f42-9c1b-1d301912aac4 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:42.463667 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-507ef17d-0591-4f42-9c1b-1d301912aac4 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:42.464114 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-507ef17d-0591-4f42-9c1b-1d301912aac4 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:42.464928 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-507ef17d-0591-4f42-9c1b-1d301912aac4 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:42.465363 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-507ef17d-0591-4f42-9c1b-1d301912aac4 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:42.610782 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-507ef17d-0591-4f42-9c1b-1d301912aac4 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:42.618335 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-507ef17d-0591-4f42-9c1b-1d301912aac4 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1358 microversion: 2.1 time: 0.165919 Dec 15 13:14:42.618901 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1450/2918] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:42 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:42.704103 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7b9795be-6efe-463b-bf39-7d2746dbc8a7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:42.704695 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7b9795be-6efe-463b-bf39-7d2746dbc8a7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:42.711685 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b9795be-6efe-463b-bf39-7d2746dbc8a7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:42.712075 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b9795be-6efe-463b-bf39-7d2746dbc8a7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:42.712869 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b9795be-6efe-463b-bf39-7d2746dbc8a7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:42.713305 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7b9795be-6efe-463b-bf39-7d2746dbc8a7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:42.774932 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7b9795be-6efe-463b-bf39-7d2746dbc8a7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a749e6b334aa28d9cbba18f84ac96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa263460f238436894d10b266e536f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:42.782724 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7b9795be-6efe-463b-bf39-7d2746dbc8a7 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 200 len: 1429 microversion: 2.1 time: 0.082230 Dec 15 13:14:42.783310 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1469/2919] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:42 2021] GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 1429 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:43.635727 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fd4daf62-ee0e-4fea-90ab-f5b0f9c0455c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:43.636618 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fd4daf62-ee0e-4fea-90ab-f5b0f9c0455c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:43.642952 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fd4daf62-ee0e-4fea-90ab-f5b0f9c0455c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:43.643399 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fd4daf62-ee0e-4fea-90ab-f5b0f9c0455c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:43.644165 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fd4daf62-ee0e-4fea-90ab-f5b0f9c0455c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:43.644593 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fd4daf62-ee0e-4fea-90ab-f5b0f9c0455c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:43.798855 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-fd4daf62-ee0e-4fea-90ab-f5b0f9c0455c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:43.799889 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-339ada4d-e745-4c10-b162-cc437c7917a8 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:43.800510 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-339ada4d-e745-4c10-b162-cc437c7917a8 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:43.806923 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fd4daf62-ee0e-4fea-90ab-f5b0f9c0455c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1358 microversion: 2.1 time: 0.175318 Dec 15 13:14:43.807109 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-339ada4d-e745-4c10-b162-cc437c7917a8 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:43.807698 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1451/2920] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:43 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:43.807821 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-339ada4d-e745-4c10-b162-cc437c7917a8 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:43.808447 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-339ada4d-e745-4c10-b162-cc437c7917a8 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:43.808892 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-339ada4d-e745-4c10-b162-cc437c7917a8 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:43.880424 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-339ada4d-e745-4c10-b162-cc437c7917a8 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a749e6b334aa28d9cbba18f84ac96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa263460f238436894d10b266e536f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:43.889001 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-339ada4d-e745-4c10-b162-cc437c7917a8 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 200 len: 1429 microversion: 2.1 time: 0.092414 Dec 15 13:14:43.889637 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1470/2921] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:43 2021] GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 1429 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:14:44.293319 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:14:44.293500 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 13:14:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:14:44.824863 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-58262f6c-73ee-4ca3-ae23-b5ff670a43b2 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:44.825466 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-58262f6c-73ee-4ca3-ae23-b5ff670a43b2 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:44.832311 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-58262f6c-73ee-4ca3-ae23-b5ff670a43b2 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:44.832755 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-58262f6c-73ee-4ca3-ae23-b5ff670a43b2 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:44.833576 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-58262f6c-73ee-4ca3-ae23-b5ff670a43b2 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:44.834012 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-58262f6c-73ee-4ca3-ae23-b5ff670a43b2 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:44.906793 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-46619262-409a-4d18-95db-3e52d613ce2d tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:44.908319 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-46619262-409a-4d18-95db-3e52d613ce2d tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:44.915495 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-46619262-409a-4d18-95db-3e52d613ce2d tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:44.915948 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-46619262-409a-4d18-95db-3e52d613ce2d tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:44.916749 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-46619262-409a-4d18-95db-3e52d613ce2d tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:44.917188 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-46619262-409a-4d18-95db-3e52d613ce2d tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:45.016048 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-46619262-409a-4d18-95db-3e52d613ce2d tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a749e6b334aa28d9cbba18f84ac96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa263460f238436894d10b266e536f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:45.027650 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-46619262-409a-4d18-95db-3e52d613ce2d tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 200 len: 1429 microversion: 2.1 time: 0.124339 Dec 15 13:14:45.030197 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1471/2922] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:44 2021] GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 1429 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:45.038037 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-58262f6c-73ee-4ca3-ae23-b5ff670a43b2 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:45.049746 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-58262f6c-73ee-4ca3-ae23-b5ff670a43b2 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1358 microversion: 2.1 time: 0.228483 Dec 15 13:14:45.050751 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1452/2923] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:44 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:46.052821 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6f87a044-13cc-4d00-844a-2361ccf9d40b tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:46.053446 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6f87a044-13cc-4d00-844a-2361ccf9d40b tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:46.059880 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6f87a044-13cc-4d00-844a-2361ccf9d40b tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:46.061424 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6f87a044-13cc-4d00-844a-2361ccf9d40b tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:46.061424 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6f87a044-13cc-4d00-844a-2361ccf9d40b tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:46.061630 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6f87a044-13cc-4d00-844a-2361ccf9d40b tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:46.066548 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c80db4fc-8b52-4350-894f-484475a3f686 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:46.067216 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c80db4fc-8b52-4350-894f-484475a3f686 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:46.075194 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c80db4fc-8b52-4350-894f-484475a3f686 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:46.075749 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c80db4fc-8b52-4350-894f-484475a3f686 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:46.076749 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c80db4fc-8b52-4350-894f-484475a3f686 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:46.077230 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c80db4fc-8b52-4350-894f-484475a3f686 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:46.163736 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6f87a044-13cc-4d00-844a-2361ccf9d40b tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a749e6b334aa28d9cbba18f84ac96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa263460f238436894d10b266e536f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:46.172310 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6f87a044-13cc-4d00-844a-2361ccf9d40b tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 200 len: 1429 microversion: 2.1 time: 0.122967 Dec 15 13:14:46.172909 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1472/2924] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:46 2021] GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 1429 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:46.255392 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c80db4fc-8b52-4350-894f-484475a3f686 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:46.263808 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c80db4fc-8b52-4350-894f-484475a3f686 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1358 microversion: 2.1 time: 0.201024 Dec 15 13:14:46.277674 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1453/2925] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:46 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:47.190164 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3db8f9e5-9940-44bb-9c67-567ae5b5c3e5 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:47.190912 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3db8f9e5-9940-44bb-9c67-567ae5b5c3e5 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:47.198259 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3db8f9e5-9940-44bb-9c67-567ae5b5c3e5 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:47.198708 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3db8f9e5-9940-44bb-9c67-567ae5b5c3e5 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:47.199487 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3db8f9e5-9940-44bb-9c67-567ae5b5c3e5 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:47.199914 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3db8f9e5-9940-44bb-9c67-567ae5b5c3e5 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:47.265093 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-3db8f9e5-9940-44bb-9c67-567ae5b5c3e5 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a749e6b334aa28d9cbba18f84ac96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa263460f238436894d10b266e536f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:47.279812 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3db8f9e5-9940-44bb-9c67-567ae5b5c3e5 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 200 len: 1429 microversion: 2.1 time: 0.093172 Dec 15 13:14:47.280672 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1473/2926] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:47 2021] GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 1429 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:47.283795 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0c0d0939-9c19-41a0-9b6f-664dc8ed5175 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:47.284986 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0c0d0939-9c19-41a0-9b6f-664dc8ed5175 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:47.291916 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0c0d0939-9c19-41a0-9b6f-664dc8ed5175 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:47.292266 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0c0d0939-9c19-41a0-9b6f-664dc8ed5175 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:47.293168 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0c0d0939-9c19-41a0-9b6f-664dc8ed5175 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:47.293621 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0c0d0939-9c19-41a0-9b6f-664dc8ed5175 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:47.438437 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0c0d0939-9c19-41a0-9b6f-664dc8ed5175 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:47.446273 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0c0d0939-9c19-41a0-9b6f-664dc8ed5175 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1358 microversion: 2.1 time: 0.166162 Dec 15 13:14:47.446845 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1454/2927] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:47 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:14:48.296117 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9d9cc994-6198-4eaf-bf99-ea5c33180961 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:48.297030 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9d9cc994-6198-4eaf-bf99-ea5c33180961 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:48.303822 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9d9cc994-6198-4eaf-bf99-ea5c33180961 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:48.304280 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9d9cc994-6198-4eaf-bf99-ea5c33180961 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:48.305733 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9d9cc994-6198-4eaf-bf99-ea5c33180961 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:48.306351 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9d9cc994-6198-4eaf-bf99-ea5c33180961 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:48.338968 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9d9cc994-6198-4eaf-bf99-ea5c33180961 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:48.339418 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9d9cc994-6198-4eaf-bf99-ea5c33180961 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:48.339869 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.objects.instance [None req-9d9cc994-6198-4eaf-bf99-ea5c33180961 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lazy-loading 'fault' on Instance uuid 8e82782a-891b-49aa-9231-36f7e2a41065 {{(pid=122614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:14:48.380476 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9d9cc994-6198-4eaf-bf99-ea5c33180961 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '539a749e6b334aa28d9cbba18f84ac96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa263460f238436894d10b266e536f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:48.387831 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9d9cc994-6198-4eaf-bf99-ea5c33180961 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 200 len: 1305 microversion: 2.1 time: 0.095473 Dec 15 13:14:48.388652 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1474/2928] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:48 2021] GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 1305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:48.467339 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9f579503-7c36-4c8f-a64f-7fd1b8d44955 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:48.467339 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9f579503-7c36-4c8f-a64f-7fd1b8d44955 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:48.489630 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9f579503-7c36-4c8f-a64f-7fd1b8d44955 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:48.490089 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9f579503-7c36-4c8f-a64f-7fd1b8d44955 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:48.496625 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9f579503-7c36-4c8f-a64f-7fd1b8d44955 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:48.497394 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9f579503-7c36-4c8f-a64f-7fd1b8d44955 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:48.681828 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9f579503-7c36-4c8f-a64f-7fd1b8d44955 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:48.691725 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9f579503-7c36-4c8f-a64f-7fd1b8d44955 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1358 microversion: 2.1 time: 0.232985 Dec 15 13:14:48.692330 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1455/2929] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:48 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:48.725727 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-6b2bcdeb-8ad9-49ff-a493-39720a675b12 req-0201b9b3-5560-467e-abaa-521e53bfae29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f24497-1033-4d38-87da-d583f8f9f1d0", "tag": "29a82cda-8e4f-40a9-b822-2d8a7bea9d87"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:14:48.728056 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:14:48.728056 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 13:14:48.743537 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-6b2bcdeb-8ad9-49ff-a493-39720a675b12 req-0201b9b3-5560-467e-abaa-521e53bfae29 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:48.744630 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-6b2bcdeb-8ad9-49ff-a493-39720a675b12 req-0201b9b3-5560-467e-abaa-521e53bfae29 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:48.757485 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-6b2bcdeb-8ad9-49ff-a493-39720a675b12 req-0201b9b3-5560-467e-abaa-521e53bfae29 service nova] Creating event network-changed:29a82cda-8e4f-40a9-b822-2d8a7bea9d87 for instance 98f24497-1033-4d38-87da-d583f8f9f1d0 on hv-cinder-81322 Dec 15 13:14:48.763384 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-6b2bcdeb-8ad9-49ff-a493-39720a675b12 req-0201b9b3-5560-467e-abaa-521e53bfae29 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041342 Dec 15 13:14:48.765587 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1475/2930] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:14:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:14:49.408916 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3ca845b2-83ee-41eb-baad-1d89e3c26550 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:49.408916 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3ca845b2-83ee-41eb-baad-1d89e3c26550 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] [instance: 8e82782a-891b-49aa-9231-36f7e2a41065] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:49.414032 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3ca845b2-83ee-41eb-baad-1d89e3c26550 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:49.414532 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3ca845b2-83ee-41eb-baad-1d89e3c26550 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:49.415343 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3ca845b2-83ee-41eb-baad-1d89e3c26550 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:49.415774 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3ca845b2-83ee-41eb-baad-1d89e3c26550 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:49.430691 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.wsgi [None req-3ca845b2-83ee-41eb-baad-1d89e3c26550 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] HTTP exception thrown: Instance 8e82782a-891b-49aa-9231-36f7e2a41065 could not be found. Dec 15 13:14:49.431401 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3ca845b2-83ee-41eb-baad-1d89e3c26550 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] Returning 404 to user: Instance 8e82782a-891b-49aa-9231-36f7e2a41065 could not be found. {{(pid=122615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:14:49.432238 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3ca845b2-83ee-41eb-baad-1d89e3c26550 tempest-VolumesNegativeTest-1558762290 tempest-VolumesNegativeTest-1558762290-project] 10.222.0.76 "GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065" status: 404 len: 111 microversion: 2.1 time: 0.029894 Dec 15 13:14:49.432799 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1456/2931] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:49 2021] GET /compute/v2.1/servers/8e82782a-891b-49aa-9231-36f7e2a41065 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:14:49.709152 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-2e25e6c4-c07e-44db-a8bc-0ce8ea99e922 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:49.709890 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-2e25e6c4-c07e-44db-a8bc-0ce8ea99e922 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:49.724276 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2e25e6c4-c07e-44db-a8bc-0ce8ea99e922 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:49.725049 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2e25e6c4-c07e-44db-a8bc-0ce8ea99e922 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:49.726063 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2e25e6c4-c07e-44db-a8bc-0ce8ea99e922 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:49.727122 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-2e25e6c4-c07e-44db-a8bc-0ce8ea99e922 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:49.930256 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-2e25e6c4-c07e-44db-a8bc-0ce8ea99e922 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:49.938882 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-2e25e6c4-c07e-44db-a8bc-0ce8ea99e922 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1358 microversion: 2.1 time: 0.234105 Dec 15 13:14:49.939485 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1476/2932] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:49 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:50.959425 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-91c8a53d-8c87-4e50-9ecc-fb18d67bfbb3 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:50.960032 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-91c8a53d-8c87-4e50-9ecc-fb18d67bfbb3 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:50.966532 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-91c8a53d-8c87-4e50-9ecc-fb18d67bfbb3 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:50.967019 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-91c8a53d-8c87-4e50-9ecc-fb18d67bfbb3 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:50.967825 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-91c8a53d-8c87-4e50-9ecc-fb18d67bfbb3 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:50.968262 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-91c8a53d-8c87-4e50-9ecc-fb18d67bfbb3 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:51.116346 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-91c8a53d-8c87-4e50-9ecc-fb18d67bfbb3 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:51.124979 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-91c8a53d-8c87-4e50-9ecc-fb18d67bfbb3 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1358 microversion: 2.1 time: 0.169177 Dec 15 13:14:51.125581 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1457/2933] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:50 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:52.142377 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7dc77643-d89b-4d8e-94d5-32435c9e77f0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:52.143321 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7dc77643-d89b-4d8e-94d5-32435c9e77f0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:52.153975 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7dc77643-d89b-4d8e-94d5-32435c9e77f0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:52.154406 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7dc77643-d89b-4d8e-94d5-32435c9e77f0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:52.155393 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7dc77643-d89b-4d8e-94d5-32435c9e77f0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:52.155868 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7dc77643-d89b-4d8e-94d5-32435c9e77f0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:52.327463 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7dc77643-d89b-4d8e-94d5-32435c9e77f0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:52.334952 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7dc77643-d89b-4d8e-94d5-32435c9e77f0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1358 microversion: 2.1 time: 0.196381 Dec 15 13:14:52.335561 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1477/2934] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:52 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:53.352539 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4e5d2d0b-b4fa-4266-ada7-6292d4f9b6a6 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:53.353209 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4e5d2d0b-b4fa-4266-ada7-6292d4f9b6a6 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:53.359690 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e5d2d0b-b4fa-4266-ada7-6292d4f9b6a6 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:53.360140 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e5d2d0b-b4fa-4266-ada7-6292d4f9b6a6 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:53.360925 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e5d2d0b-b4fa-4266-ada7-6292d4f9b6a6 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:53.361363 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4e5d2d0b-b4fa-4266-ada7-6292d4f9b6a6 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:53.497849 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4e5d2d0b-b4fa-4266-ada7-6292d4f9b6a6 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:53.505255 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4e5d2d0b-b4fa-4266-ada7-6292d4f9b6a6 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1358 microversion: 2.1 time: 0.156417 Dec 15 13:14:53.505891 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1458/2935] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:53 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:54.333952 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-15bf4c91-e6c9-40c0-be51-9d06140e63ee req-91ba32f1-60ad-4ec8-a244-0440066a3505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f24497-1033-4d38-87da-d583f8f9f1d0", "name": "network-vif-plugged", "status": "completed", "tag": "29a82cda-8e4f-40a9-b822-2d8a7bea9d87"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:14:54.335609 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:14:54.335609 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 13:14:54.344573 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-15bf4c91-e6c9-40c0-be51-9d06140e63ee req-91ba32f1-60ad-4ec8-a244-0440066a3505 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:54.345052 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-15bf4c91-e6c9-40c0-be51-9d06140e63ee req-91ba32f1-60ad-4ec8-a244-0440066a3505 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:54.360562 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-15bf4c91-e6c9-40c0-be51-9d06140e63ee req-91ba32f1-60ad-4ec8-a244-0440066a3505 service nova] Creating event network-vif-plugged:29a82cda-8e4f-40a9-b822-2d8a7bea9d87 for instance 98f24497-1033-4d38-87da-d583f8f9f1d0 on hv-cinder-81322 Dec 15 13:14:54.366813 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-15bf4c91-e6c9-40c0-be51-9d06140e63ee req-91ba32f1-60ad-4ec8-a244-0440066a3505 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036571 Dec 15 13:14:54.367465 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1478/2936] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:14:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:14:54.522508 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-efac966e-6751-4c53-b142-f284a5b3413b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:54.523223 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-efac966e-6751-4c53-b142-f284a5b3413b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:54.529715 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-efac966e-6751-4c53-b142-f284a5b3413b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:54.530169 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-efac966e-6751-4c53-b142-f284a5b3413b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:54.530954 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-efac966e-6751-4c53-b142-f284a5b3413b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:54.531390 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-efac966e-6751-4c53-b142-f284a5b3413b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:54.667277 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-efac966e-6751-4c53-b142-f284a5b3413b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:54.675405 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-efac966e-6751-4c53-b142-f284a5b3413b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1358 microversion: 2.1 time: 0.156445 Dec 15 13:14:54.675980 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1459/2937] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:54 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:55.692913 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ac5106be-fe9c-4b77-9856-2e8f0d116bb9 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:55.693646 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ac5106be-fe9c-4b77-9856-2e8f0d116bb9 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:55.700582 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ac5106be-fe9c-4b77-9856-2e8f0d116bb9 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:55.701039 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ac5106be-fe9c-4b77-9856-2e8f0d116bb9 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:55.701861 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ac5106be-fe9c-4b77-9856-2e8f0d116bb9 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:55.702301 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ac5106be-fe9c-4b77-9856-2e8f0d116bb9 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:55.847451 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ac5106be-fe9c-4b77-9856-2e8f0d116bb9 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:55.855115 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ac5106be-fe9c-4b77-9856-2e8f0d116bb9 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1358 microversion: 2.1 time: 0.166625 Dec 15 13:14:55.855681 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1479/2938] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:55 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:56.872545 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-32ecd0e4-60e1-48ba-9c7f-54032925e565 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:56.873154 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-32ecd0e4-60e1-48ba-9c7f-54032925e565 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:56.879491 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-32ecd0e4-60e1-48ba-9c7f-54032925e565 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:56.879937 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-32ecd0e4-60e1-48ba-9c7f-54032925e565 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:56.880704 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-32ecd0e4-60e1-48ba-9c7f-54032925e565 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:56.881127 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-32ecd0e4-60e1-48ba-9c7f-54032925e565 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:57.014130 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-32ecd0e4-60e1-48ba-9c7f-54032925e565 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:57.021780 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-32ecd0e4-60e1-48ba-9c7f-54032925e565 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1548 microversion: 2.1 time: 0.152989 Dec 15 13:14:57.022341 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1460/2939] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:56 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:57.038192 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6455dd87-4bba-4272-a230-586396cedd71 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:57.039424 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6455dd87-4bba-4272-a230-586396cedd71 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:57.045713 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6455dd87-4bba-4272-a230-586396cedd71 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:57.046175 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6455dd87-4bba-4272-a230-586396cedd71 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:57.046958 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6455dd87-4bba-4272-a230-586396cedd71 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:57.047397 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6455dd87-4bba-4272-a230-586396cedd71 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:57.181617 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6455dd87-4bba-4272-a230-586396cedd71 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:57.188914 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6455dd87-4bba-4272-a230-586396cedd71 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1548 microversion: 2.1 time: 0.154362 Dec 15 13:14:57.189481 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1480/2940] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:57 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:57.204830 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d3d22fc2-b382-4aec-8765-47aa65bebd7a tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:57.208497 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:14:57.208497 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: warnings.warn(msg) Dec 15 13:14:57.209478 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d3d22fc2-b382-4aec-8765-47aa65bebd7a tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:57.210270 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d3d22fc2-b382-4aec-8765-47aa65bebd7a tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Searching by: {'deleted': False, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d'} {{(pid=122615) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 15 13:14:57.223806 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d3d22fc2-b382-4aec-8765-47aa65bebd7a tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:57.224243 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d3d22fc2-b382-4aec-8765-47aa65bebd7a tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:57.225057 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d3d22fc2-b382-4aec-8765-47aa65bebd7a tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:57.225488 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d3d22fc2-b382-4aec-8765-47aa65bebd7a tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:57.320011 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.multi_cell_list [None req-d3d22fc2-b382-4aec-8765-47aa65bebd7a tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122615) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 15 13:14:57.413562 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d3d22fc2-b382-4aec-8765-47aa65bebd7a tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.212236 Dec 15 13:14:57.414694 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1461/2941] 10.222.0.76 () {58 vars in 1124 bytes} [Wed Dec 15 13:14:57 2021] GET /compute/v2.1/servers => generated 342 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:14:57.424785 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8cb4e523-700b-48e4-a195-401e4b90897d tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:14:57.425407 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8cb4e523-700b-48e4-a195-401e4b90897d tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:57.432366 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8cb4e523-700b-48e4-a195-401e4b90897d tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:57.432825 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8cb4e523-700b-48e4-a195-401e4b90897d tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:57.433646 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8cb4e523-700b-48e4-a195-401e4b90897d tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:57.434099 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8cb4e523-700b-48e4-a195-401e4b90897d tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:57.568878 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-8cb4e523-700b-48e4-a195-401e4b90897d tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:14:57.576340 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8cb4e523-700b-48e4-a195-401e4b90897d tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1548 microversion: 2.1 time: 0.155259 Dec 15 13:14:57.576906 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1481/2942] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:14:57 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:14:59.100740 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-14cdd3af-b3de-486f-9325-d9cce5df9df1 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a0b191f-9bf3-4a51-815c-9abcd5e5526c"}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:14:59.102566 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-14cdd3af-b3de-486f-9325-d9cce5df9df1 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:14:59.108394 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-14cdd3af-b3de-486f-9325-d9cce5df9df1 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:59.108836 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-14cdd3af-b3de-486f-9325-d9cce5df9df1 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:59.109639 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-14cdd3af-b3de-486f-9325-d9cce5df9df1 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:14:59.110055 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-14cdd3af-b3de-486f-9325-d9cce5df9df1 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:14:59.356051 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-14cdd3af-b3de-486f-9325-d9cce5df9df1 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "POST /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258468 Dec 15 13:14:59.356909 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1462/2943] 10.222.0.76 () {60 vars in 1322 bytes} [Wed Dec 15 13:14:59 2021] POST /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:15:06.901428 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8a14352d-5299-4dd7-bf43-a739175ebcea tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:15:06.902076 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8a14352d-5299-4dd7-bf43-a739175ebcea tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:15:06.908413 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8a14352d-5299-4dd7-bf43-a739175ebcea tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:06.908859 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8a14352d-5299-4dd7-bf43-a739175ebcea tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:06.909714 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8a14352d-5299-4dd7-bf43-a739175ebcea tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:06.910146 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8a14352d-5299-4dd7-bf43-a739175ebcea tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:07.044957 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-8a14352d-5299-4dd7-bf43-a739175ebcea tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:15:07.053018 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8a14352d-5299-4dd7-bf43-a739175ebcea tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1594 microversion: 2.1 time: 0.155307 Dec 15 13:15:07.053633 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1482/2944] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:15:06 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1594 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:15:09.204837 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [req-9ef5effb-e15b-4674-afbb-b788d95043f9 req-54078d40-ea82-4348-b6d5-491da66fd0ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f24497-1033-4d38-87da-d583f8f9f1d0", "tag": "29a82cda-8e4f-40a9-b822-2d8a7bea9d87"}]} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:15:09.206405 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:15:09.206405 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: warnings.warn(msg) Dec 15 13:15:09.214612 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-9ef5effb-e15b-4674-afbb-b788d95043f9 req-54078d40-ea82-4348-b6d5-491da66fd0ba service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:09.215054 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-9ef5effb-e15b-4674-afbb-b788d95043f9 req-54078d40-ea82-4348-b6d5-491da66fd0ba service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:09.226267 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.compute.server_external_events [req-9ef5effb-e15b-4674-afbb-b788d95043f9 req-54078d40-ea82-4348-b6d5-491da66fd0ba service nova] Creating event network-changed:29a82cda-8e4f-40a9-b822-2d8a7bea9d87 for instance 98f24497-1033-4d38-87da-d583f8f9f1d0 on hv-cinder-81322 Dec 15 13:15:09.231144 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [req-9ef5effb-e15b-4674-afbb-b788d95043f9 req-54078d40-ea82-4348-b6d5-491da66fd0ba service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179142 Dec 15 13:15:09.232048 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1463/2945] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:15:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:15:10.207791 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0bf812c5-9969-4e33-8ec5-bfb83c109e29 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-849567733"}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:15:10.208321 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0bf812c5-9969-4e33-8ec5-bfb83c109e29 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:15:10.215444 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0bf812c5-9969-4e33-8ec5-bfb83c109e29 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:10.215903 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0bf812c5-9969-4e33-8ec5-bfb83c109e29 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:10.216693 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0bf812c5-9969-4e33-8ec5-bfb83c109e29 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:10.217136 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0bf812c5-9969-4e33-8ec5-bfb83c109e29 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:10.359280 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.network.security_group_api [None req-0bf812c5-9969-4e33-8ec5-bfb83c109e29 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Adding security group 55aa7714-2bb4-43a0-a9b6-c8afea89e793 to port 29a82cda-8e4f-40a9-b822-2d8a7bea9d87 Dec 15 13:15:10.734532 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0bf812c5-9969-4e33-8ec5-bfb83c109e29 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "POST /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0/action" status: 202 len: 0 microversion: 2.1 time: 0.530503 Dec 15 13:15:10.735176 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1483/2946] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:15:10 2021] POST /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:15:10.747219 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-137d23e5-e909-4a59-b8c6-d6e1682b389b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:15:10.748039 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-137d23e5-e909-4a59-b8c6-d6e1682b389b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:15:10.761310 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-137d23e5-e909-4a59-b8c6-d6e1682b389b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:10.762236 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-137d23e5-e909-4a59-b8c6-d6e1682b389b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:10.763588 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-137d23e5-e909-4a59-b8c6-d6e1682b389b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:10.764283 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-137d23e5-e909-4a59-b8c6-d6e1682b389b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:10.959289 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-137d23e5-e909-4a59-b8c6-d6e1682b389b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:15:10.968412 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-137d23e5-e909-4a59-b8c6-d6e1682b389b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1758 microversion: 2.1 time: 0.227223 Dec 15 13:15:10.968998 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1464/2947] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:15:10 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1758 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:15:11.248254 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-ba29e871-9aaf-4b4c-83b3-bef279f60292 req-8ded3694-6a85-4e2f-990c-29e935e814fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f24497-1033-4d38-87da-d583f8f9f1d0", "tag": "29a82cda-8e4f-40a9-b822-2d8a7bea9d87"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:15:11.250414 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:15:11.250414 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 13:15:11.258008 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-ba29e871-9aaf-4b4c-83b3-bef279f60292 req-8ded3694-6a85-4e2f-990c-29e935e814fe service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:11.258471 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-ba29e871-9aaf-4b4c-83b3-bef279f60292 req-8ded3694-6a85-4e2f-990c-29e935e814fe service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:11.272077 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-ba29e871-9aaf-4b4c-83b3-bef279f60292 req-8ded3694-6a85-4e2f-990c-29e935e814fe service nova] Creating event network-changed:29a82cda-8e4f-40a9-b822-2d8a7bea9d87 for instance 98f24497-1033-4d38-87da-d583f8f9f1d0 on hv-cinder-81322 Dec 15 13:15:11.277254 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-ba29e871-9aaf-4b4c-83b3-bef279f60292 req-8ded3694-6a85-4e2f-990c-29e935e814fe service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033061 Dec 15 13:15:11.284927 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1484/2948] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:15:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:15:33.526124 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-73ee918a-9a6c-43d1-ad2e-a7a3da6eb97b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:15:33.527034 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-73ee918a-9a6c-43d1-ad2e-a7a3da6eb97b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:15:33.533424 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-73ee918a-9a6c-43d1-ad2e-a7a3da6eb97b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:33.533903 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-73ee918a-9a6c-43d1-ad2e-a7a3da6eb97b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:33.534677 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-73ee918a-9a6c-43d1-ad2e-a7a3da6eb97b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:33.535110 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-73ee918a-9a6c-43d1-ad2e-a7a3da6eb97b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:33.617738 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-73ee918a-9a6c-43d1-ad2e-a7a3da6eb97b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "POST /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0/action" status: 202 len: 0 microversion: 2.1 time: 0.095196 Dec 15 13:15:33.618213 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1465/2949] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:15:33 2021] POST /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:15:33.628094 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-90a9ec86-7a7d-40ae-b681-6f9f453917e0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:15:33.628793 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-90a9ec86-7a7d-40ae-b681-6f9f453917e0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:15:33.638027 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-90a9ec86-7a7d-40ae-b681-6f9f453917e0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:33.638455 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-90a9ec86-7a7d-40ae-b681-6f9f453917e0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:33.639240 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-90a9ec86-7a7d-40ae-b681-6f9f453917e0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:33.640019 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-90a9ec86-7a7d-40ae-b681-6f9f453917e0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:33.796598 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-90a9ec86-7a7d-40ae-b681-6f9f453917e0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:15:33.813191 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-90a9ec86-7a7d-40ae-b681-6f9f453917e0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1750 microversion: 2.1 time: 0.189235 Dec 15 13:15:33.814121 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1485/2950] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:15:33 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1750 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:15:34.832845 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4ec0b5e9-948f-4744-99de-827d01465c1f tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:15:34.833458 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4ec0b5e9-948f-4744-99de-827d01465c1f tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:15:34.840254 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4ec0b5e9-948f-4744-99de-827d01465c1f tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:34.840707 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4ec0b5e9-948f-4744-99de-827d01465c1f tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:34.841489 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4ec0b5e9-948f-4744-99de-827d01465c1f tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:34.841955 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4ec0b5e9-948f-4744-99de-827d01465c1f tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:34.993091 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-4ec0b5e9-948f-4744-99de-827d01465c1f tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:15:35.001371 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4ec0b5e9-948f-4744-99de-827d01465c1f tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1755 microversion: 2.1 time: 0.173028 Dec 15 13:15:35.002178 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1466/2951] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:15:34 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:15:36.020696 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-728af908-1f07-4c7e-bd5f-18bb4b72c5f0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:15:36.021313 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-728af908-1f07-4c7e-bd5f-18bb4b72c5f0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:15:36.027715 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-728af908-1f07-4c7e-bd5f-18bb4b72c5f0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:36.028172 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-728af908-1f07-4c7e-bd5f-18bb4b72c5f0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:36.028947 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-728af908-1f07-4c7e-bd5f-18bb4b72c5f0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:36.029392 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-728af908-1f07-4c7e-bd5f-18bb4b72c5f0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:36.191083 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-728af908-1f07-4c7e-bd5f-18bb4b72c5f0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:15:36.199547 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-728af908-1f07-4c7e-bd5f-18bb4b72c5f0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1755 microversion: 2.1 time: 0.182682 Dec 15 13:15:36.200261 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1486/2952] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:15:36 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:15:37.217438 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-648d6b35-dd13-4f21-9322-80fa29948904 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:15:37.218066 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-648d6b35-dd13-4f21-9322-80fa29948904 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:15:37.224369 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-648d6b35-dd13-4f21-9322-80fa29948904 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:37.224811 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-648d6b35-dd13-4f21-9322-80fa29948904 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:37.226266 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-648d6b35-dd13-4f21-9322-80fa29948904 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:37.226753 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-648d6b35-dd13-4f21-9322-80fa29948904 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:37.375867 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-648d6b35-dd13-4f21-9322-80fa29948904 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:15:37.383533 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-648d6b35-dd13-4f21-9322-80fa29948904 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1755 microversion: 2.1 time: 0.169755 Dec 15 13:15:37.384105 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1467/2953] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:15:37 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:15:38.401721 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-30d92136-deba-4b25-8026-9298b31d7a7c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:15:38.402346 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-30d92136-deba-4b25-8026-9298b31d7a7c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:15:38.409038 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-30d92136-deba-4b25-8026-9298b31d7a7c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:38.409491 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-30d92136-deba-4b25-8026-9298b31d7a7c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:38.410312 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-30d92136-deba-4b25-8026-9298b31d7a7c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:38.410761 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-30d92136-deba-4b25-8026-9298b31d7a7c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:38.562805 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-30d92136-deba-4b25-8026-9298b31d7a7c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:15:38.571264 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-30d92136-deba-4b25-8026-9298b31d7a7c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1755 microversion: 2.1 time: 0.174100 Dec 15 13:15:38.571846 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1487/2954] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:15:38 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:15:39.589366 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ff229574-912d-4c0c-b529-b8815aa9bc44 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:15:39.589964 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ff229574-912d-4c0c-b529-b8815aa9bc44 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:15:39.597044 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ff229574-912d-4c0c-b529-b8815aa9bc44 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:39.597536 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ff229574-912d-4c0c-b529-b8815aa9bc44 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:39.598339 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ff229574-912d-4c0c-b529-b8815aa9bc44 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:39.598768 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ff229574-912d-4c0c-b529-b8815aa9bc44 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:39.747856 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ff229574-912d-4c0c-b529-b8815aa9bc44 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:15:39.756104 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ff229574-912d-4c0c-b529-b8815aa9bc44 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1755 microversion: 2.1 time: 0.170380 Dec 15 13:15:39.756708 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1468/2955] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:15:39 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:15:40.772879 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-837327ed-3331-4013-9e13-ab88edaebd19 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:15:40.773484 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-837327ed-3331-4013-9e13-ab88edaebd19 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:15:40.779996 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-837327ed-3331-4013-9e13-ab88edaebd19 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:40.780472 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-837327ed-3331-4013-9e13-ab88edaebd19 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:40.781261 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-837327ed-3331-4013-9e13-ab88edaebd19 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:40.781736 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-837327ed-3331-4013-9e13-ab88edaebd19 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:40.935415 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-837327ed-3331-4013-9e13-ab88edaebd19 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:15:40.943210 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-837327ed-3331-4013-9e13-ab88edaebd19 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1755 microversion: 2.1 time: 0.173972 Dec 15 13:15:40.943782 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1488/2956] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:15:40 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:15:41.960736 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-21ba0031-d4ec-4402-980c-9d5f7e8bd668 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:15:41.961352 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-21ba0031-d4ec-4402-980c-9d5f7e8bd668 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:15:41.967566 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-21ba0031-d4ec-4402-980c-9d5f7e8bd668 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:41.968008 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-21ba0031-d4ec-4402-980c-9d5f7e8bd668 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:41.968775 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-21ba0031-d4ec-4402-980c-9d5f7e8bd668 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:41.969205 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-21ba0031-d4ec-4402-980c-9d5f7e8bd668 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:42.123826 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-21ba0031-d4ec-4402-980c-9d5f7e8bd668 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:15:42.132477 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-21ba0031-d4ec-4402-980c-9d5f7e8bd668 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1755 microversion: 2.1 time: 0.175270 Dec 15 13:15:42.133233 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1469/2957] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:15:41 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:15:43.151241 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9eccb3b8-bcea-448b-913a-4fec15c37bd3 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:15:43.151847 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9eccb3b8-bcea-448b-913a-4fec15c37bd3 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:15:43.158070 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9eccb3b8-bcea-448b-913a-4fec15c37bd3 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:43.158508 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9eccb3b8-bcea-448b-913a-4fec15c37bd3 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:43.159266 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9eccb3b8-bcea-448b-913a-4fec15c37bd3 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:43.159695 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9eccb3b8-bcea-448b-913a-4fec15c37bd3 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:43.315489 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9eccb3b8-bcea-448b-913a-4fec15c37bd3 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:15:43.323987 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9eccb3b8-bcea-448b-913a-4fec15c37bd3 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1755 microversion: 2.1 time: 0.177646 Dec 15 13:15:43.324561 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1489/2958] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:15:43 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:15:44.341637 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-265c9f19-a00f-4d0c-bfcc-9dfc593748a0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:15:44.342190 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-265c9f19-a00f-4d0c-bfcc-9dfc593748a0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:15:44.348914 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-265c9f19-a00f-4d0c-bfcc-9dfc593748a0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:44.349361 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-265c9f19-a00f-4d0c-bfcc-9dfc593748a0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:44.350446 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-265c9f19-a00f-4d0c-bfcc-9dfc593748a0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:44.350652 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-265c9f19-a00f-4d0c-bfcc-9dfc593748a0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:44.503123 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-265c9f19-a00f-4d0c-bfcc-9dfc593748a0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:15:44.511860 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-265c9f19-a00f-4d0c-bfcc-9dfc593748a0 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1755 microversion: 2.1 time: 0.174040 Dec 15 13:15:44.512446 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1470/2959] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:15:44 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:15:45.529204 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e3af3365-080e-4032-bd5b-9d0af6e139fc tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:15:45.529894 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e3af3365-080e-4032-bd5b-9d0af6e139fc tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:15:45.536251 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e3af3365-080e-4032-bd5b-9d0af6e139fc tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:45.536701 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e3af3365-080e-4032-bd5b-9d0af6e139fc tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:45.537475 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e3af3365-080e-4032-bd5b-9d0af6e139fc tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:15:45.538481 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e3af3365-080e-4032-bd5b-9d0af6e139fc tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:15:45.685751 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e3af3365-080e-4032-bd5b-9d0af6e139fc tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:15:45.693582 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e3af3365-080e-4032-bd5b-9d0af6e139fc tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1758 microversion: 2.1 time: 0.168022 Dec 15 13:15:45.694474 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1490/2960] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:15:45 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:16:18.758430 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a00c6d42-7bd0-418b-857f-ecfd00f3782b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-849567733"}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:16:18.759054 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a00c6d42-7bd0-418b-857f-ecfd00f3782b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:16:18.765267 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a00c6d42-7bd0-418b-857f-ecfd00f3782b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:18.765745 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a00c6d42-7bd0-418b-857f-ecfd00f3782b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:18.766766 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a00c6d42-7bd0-418b-857f-ecfd00f3782b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:18.767194 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a00c6d42-7bd0-418b-857f-ecfd00f3782b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:18.903264 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.network.security_group_api [None req-a00c6d42-7bd0-418b-857f-ecfd00f3782b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Removing security group 55aa7714-2bb4-43a0-a9b6-c8afea89e793 from port 29a82cda-8e4f-40a9-b822-2d8a7bea9d87 Dec 15 13:16:19.258999 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a00c6d42-7bd0-418b-857f-ecfd00f3782b tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "POST /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0/action" status: 202 len: 0 microversion: 2.1 time: 0.505004 Dec 15 13:16:19.268961 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-75e8bef1-4338-4330-b822-bc2d7389a6ee req-0548cb33-a1e6-4ee2-bdec-f74f32211d01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f24497-1033-4d38-87da-d583f8f9f1d0", "tag": "29a82cda-8e4f-40a9-b822-2d8a7bea9d87"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:16:19.279536 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:16:19.279536 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 13:16:19.279829 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1471/2961] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:16:18 2021] POST /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:16:19.291222 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-75e8bef1-4338-4330-b822-bc2d7389a6ee req-0548cb33-a1e6-4ee2-bdec-f74f32211d01 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:19.291665 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-75e8bef1-4338-4330-b822-bc2d7389a6ee req-0548cb33-a1e6-4ee2-bdec-f74f32211d01 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:19.313313 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-75e8bef1-4338-4330-b822-bc2d7389a6ee req-0548cb33-a1e6-4ee2-bdec-f74f32211d01 service nova] Creating event network-changed:29a82cda-8e4f-40a9-b822-2d8a7bea9d87 for instance 98f24497-1033-4d38-87da-d583f8f9f1d0 on hv-cinder-81322 Dec 15 13:16:19.323735 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-75e8bef1-4338-4330-b822-bc2d7389a6ee req-0548cb33-a1e6-4ee2-bdec-f74f32211d01 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058073 Dec 15 13:16:19.324620 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1491/2962] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:16:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:16:20.991291 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5bf21f03-604d-490a-875b-9e5a83e29fd3 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:16:20.992777 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5bf21f03-604d-490a-875b-9e5a83e29fd3 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:16:21.000896 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-f4f8d8d6-f018-45b7-87c5-ed36a573765f req-ac347786-62ac-434c-afc3-650524bb0ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f24497-1033-4d38-87da-d583f8f9f1d0", "tag": "29a82cda-8e4f-40a9-b822-2d8a7bea9d87"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:16:21.000896 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:16:21.000896 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 13:16:21.001591 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5bf21f03-604d-490a-875b-9e5a83e29fd3 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:21.001591 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5bf21f03-604d-490a-875b-9e5a83e29fd3 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:21.001591 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5bf21f03-604d-490a-875b-9e5a83e29fd3 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:21.001591 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5bf21f03-604d-490a-875b-9e5a83e29fd3 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:21.006773 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-f4f8d8d6-f018-45b7-87c5-ed36a573765f req-ac347786-62ac-434c-afc3-650524bb0ae2 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:21.007276 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-f4f8d8d6-f018-45b7-87c5-ed36a573765f req-ac347786-62ac-434c-afc3-650524bb0ae2 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:21.018547 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-f4f8d8d6-f018-45b7-87c5-ed36a573765f req-ac347786-62ac-434c-afc3-650524bb0ae2 service nova] Creating event network-changed:29a82cda-8e4f-40a9-b822-2d8a7bea9d87 for instance 98f24497-1033-4d38-87da-d583f8f9f1d0 on hv-cinder-81322 Dec 15 13:16:21.023865 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-f4f8d8d6-f018-45b7-87c5-ed36a573765f req-ac347786-62ac-434c-afc3-650524bb0ae2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033566 Dec 15 13:16:21.024456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1492/2963] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:16:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:16:21.088382 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.objects.instance [None req-5bf21f03-604d-490a-875b-9e5a83e29fd3 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lazy-loading 'services' on Instance uuid 98f24497-1033-4d38-87da-d583f8f9f1d0 {{(pid=122615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:16:21.168697 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5bf21f03-604d-490a-875b-9e5a83e29fd3 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "DELETE /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0/os-volume_attachments/5a0b191f-9bf3-4a51-815c-9abcd5e5526c" status: 202 len: 0 microversion: 2.1 time: 0.181821 Dec 15 13:16:21.169579 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1472/2964] 10.222.0.76 () {58 vars in 1415 bytes} [Wed Dec 15 13:16:20 2021] DELETE /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0/os-volume_attachments/5a0b191f-9bf3-4a51-815c-9abcd5e5526c => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:16:21.180343 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-25209cd6-efcb-4d83-a0f1-145b6ac4f095 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:16:21.181782 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-25209cd6-efcb-4d83-a0f1-145b6ac4f095 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:16:21.188796 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-25209cd6-efcb-4d83-a0f1-145b6ac4f095 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:21.189601 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-25209cd6-efcb-4d83-a0f1-145b6ac4f095 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:21.190977 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-25209cd6-efcb-4d83-a0f1-145b6ac4f095 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:21.191624 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-25209cd6-efcb-4d83-a0f1-145b6ac4f095 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:21.228248 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-25209cd6-efcb-4d83-a0f1-145b6ac4f095 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054091 Dec 15 13:16:21.228823 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1493/2965] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 13:16:21 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:16:22.240683 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-92bb6dc8-172c-4852-9a11-8eee82a65e9f tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:16:22.242409 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-92bb6dc8-172c-4852-9a11-8eee82a65e9f tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:16:22.252897 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-92bb6dc8-172c-4852-9a11-8eee82a65e9f tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:22.253612 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-92bb6dc8-172c-4852-9a11-8eee82a65e9f tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:22.254835 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-92bb6dc8-172c-4852-9a11-8eee82a65e9f tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:22.255508 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-92bb6dc8-172c-4852-9a11-8eee82a65e9f tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:22.296584 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-92bb6dc8-172c-4852-9a11-8eee82a65e9f tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060372 Dec 15 13:16:22.297163 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1473/2966] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 13:16:22 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:16:22.308902 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d641adb6-1aea-4bcb-9839-3599c815026a tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:16:22.309404 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-d641adb6-1aea-4bcb-9839-3599c815026a tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:16:22.315671 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d641adb6-1aea-4bcb-9839-3599c815026a tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:22.316118 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d641adb6-1aea-4bcb-9839-3599c815026a tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:22.316907 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d641adb6-1aea-4bcb-9839-3599c815026a tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:22.317343 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-d641adb6-1aea-4bcb-9839-3599c815026a tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:22.389382 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.wsgi [None req-d641adb6-1aea-4bcb-9839-3599c815026a tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] HTTP exception thrown: Instance 98f24497-1033-4d38-87da-d583f8f9f1d0 is not attached to volume 5a0b191f-9bf3-4a51-815c-9abcd5e5526c Dec 15 13:16:22.390043 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-d641adb6-1aea-4bcb-9839-3599c815026a tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Returning 404 to user: Instance 98f24497-1033-4d38-87da-d583f8f9f1d0 is not attached to volume 5a0b191f-9bf3-4a51-815c-9abcd5e5526c {{(pid=122614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:16:22.391136 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-d641adb6-1aea-4bcb-9839-3599c815026a tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "DELETE /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0/os-volume_attachments/5a0b191f-9bf3-4a51-815c-9abcd5e5526c" status: 404 len: 154 microversion: 2.1 time: 0.085883 Dec 15 13:16:22.391679 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1494/2967] 10.222.0.76 () {58 vars in 1415 bytes} [Wed Dec 15 13:16:22 2021] DELETE /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0/os-volume_attachments/5a0b191f-9bf3-4a51-815c-9abcd5e5526c => generated 154 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:16:23.521589 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6113dee5-3df9-4cd1-ac70-0ba29e65627c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:16:23.522109 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6113dee5-3df9-4cd1-ac70-0ba29e65627c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:16:23.528280 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6113dee5-3df9-4cd1-ac70-0ba29e65627c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:23.528718 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6113dee5-3df9-4cd1-ac70-0ba29e65627c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:23.529486 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6113dee5-3df9-4cd1-ac70-0ba29e65627c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:23.529938 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6113dee5-3df9-4cd1-ac70-0ba29e65627c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:23.555666 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6113dee5-3df9-4cd1-ac70-0ba29e65627c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Going to try to terminate instance {{(pid=122615) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:16:23.631375 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6113dee5-3df9-4cd1-ac70-0ba29e65627c tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "DELETE /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 204 len: 0 microversion: 2.1 time: 0.112936 Dec 15 13:16:23.632094 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1474/2968] 10.222.0.76 () {58 vars in 1238 bytes} [Wed Dec 15 13:16:23 2021] DELETE /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:16:23.642141 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5b307ba5-d5ac-4bf8-926b-cf7bae5ed337 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:16:23.642833 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5b307ba5-d5ac-4bf8-926b-cf7bae5ed337 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:16:23.650256 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5b307ba5-d5ac-4bf8-926b-cf7bae5ed337 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:23.650731 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5b307ba5-d5ac-4bf8-926b-cf7bae5ed337 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:23.651553 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5b307ba5-d5ac-4bf8-926b-cf7bae5ed337 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:23.652000 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5b307ba5-d5ac-4bf8-926b-cf7bae5ed337 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:23.791622 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5b307ba5-d5ac-4bf8-926b-cf7bae5ed337 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:16:23.798917 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5b307ba5-d5ac-4bf8-926b-cf7bae5ed337 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1554 microversion: 2.1 time: 0.160731 Dec 15 13:16:23.799492 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1495/2969] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:16:23 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:16:24.817579 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1cc59e78-5fd6-4af5-bcc8-108367f7f013 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:16:24.818492 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1cc59e78-5fd6-4af5-bcc8-108367f7f013 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:16:24.825348 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1cc59e78-5fd6-4af5-bcc8-108367f7f013 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:24.825835 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1cc59e78-5fd6-4af5-bcc8-108367f7f013 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:24.826614 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1cc59e78-5fd6-4af5-bcc8-108367f7f013 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:24.827052 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1cc59e78-5fd6-4af5-bcc8-108367f7f013 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:24.962687 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1cc59e78-5fd6-4af5-bcc8-108367f7f013 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:16:24.970425 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1cc59e78-5fd6-4af5-bcc8-108367f7f013 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1554 microversion: 2.1 time: 0.156800 Dec 15 13:16:24.971001 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1475/2970] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:16:24 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:16:25.987439 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ab0eb4d9-44e7-4775-8388-d4ea597ca262 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:16:25.987974 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ab0eb4d9-44e7-4775-8388-d4ea597ca262 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:16:25.995120 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ab0eb4d9-44e7-4775-8388-d4ea597ca262 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:25.995576 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ab0eb4d9-44e7-4775-8388-d4ea597ca262 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:25.996356 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ab0eb4d9-44e7-4775-8388-d4ea597ca262 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:25.996803 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ab0eb4d9-44e7-4775-8388-d4ea597ca262 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:26.063823 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-ab0eb4d9-44e7-4775-8388-d4ea597ca262 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c111291a474d4a4c9fe72670b335544b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a88aa79c93452296a538fae9d72a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:16:26.074113 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ab0eb4d9-44e7-4775-8388-d4ea597ca262 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 200 len: 1512 microversion: 2.1 time: 0.090195 Dec 15 13:16:26.075036 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1496/2971] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:16:25 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 1512 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:16:26.116096 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [req-0126a21d-c962-4a62-8191-87b0b1634556 req-e74cd1ab-4f1c-47a0-99e7-df9159559cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f24497-1033-4d38-87da-d583f8f9f1d0", "name": "network-vif-deleted", "tag": "29a82cda-8e4f-40a9-b822-2d8a7bea9d87"}]} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:16:26.118478 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:16:26.118478 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: warnings.warn(msg) Dec 15 13:16:26.125871 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-0126a21d-c962-4a62-8191-87b0b1634556 req-e74cd1ab-4f1c-47a0-99e7-df9159559cf4 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:26.126734 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-0126a21d-c962-4a62-8191-87b0b1634556 req-e74cd1ab-4f1c-47a0-99e7-df9159559cf4 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:26.139641 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.compute.server_external_events [req-0126a21d-c962-4a62-8191-87b0b1634556 req-e74cd1ab-4f1c-47a0-99e7-df9159559cf4 service nova] Creating event network-vif-deleted:29a82cda-8e4f-40a9-b822-2d8a7bea9d87 for instance 98f24497-1033-4d38-87da-d583f8f9f1d0 on hv-cinder-81322 Dec 15 13:16:26.146559 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [req-0126a21d-c962-4a62-8191-87b0b1634556 req-e74cd1ab-4f1c-47a0-99e7-df9159559cf4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034032 Dec 15 13:16:26.147350 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1476/2972] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:16:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:16:27.091745 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ccd25c5a-789a-4009-b281-4e1c5ece2542 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:16:27.092406 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ccd25c5a-789a-4009-b281-4e1c5ece2542 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] [instance: 98f24497-1033-4d38-87da-d583f8f9f1d0] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:16:27.099241 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ccd25c5a-789a-4009-b281-4e1c5ece2542 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:27.099694 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ccd25c5a-789a-4009-b281-4e1c5ece2542 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:27.100486 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ccd25c5a-789a-4009-b281-4e1c5ece2542 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:16:27.101006 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ccd25c5a-789a-4009-b281-4e1c5ece2542 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:16:27.114613 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.wsgi [None req-ccd25c5a-789a-4009-b281-4e1c5ece2542 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] HTTP exception thrown: Instance 98f24497-1033-4d38-87da-d583f8f9f1d0 could not be found. Dec 15 13:16:27.115208 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ccd25c5a-789a-4009-b281-4e1c5ece2542 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Returning 404 to user: Instance 98f24497-1033-4d38-87da-d583f8f9f1d0 could not be found. {{(pid=122614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:16:27.116036 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ccd25c5a-789a-4009-b281-4e1c5ece2542 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0" status: 404 len: 111 microversion: 2.1 time: 0.028075 Dec 15 13:16:27.116578 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1497/2973] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:16:27 2021] GET /compute/v2.1/servers/98f24497-1033-4d38-87da-d583f8f9f1d0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:16:27.125044 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7a7ad577-f112-4d45-a838-e87786fb7a81 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] Calling method '.version_select at 0x7f3c6958d040>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:16:27.144005 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7a7ad577-f112-4d45-a838-e87786fb7a81 tempest-TestMinimumBasicScenario-1138402011 tempest-TestMinimumBasicScenario-1138402011-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1860211279" status: 202 len: 0 microversion: 2.1 time: 0.022767 Dec 15 13:16:27.144606 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1477/2974] 10.222.0.76 () {58 vars in 1271 bytes} [Wed Dec 15 13:16:27 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1860211279 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:17:00.850791 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4c0a9b29-d22d-449f-8010-a8e9e2540b93 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:00.851338 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4c0a9b29-d22d-449f-8010-a8e9e2540b93 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:00.857974 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4c0a9b29-d22d-449f-8010-a8e9e2540b93 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:00.858411 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4c0a9b29-d22d-449f-8010-a8e9e2540b93 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:00.859186 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4c0a9b29-d22d-449f-8010-a8e9e2540b93 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:00.859614 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4c0a9b29-d22d-449f-8010-a8e9e2540b93 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:00.873848 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.wsgi [None req-4c0a9b29-d22d-449f-8010-a8e9e2540b93 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] HTTP exception thrown: Instance 25f24920-c5f0-4998-abf1-1f4619400206 could not be found. Dec 15 13:17:00.874363 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4c0a9b29-d22d-449f-8010-a8e9e2540b93 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Returning 404 to user: Instance 25f24920-c5f0-4998-abf1-1f4619400206 could not be found. {{(pid=122614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:17:00.875239 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4c0a9b29-d22d-449f-8010-a8e9e2540b93 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "DELETE /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206" status: 404 len: 111 microversion: 2.20 time: 0.028333 Dec 15 13:17:00.875809 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1498/2975] 10.222.0.76 () {60 vars in 1279 bytes} [Wed Dec 15 13:17:00 2021] DELETE /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:17:00.884641 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a2eaccfa-3195-43b0-a6b6-bf97201cf00b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:00.885374 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-a2eaccfa-3195-43b0-a6b6-bf97201cf00b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: 25f24920-c5f0-4998-abf1-1f4619400206] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:00.892236 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a2eaccfa-3195-43b0-a6b6-bf97201cf00b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:00.892683 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a2eaccfa-3195-43b0-a6b6-bf97201cf00b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:00.893461 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a2eaccfa-3195-43b0-a6b6-bf97201cf00b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:00.893941 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-a2eaccfa-3195-43b0-a6b6-bf97201cf00b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:00.906691 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.wsgi [None req-a2eaccfa-3195-43b0-a6b6-bf97201cf00b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] HTTP exception thrown: Instance 25f24920-c5f0-4998-abf1-1f4619400206 could not be found. Dec 15 13:17:00.907273 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-a2eaccfa-3195-43b0-a6b6-bf97201cf00b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Returning 404 to user: Instance 25f24920-c5f0-4998-abf1-1f4619400206 could not be found. {{(pid=122615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:17:00.908089 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-a2eaccfa-3195-43b0-a6b6-bf97201cf00b tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206" status: 404 len: 111 microversion: 2.20 time: 0.028014 Dec 15 13:17:00.908621 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1478/2976] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 13:17:00 2021] GET /compute/v2.1/servers/25f24920-c5f0-4998-abf1-1f4619400206 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:17:02.043275 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b0870ebb-ffa0-46d6-ab68-fe1af0520c62 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:02.043819 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b0870ebb-ffa0-46d6-ab68-fe1af0520c62 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:02.050340 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b0870ebb-ffa0-46d6-ab68-fe1af0520c62 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:02.050804 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b0870ebb-ffa0-46d6-ab68-fe1af0520c62 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:02.051592 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b0870ebb-ffa0-46d6-ab68-fe1af0520c62 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:02.052031 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b0870ebb-ffa0-46d6-ab68-fe1af0520c62 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:02.066456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.wsgi [None req-b0870ebb-ffa0-46d6-ab68-fe1af0520c62 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] HTTP exception thrown: Instance ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 could not be found. Dec 15 13:17:02.067043 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b0870ebb-ffa0-46d6-ab68-fe1af0520c62 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Returning 404 to user: Instance ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 could not be found. {{(pid=122614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:17:02.067901 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b0870ebb-ffa0-46d6-ab68-fe1af0520c62 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 404 len: 111 microversion: 2.20 time: 0.028477 Dec 15 13:17:02.068444 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1499/2977] 10.222.0.76 () {60 vars in 1279 bytes} [Wed Dec 15 13:17:02 2021] DELETE /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 15 13:17:02.077435 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c2c72e23-83f0-4736-b944-97c91efb6602 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:02.078170 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c2c72e23-83f0-4736-b944-97c91efb6602 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] [instance: ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:02.084697 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2c72e23-83f0-4736-b944-97c91efb6602 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:02.085144 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2c72e23-83f0-4736-b944-97c91efb6602 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:02.086029 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2c72e23-83f0-4736-b944-97c91efb6602 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:02.086457 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2c72e23-83f0-4736-b944-97c91efb6602 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:02.101264 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.wsgi [None req-c2c72e23-83f0-4736-b944-97c91efb6602 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] HTTP exception thrown: Instance ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 could not be found. Dec 15 13:17:02.101943 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c2c72e23-83f0-4736-b944-97c91efb6602 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] Returning 404 to user: Instance ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 could not be found. {{(pid=122615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:17:02.102745 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c2c72e23-83f0-4736-b944-97c91efb6602 tempest-AttachVolumeShelveTestJSON-1753660501 tempest-AttachVolumeShelveTestJSON-1753660501-project] 10.222.0.76 "GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2" status: 404 len: 111 microversion: 2.20 time: 0.029227 Dec 15 13:17:02.103371 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1479/2978] 10.222.0.76 () {60 vars in 1276 bytes} [Wed Dec 15 13:17:02 2021] GET /compute/v2.1/servers/ecc10eaf-3387-4dd6-bd31-7ed562e0b2a2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:17:11.308154 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-83b8c171-c05e-4412-8c63-c0cc6032dad3 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'create', calling method: .version_select at 0x7f3c68c04b80>, body: {"keypair": {"name": "tempest-keypair-547748653"}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:11.322459 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-83b8c171-c05e-4412-8c63-c0cc6032dad3 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Getting quotas for project e14d0b1e292642178957ec76e117319f. Resources: {'key_pairs'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:17:11.326466 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-83b8c171-c05e-4412-8c63-c0cc6032dad3 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Getting quotas for user c2e8e15913354e24ac86a7d6ad02960f and project e14d0b1e292642178957ec76e117319f. Resources: {'key_pairs'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:17:11.772130 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-83b8c171-c05e-4412-8c63-c0cc6032dad3 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Getting quotas for project e14d0b1e292642178957ec76e117319f. Resources: {'key_pairs'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:17:11.784167 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-83b8c171-c05e-4412-8c63-c0cc6032dad3 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Getting quotas for user c2e8e15913354e24ac86a7d6ad02960f and project e14d0b1e292642178957ec76e117319f. Resources: {'key_pairs'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:17:11.798213 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-83b8c171-c05e-4412-8c63-c0cc6032dad3 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.628140 Dec 15 13:17:11.798587 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1500/2979] 10.222.0.76 () {60 vars in 1157 bytes} [Wed Dec 15 13:17:11 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:17:13.403926 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-070de84c-eb72-42a8-9c92-94a356d9c3f5 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1544418145", "imageRef": "d302555e-2bff-4492-b57d-d59c0097a278", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4748d35a-8673-45a0-b07b-cb658dfc749d"}], "security_groups": [{"name": "tempest-securitygroup--1695479038"}], "key_name": "tempest-keypair-547748653", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:13.513632 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.network.neutron [None req-070de84c-eb72-42a8-9c92-94a356d9c3f5 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] validate_networks() for [('4748d35a-8673-45a0-b07b-cb658dfc749d', None, None, None, None, None)] {{(pid=122615) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:17:13.924693 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-070de84c-eb72-42a8-9c92-94a356d9c3f5 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Flavor limits 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:17:13.925251 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-070de84c-eb72-42a8-9c92-94a356d9c3f5 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Image limits 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:17:13.925909 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-070de84c-eb72-42a8-9c92-94a356d9c3f5 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Flavor pref 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:17:13.926430 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-070de84c-eb72-42a8-9c92-94a356d9c3f5 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Image pref 0:0:0 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:17:13.926990 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.virt.hardware [None req-070de84c-eb72-42a8-9c92-94a356d9c3f5 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:17:13.942046 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-070de84c-eb72-42a8-9c92-94a356d9c3f5 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:13.942487 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-070de84c-eb72-42a8-9c92-94a356d9c3f5 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:13.943294 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-070de84c-eb72-42a8-9c92-94a356d9c3f5 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:13.943722 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-070de84c-eb72-42a8-9c92-94a356d9c3f5 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:13.963918 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-070de84c-eb72-42a8-9c92-94a356d9c3f5 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Getting quotas for project e14d0b1e292642178957ec76e117319f. Resources: {'instances', 'cores', 'ram'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:17:13.968869 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-070de84c-eb72-42a8-9c92-94a356d9c3f5 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Getting quotas for user c2e8e15913354e24ac86a7d6ad02960f and project e14d0b1e292642178957ec76e117319f. Resources: {'instances', 'cores', 'ram'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:17:13.982801 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-070de84c-eb72-42a8-9c92-94a356d9c3f5 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Going to run 1 instances... {{(pid=122615) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:17:13.985154 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-070de84c-eb72-42a8-9c92-94a356d9c3f5 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d302555e-2bff-4492-b57d-d59c0097a278',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:17:14.040470 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-070de84c-eb72-42a8-9c92-94a356d9c3f5 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.639643 Dec 15 13:17:14.041849 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1480/2980] 10.222.0.76 () {60 vars in 1146 bytes} [Wed Dec 15 13:17:13 2021] POST /compute/v2.1/servers => generated 402 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:17:14.051902 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-417d5d87-8fd4-4c2b-b72f-69d409e5fc12 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:14.052535 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-417d5d87-8fd4-4c2b-b72f-69d409e5fc12 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:14.147441 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-417d5d87-8fd4-4c2b-b72f-69d409e5fc12 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:17:14.156595 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-417d5d87-8fd4-4c2b-b72f-69d409e5fc12 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1237 microversion: 2.1 time: 0.109069 Dec 15 13:17:14.166074 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1501/2981] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:17:14 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1237 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:17:15.174713 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-95796d1f-97fa-4eee-b891-dda16ac60797 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:15.175943 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-95796d1f-97fa-4eee-b891-dda16ac60797 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:15.183096 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-95796d1f-97fa-4eee-b891-dda16ac60797 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:15.183537 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-95796d1f-97fa-4eee-b891-dda16ac60797 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:15.184306 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-95796d1f-97fa-4eee-b891-dda16ac60797 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:15.184731 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-95796d1f-97fa-4eee-b891-dda16ac60797 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:15.251228 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-95796d1f-97fa-4eee-b891-dda16ac60797 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:17:15.258731 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-95796d1f-97fa-4eee-b891-dda16ac60797 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1297 microversion: 2.1 time: 0.087667 Dec 15 13:17:15.259308 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1481/2982] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:17:15 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:17:16.276675 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6734b77a-35b8-4e08-9e17-a672e6b1995f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:16.277200 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6734b77a-35b8-4e08-9e17-a672e6b1995f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:16.283393 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6734b77a-35b8-4e08-9e17-a672e6b1995f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:16.283973 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6734b77a-35b8-4e08-9e17-a672e6b1995f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:16.284616 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6734b77a-35b8-4e08-9e17-a672e6b1995f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:16.285043 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6734b77a-35b8-4e08-9e17-a672e6b1995f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:16.445214 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6734b77a-35b8-4e08-9e17-a672e6b1995f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:17:16.459935 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6734b77a-35b8-4e08-9e17-a672e6b1995f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1363 microversion: 2.1 time: 0.185153 Dec 15 13:17:16.460277 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1502/2983] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:17:16 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:17:16.599700 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [req-695c0152-bccd-4ede-a828-00238d2da198 req-241f7762-1a3f-4abc-8256-7f6431792157 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "156953db-d05a-4a97-9bfe-f5c5ee19edc9", "tag": "d6c08910-596b-47af-854e-0c26715de1c8"}]} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:16.602343 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:17:16.602343 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: warnings.warn(msg) Dec 15 13:17:16.615617 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-695c0152-bccd-4ede-a828-00238d2da198 req-241f7762-1a3f-4abc-8256-7f6431792157 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:16.616321 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-695c0152-bccd-4ede-a828-00238d2da198 req-241f7762-1a3f-4abc-8256-7f6431792157 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:16.637301 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.compute.server_external_events [req-695c0152-bccd-4ede-a828-00238d2da198 req-241f7762-1a3f-4abc-8256-7f6431792157 service nova] Creating event network-changed:d6c08910-596b-47af-854e-0c26715de1c8 for instance 156953db-d05a-4a97-9bfe-f5c5ee19edc9 on hv-cinder-81322 Dec 15 13:17:16.652337 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [req-695c0152-bccd-4ede-a828-00238d2da198 req-241f7762-1a3f-4abc-8256-7f6431792157 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056551 Dec 15 13:17:16.652885 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1482/2984] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:17:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:17:17.479014 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c19e456b-c74c-473d-add5-3d3d7c33be66 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:17.479638 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c19e456b-c74c-473d-add5-3d3d7c33be66 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:17.485990 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c19e456b-c74c-473d-add5-3d3d7c33be66 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:17.486445 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c19e456b-c74c-473d-add5-3d3d7c33be66 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:17.487228 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c19e456b-c74c-473d-add5-3d3d7c33be66 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:17.487669 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c19e456b-c74c-473d-add5-3d3d7c33be66 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:17.626145 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-c19e456b-c74c-473d-add5-3d3d7c33be66 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:17:17.633733 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c19e456b-c74c-473d-add5-3d3d7c33be66 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1363 microversion: 2.1 time: 0.159364 Dec 15 13:17:17.634283 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1503/2985] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:17:17 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:17:18.652646 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c09f9cd4-9e35-42f9-9a82-7cd2952d580a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:18.653354 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c09f9cd4-9e35-42f9-9a82-7cd2952d580a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:18.660162 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c09f9cd4-9e35-42f9-9a82-7cd2952d580a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:18.660729 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c09f9cd4-9e35-42f9-9a82-7cd2952d580a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:18.661644 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c09f9cd4-9e35-42f9-9a82-7cd2952d580a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:18.662082 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c09f9cd4-9e35-42f9-9a82-7cd2952d580a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:18.802365 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c09f9cd4-9e35-42f9-9a82-7cd2952d580a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:17:18.813004 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c09f9cd4-9e35-42f9-9a82-7cd2952d580a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1363 microversion: 2.1 time: 0.164693 Dec 15 13:17:18.813970 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1483/2986] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:17:18 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:17:19.830526 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4ec37581-6aa0-409b-8533-7d9835a60c0c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:19.831155 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4ec37581-6aa0-409b-8533-7d9835a60c0c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:19.838329 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4ec37581-6aa0-409b-8533-7d9835a60c0c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:19.838772 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4ec37581-6aa0-409b-8533-7d9835a60c0c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:19.839548 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4ec37581-6aa0-409b-8533-7d9835a60c0c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:19.839974 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4ec37581-6aa0-409b-8533-7d9835a60c0c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:19.980787 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-4ec37581-6aa0-409b-8533-7d9835a60c0c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:17:19.988152 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4ec37581-6aa0-409b-8533-7d9835a60c0c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1363 microversion: 2.1 time: 0.161207 Dec 15 13:17:19.988709 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1504/2987] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:17:19 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:17:21.004415 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8ebef3f3-de55-4449-8afd-427ae5e9a378 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:21.005130 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8ebef3f3-de55-4449-8afd-427ae5e9a378 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:21.016464 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8ebef3f3-de55-4449-8afd-427ae5e9a378 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:21.016920 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8ebef3f3-de55-4449-8afd-427ae5e9a378 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:21.017759 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8ebef3f3-de55-4449-8afd-427ae5e9a378 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:21.018202 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8ebef3f3-de55-4449-8afd-427ae5e9a378 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:21.154705 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-8ebef3f3-de55-4449-8afd-427ae5e9a378 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:17:21.162073 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8ebef3f3-de55-4449-8afd-427ae5e9a378 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1363 microversion: 2.1 time: 0.161125 Dec 15 13:17:21.162686 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1484/2988] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:17:20 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:17:22.178827 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-5d15bb81-3989-465e-afdf-fdfc4bf1222b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:22.179541 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-5d15bb81-3989-465e-afdf-fdfc4bf1222b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:22.186138 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5d15bb81-3989-465e-afdf-fdfc4bf1222b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:22.186594 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5d15bb81-3989-465e-afdf-fdfc4bf1222b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:22.187374 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5d15bb81-3989-465e-afdf-fdfc4bf1222b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:22.187809 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-5d15bb81-3989-465e-afdf-fdfc4bf1222b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:22.327178 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-5d15bb81-3989-465e-afdf-fdfc4bf1222b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:17:22.336800 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-5d15bb81-3989-465e-afdf-fdfc4bf1222b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1363 microversion: 2.1 time: 0.161315 Dec 15 13:17:22.337662 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1505/2989] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:17:22 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:17:23.050273 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [req-6c101b9a-20dc-4b5a-bba9-99a9b8e50b99 req-c86ba465-088b-48a0-94a2-192574993e1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "156953db-d05a-4a97-9bfe-f5c5ee19edc9", "name": "network-vif-plugged", "status": "completed", "tag": "d6c08910-596b-47af-854e-0c26715de1c8"}]} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:23.051836 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:17:23.051836 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: warnings.warn(msg) Dec 15 13:17:23.060579 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-6c101b9a-20dc-4b5a-bba9-99a9b8e50b99 req-c86ba465-088b-48a0-94a2-192574993e1f service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:23.061021 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-6c101b9a-20dc-4b5a-bba9-99a9b8e50b99 req-c86ba465-088b-48a0-94a2-192574993e1f service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:23.073315 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.compute.server_external_events [req-6c101b9a-20dc-4b5a-bba9-99a9b8e50b99 req-c86ba465-088b-48a0-94a2-192574993e1f service nova] Creating event network-vif-plugged:d6c08910-596b-47af-854e-0c26715de1c8 for instance 156953db-d05a-4a97-9bfe-f5c5ee19edc9 on hv-cinder-81322 Dec 15 13:17:23.078216 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [req-6c101b9a-20dc-4b5a-bba9-99a9b8e50b99 req-c86ba465-088b-48a0-94a2-192574993e1f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031585 Dec 15 13:17:23.078816 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1485/2990] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:17:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:17:23.356667 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b1f7d0ac-da59-4d69-bcc1-ed9390595515 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:23.357268 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b1f7d0ac-da59-4d69-bcc1-ed9390595515 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:23.363511 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b1f7d0ac-da59-4d69-bcc1-ed9390595515 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:23.363955 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b1f7d0ac-da59-4d69-bcc1-ed9390595515 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:23.364713 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b1f7d0ac-da59-4d69-bcc1-ed9390595515 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:23.365143 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b1f7d0ac-da59-4d69-bcc1-ed9390595515 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:23.499885 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b1f7d0ac-da59-4d69-bcc1-ed9390595515 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:17:23.515407 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b1f7d0ac-da59-4d69-bcc1-ed9390595515 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1363 microversion: 2.1 time: 0.162256 Dec 15 13:17:23.515985 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1506/2991] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:17:23 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:17:24.534931 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1ae53512-c5f2-4b23-9042-e66ae79fcb03 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:24.535643 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1ae53512-c5f2-4b23-9042-e66ae79fcb03 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:24.543177 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1ae53512-c5f2-4b23-9042-e66ae79fcb03 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:24.543625 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1ae53512-c5f2-4b23-9042-e66ae79fcb03 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:24.544457 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1ae53512-c5f2-4b23-9042-e66ae79fcb03 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:24.544893 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1ae53512-c5f2-4b23-9042-e66ae79fcb03 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:24.689798 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1ae53512-c5f2-4b23-9042-e66ae79fcb03 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:17:24.697168 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1ae53512-c5f2-4b23-9042-e66ae79fcb03 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1549 microversion: 2.1 time: 0.167433 Dec 15 13:17:24.697778 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1486/2992] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:17:24 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:17:24.714483 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-36fb6fca-8802-4ad7-af8f-6eb47120e55d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:17:24.715054 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-36fb6fca-8802-4ad7-af8f-6eb47120e55d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:24.721309 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-36fb6fca-8802-4ad7-af8f-6eb47120e55d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:24.721804 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-36fb6fca-8802-4ad7-af8f-6eb47120e55d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:24.722597 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-36fb6fca-8802-4ad7-af8f-6eb47120e55d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:24.723035 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-36fb6fca-8802-4ad7-af8f-6eb47120e55d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:24.803951 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-36fb6fca-8802-4ad7-af8f-6eb47120e55d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093880 Dec 15 13:17:24.804607 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1507/2993] 10.222.0.76 () {58 vars in 1274 bytes} [Wed Dec 15 13:17:24 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:17:25.999218 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c8bf8db4-9587-4f35-b35d-a6f933059942 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:26.000132 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c8bf8db4-9587-4f35-b35d-a6f933059942 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:26.002398 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-2fe69f0a-02b2-44e2-bd33-5ff236d32600 req-dfa305a7-5950-47f1-9014-4bac56e62a63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "156953db-d05a-4a97-9bfe-f5c5ee19edc9", "tag": "d6c08910-596b-47af-854e-0c26715de1c8"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:26.003952 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:17:26.003952 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 13:17:26.006928 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c8bf8db4-9587-4f35-b35d-a6f933059942 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:26.007580 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c8bf8db4-9587-4f35-b35d-a6f933059942 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:26.008674 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c8bf8db4-9587-4f35-b35d-a6f933059942 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:26.009206 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c8bf8db4-9587-4f35-b35d-a6f933059942 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:26.011277 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-2fe69f0a-02b2-44e2-bd33-5ff236d32600 req-dfa305a7-5950-47f1-9014-4bac56e62a63 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:26.011726 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-2fe69f0a-02b2-44e2-bd33-5ff236d32600 req-dfa305a7-5950-47f1-9014-4bac56e62a63 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:26.024833 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-2fe69f0a-02b2-44e2-bd33-5ff236d32600 req-dfa305a7-5950-47f1-9014-4bac56e62a63 service nova] Creating event network-changed:d6c08910-596b-47af-854e-0c26715de1c8 for instance 156953db-d05a-4a97-9bfe-f5c5ee19edc9 on hv-cinder-81322 Dec 15 13:17:26.030325 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-2fe69f0a-02b2-44e2-bd33-5ff236d32600 req-dfa305a7-5950-47f1-9014-4bac56e62a63 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031904 Dec 15 13:17:26.031600 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1508/2994] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:17:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:17:26.076646 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c8bf8db4-9587-4f35-b35d-a6f933059942 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 14 microversion: 2.1 time: 0.080812 Dec 15 13:17:26.080000 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1487/2995] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:25 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:17:27.089315 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f24d51bf-4ed2-4522-b5e7-3494ac39bdd3 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:27.090716 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f24d51bf-4ed2-4522-b5e7-3494ac39bdd3 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:27.097308 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f24d51bf-4ed2-4522-b5e7-3494ac39bdd3 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:27.105166 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f24d51bf-4ed2-4522-b5e7-3494ac39bdd3 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:27.106242 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f24d51bf-4ed2-4522-b5e7-3494ac39bdd3 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:27.106691 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f24d51bf-4ed2-4522-b5e7-3494ac39bdd3 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:27.167368 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f24d51bf-4ed2-4522-b5e7-3494ac39bdd3 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 14 microversion: 2.1 time: 0.082910 Dec 15 13:17:27.167911 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1509/2996] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:27 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:17:28.178980 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d505175b-3f96-47b1-9ee8-9fd27025ca65 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:28.180109 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d505175b-3f96-47b1-9ee8-9fd27025ca65 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:28.186888 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d505175b-3f96-47b1-9ee8-9fd27025ca65 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:28.187331 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d505175b-3f96-47b1-9ee8-9fd27025ca65 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:28.188091 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d505175b-3f96-47b1-9ee8-9fd27025ca65 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:28.188515 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d505175b-3f96-47b1-9ee8-9fd27025ca65 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:28.251927 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d505175b-3f96-47b1-9ee8-9fd27025ca65 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 14 microversion: 2.1 time: 0.076711 Dec 15 13:17:28.252567 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1488/2997] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:28 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:17:29.264094 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ed0a96d1-fc94-4c63-b291-873bcc98c2da tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:29.265183 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ed0a96d1-fc94-4c63-b291-873bcc98c2da tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:29.272177 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ed0a96d1-fc94-4c63-b291-873bcc98c2da tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:29.272621 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ed0a96d1-fc94-4c63-b291-873bcc98c2da tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:29.273756 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ed0a96d1-fc94-4c63-b291-873bcc98c2da tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:29.274211 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ed0a96d1-fc94-4c63-b291-873bcc98c2da tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:29.348099 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ed0a96d1-fc94-4c63-b291-873bcc98c2da tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 14 microversion: 2.1 time: 0.087835 Dec 15 13:17:29.348949 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1510/2998] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:29 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 13:17:30.360590 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-30232f77-8f66-44ca-a838-c184a5fd9082 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:30.361767 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-30232f77-8f66-44ca-a838-c184a5fd9082 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:30.369332 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-30232f77-8f66-44ca-a838-c184a5fd9082 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:30.369815 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-30232f77-8f66-44ca-a838-c184a5fd9082 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:30.370629 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-30232f77-8f66-44ca-a838-c184a5fd9082 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:30.371064 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-30232f77-8f66-44ca-a838-c184a5fd9082 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:30.433943 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-30232f77-8f66-44ca-a838-c184a5fd9082 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 14 microversion: 2.1 time: 0.077188 Dec 15 13:17:30.434612 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1489/2999] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:30 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:17:31.446248 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e1286470-e555-4001-9046-eb5fa2eeed7b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:31.447246 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e1286470-e555-4001-9046-eb5fa2eeed7b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:31.454072 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e1286470-e555-4001-9046-eb5fa2eeed7b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:31.454521 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e1286470-e555-4001-9046-eb5fa2eeed7b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:31.455294 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e1286470-e555-4001-9046-eb5fa2eeed7b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:31.455728 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e1286470-e555-4001-9046-eb5fa2eeed7b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:31.514758 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e1286470-e555-4001-9046-eb5fa2eeed7b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 14 microversion: 2.1 time: 0.073096 Dec 15 13:17:31.515379 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1511/3000] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:31 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:17:32.526644 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bd5576b4-8920-44f4-8977-b9a720c79c1e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:32.527556 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bd5576b4-8920-44f4-8977-b9a720c79c1e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:32.534854 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd5576b4-8920-44f4-8977-b9a720c79c1e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:32.535306 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd5576b4-8920-44f4-8977-b9a720c79c1e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:32.536085 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd5576b4-8920-44f4-8977-b9a720c79c1e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:32.536549 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bd5576b4-8920-44f4-8977-b9a720c79c1e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:32.598436 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bd5576b4-8920-44f4-8977-b9a720c79c1e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 14 microversion: 2.1 time: 0.075753 Dec 15 13:17:32.599315 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1490/3001] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:32 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:17:33.611245 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-39429992-60df-4306-a70e-43306c83da0e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:33.612296 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-39429992-60df-4306-a70e-43306c83da0e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:33.620678 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-39429992-60df-4306-a70e-43306c83da0e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:33.621135 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-39429992-60df-4306-a70e-43306c83da0e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:33.621970 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-39429992-60df-4306-a70e-43306c83da0e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:33.622447 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-39429992-60df-4306-a70e-43306c83da0e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:33.700982 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-39429992-60df-4306-a70e-43306c83da0e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 14 microversion: 2.1 time: 0.094177 Dec 15 13:17:33.701648 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1512/3002] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:33 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:17:34.713659 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-be6481cc-5de4-4467-aabe-9787cab0bd65 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:34.714676 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-be6481cc-5de4-4467-aabe-9787cab0bd65 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:34.721664 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-be6481cc-5de4-4467-aabe-9787cab0bd65 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:34.722108 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-be6481cc-5de4-4467-aabe-9787cab0bd65 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:34.722887 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-be6481cc-5de4-4467-aabe-9787cab0bd65 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:34.723315 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-be6481cc-5de4-4467-aabe-9787cab0bd65 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:34.796032 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-be6481cc-5de4-4467-aabe-9787cab0bd65 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 14 microversion: 2.1 time: 0.087470 Dec 15 13:17:34.796677 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1491/3003] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:34 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:17:35.808011 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-26683e94-3328-4a64-8acb-05e281c21aaf tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:35.808928 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-26683e94-3328-4a64-8acb-05e281c21aaf tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:35.815774 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-26683e94-3328-4a64-8acb-05e281c21aaf tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:35.816220 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-26683e94-3328-4a64-8acb-05e281c21aaf tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:35.816988 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-26683e94-3328-4a64-8acb-05e281c21aaf tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:35.817420 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-26683e94-3328-4a64-8acb-05e281c21aaf tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:35.880875 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-26683e94-3328-4a64-8acb-05e281c21aaf tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 14 microversion: 2.1 time: 0.076866 Dec 15 13:17:35.882134 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1513/3004] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:35 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:17:36.893347 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f10db406-f7a7-4db6-8365-be80c6b61d34 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:36.894364 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f10db406-f7a7-4db6-8365-be80c6b61d34 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:36.902312 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f10db406-f7a7-4db6-8365-be80c6b61d34 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:36.902761 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f10db406-f7a7-4db6-8365-be80c6b61d34 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:36.903550 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f10db406-f7a7-4db6-8365-be80c6b61d34 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:36.903987 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f10db406-f7a7-4db6-8365-be80c6b61d34 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:36.978838 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f10db406-f7a7-4db6-8365-be80c6b61d34 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 9366 microversion: 2.1 time: 0.089875 Dec 15 13:17:36.979483 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1492/3005] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:36 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 9366 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:17:37.991065 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fe92e6eb-63e1-45b4-b725-9513a26db26d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:37.992656 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fe92e6eb-63e1-45b4-b725-9513a26db26d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:37.999561 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe92e6eb-63e1-45b4-b725-9513a26db26d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:38.000006 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe92e6eb-63e1-45b4-b725-9513a26db26d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:38.000775 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe92e6eb-63e1-45b4-b725-9513a26db26d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:38.001204 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fe92e6eb-63e1-45b4-b725-9513a26db26d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:38.078758 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fe92e6eb-63e1-45b4-b725-9513a26db26d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 16546 microversion: 2.1 time: 0.091810 Dec 15 13:17:38.079440 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1514/3006] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:37 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 16546 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:17:39.091620 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-04386eb0-b517-4217-a5c5-1044c7544318 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:39.092673 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-04386eb0-b517-4217-a5c5-1044c7544318 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:39.099890 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-04386eb0-b517-4217-a5c5-1044c7544318 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:39.100337 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-04386eb0-b517-4217-a5c5-1044c7544318 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:39.101211 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-04386eb0-b517-4217-a5c5-1044c7544318 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:39.101702 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-04386eb0-b517-4217-a5c5-1044c7544318 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:39.183584 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-04386eb0-b517-4217-a5c5-1044c7544318 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 18398 microversion: 2.1 time: 0.096141 Dec 15 13:17:39.186448 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1493/3007] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:39 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 18398 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:17:40.195814 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-787a7bfe-017f-4123-8c5f-797635b0fb32 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:40.197139 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-787a7bfe-017f-4123-8c5f-797635b0fb32 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:40.204405 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-787a7bfe-017f-4123-8c5f-797635b0fb32 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:40.204857 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-787a7bfe-017f-4123-8c5f-797635b0fb32 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:40.205878 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-787a7bfe-017f-4123-8c5f-797635b0fb32 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:40.206327 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-787a7bfe-017f-4123-8c5f-797635b0fb32 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:40.285016 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-787a7bfe-017f-4123-8c5f-797635b0fb32 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 20997 microversion: 2.1 time: 0.093019 Dec 15 13:17:40.285707 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1515/3008] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:40 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 20997 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:17:41.298366 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-88b3069f-13fd-4f40-afbe-1d7fd88d6ef2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:41.299383 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-88b3069f-13fd-4f40-afbe-1d7fd88d6ef2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:41.307018 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-88b3069f-13fd-4f40-afbe-1d7fd88d6ef2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:41.307468 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-88b3069f-13fd-4f40-afbe-1d7fd88d6ef2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:41.308247 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-88b3069f-13fd-4f40-afbe-1d7fd88d6ef2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:41.308680 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-88b3069f-13fd-4f40-afbe-1d7fd88d6ef2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:41.399456 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-88b3069f-13fd-4f40-afbe-1d7fd88d6ef2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 22772 microversion: 2.1 time: 0.105272 Dec 15 13:17:41.400108 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1494/3009] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:41 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 22772 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:17:42.411787 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e86f73ff-1a7e-4cb7-9d11-904b790ca346 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:42.412697 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e86f73ff-1a7e-4cb7-9d11-904b790ca346 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:42.420951 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e86f73ff-1a7e-4cb7-9d11-904b790ca346 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:42.421411 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e86f73ff-1a7e-4cb7-9d11-904b790ca346 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:42.422518 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e86f73ff-1a7e-4cb7-9d11-904b790ca346 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:42.422960 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e86f73ff-1a7e-4cb7-9d11-904b790ca346 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:42.503095 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e86f73ff-1a7e-4cb7-9d11-904b790ca346 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 23804 microversion: 2.1 time: 0.095217 Dec 15 13:17:42.503775 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1516/3010] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:42 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 23804 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:17:43.516145 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-597fbb33-3b14-4886-9909-8bb8964841e8 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:43.517390 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-597fbb33-3b14-4886-9909-8bb8964841e8 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:43.524847 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-597fbb33-3b14-4886-9909-8bb8964841e8 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:43.525759 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-597fbb33-3b14-4886-9909-8bb8964841e8 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:43.526556 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-597fbb33-3b14-4886-9909-8bb8964841e8 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:43.526988 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-597fbb33-3b14-4886-9909-8bb8964841e8 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:43.606059 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-597fbb33-3b14-4886-9909-8bb8964841e8 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 25381 microversion: 2.1 time: 0.093612 Dec 15 13:17:43.606614 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1495/3011] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:43 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 25381 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:17:44.619291 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4d151d82-872e-418c-a1f7-f0a4db2fc688 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:44.620259 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4d151d82-872e-418c-a1f7-f0a4db2fc688 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:44.627198 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4d151d82-872e-418c-a1f7-f0a4db2fc688 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:44.627649 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4d151d82-872e-418c-a1f7-f0a4db2fc688 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:44.628441 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4d151d82-872e-418c-a1f7-f0a4db2fc688 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:44.628878 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4d151d82-872e-418c-a1f7-f0a4db2fc688 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:44.704833 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4d151d82-872e-418c-a1f7-f0a4db2fc688 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 26744 microversion: 2.1 time: 0.090453 Dec 15 13:17:44.705711 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1517/3012] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:44 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 26744 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:17:45.717277 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d3a60c60-68c7-4aa7-ac9b-f77987d052d2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:45.718306 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d3a60c60-68c7-4aa7-ac9b-f77987d052d2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:45.725133 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d3a60c60-68c7-4aa7-ac9b-f77987d052d2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:45.725611 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d3a60c60-68c7-4aa7-ac9b-f77987d052d2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:45.727107 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d3a60c60-68c7-4aa7-ac9b-f77987d052d2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:45.727548 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d3a60c60-68c7-4aa7-ac9b-f77987d052d2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:45.804628 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d3a60c60-68c7-4aa7-ac9b-f77987d052d2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 27678 microversion: 2.1 time: 0.091153 Dec 15 13:17:45.805318 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1496/3013] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:45 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 27678 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:17:46.818064 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-dc0cc6c0-c83d-4605-b462-8e7d9d108fa0 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:46.819072 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-dc0cc6c0-c83d-4605-b462-8e7d9d108fa0 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:46.826130 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dc0cc6c0-c83d-4605-b462-8e7d9d108fa0 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:46.826584 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dc0cc6c0-c83d-4605-b462-8e7d9d108fa0 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:46.827360 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dc0cc6c0-c83d-4605-b462-8e7d9d108fa0 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:46.827800 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dc0cc6c0-c83d-4605-b462-8e7d9d108fa0 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:46.909599 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-dc0cc6c0-c83d-4605-b462-8e7d9d108fa0 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 28040 microversion: 2.1 time: 0.095333 Dec 15 13:17:46.910311 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1518/3014] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:46 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 28040 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:17:47.922628 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4678262e-3a5b-480f-b6db-f5bd1f510169 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:47.923615 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4678262e-3a5b-480f-b6db-f5bd1f510169 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:47.930532 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4678262e-3a5b-480f-b6db-f5bd1f510169 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:47.930978 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4678262e-3a5b-480f-b6db-f5bd1f510169 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:47.931743 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4678262e-3a5b-480f-b6db-f5bd1f510169 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:47.932170 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4678262e-3a5b-480f-b6db-f5bd1f510169 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:48.018489 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4678262e-3a5b-480f-b6db-f5bd1f510169 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 28226 microversion: 2.1 time: 0.099647 Dec 15 13:17:48.019171 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1497/3015] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:47 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 28226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:17:49.031753 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9ab51ea2-661a-4df5-92de-a71524873358 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:49.032671 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9ab51ea2-661a-4df5-92de-a71524873358 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:49.040270 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9ab51ea2-661a-4df5-92de-a71524873358 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:49.040748 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9ab51ea2-661a-4df5-92de-a71524873358 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:49.041553 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9ab51ea2-661a-4df5-92de-a71524873358 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:49.041994 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9ab51ea2-661a-4df5-92de-a71524873358 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:49.110966 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9ab51ea2-661a-4df5-92de-a71524873358 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 28226 microversion: 2.1 time: 0.083265 Dec 15 13:17:49.111655 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1519/3016] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:49 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 28226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:17:50.123104 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-158b8077-3df0-47c8-96a2-2e52036e0718 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:50.124119 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-158b8077-3df0-47c8-96a2-2e52036e0718 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:50.131533 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-158b8077-3df0-47c8-96a2-2e52036e0718 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:50.132126 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-158b8077-3df0-47c8-96a2-2e52036e0718 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:50.133019 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-158b8077-3df0-47c8-96a2-2e52036e0718 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:50.133458 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-158b8077-3df0-47c8-96a2-2e52036e0718 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:50.212419 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-158b8077-3df0-47c8-96a2-2e52036e0718 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 28516 microversion: 2.1 time: 0.093287 Dec 15 13:17:50.213122 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1498/3017] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:50 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 28516 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:17:51.225456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-4198ab5a-b66f-41a9-a744-db19bd57045a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:51.227121 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-4198ab5a-b66f-41a9-a744-db19bd57045a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:51.234511 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4198ab5a-b66f-41a9-a744-db19bd57045a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:51.234965 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4198ab5a-b66f-41a9-a744-db19bd57045a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:51.235759 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4198ab5a-b66f-41a9-a744-db19bd57045a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:51.239302 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-4198ab5a-b66f-41a9-a744-db19bd57045a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:51.317680 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-4198ab5a-b66f-41a9-a744-db19bd57045a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 28684 microversion: 2.1 time: 0.096311 Dec 15 13:17:51.318519 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1520/3018] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:51 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 28684 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:17:52.330619 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-8af27adc-3806-4062-9369-1b128c2703e2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:52.331620 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-8af27adc-3806-4062-9369-1b128c2703e2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:52.340864 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8af27adc-3806-4062-9369-1b128c2703e2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:52.341305 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8af27adc-3806-4062-9369-1b128c2703e2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:52.342113 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8af27adc-3806-4062-9369-1b128c2703e2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:52.342549 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-8af27adc-3806-4062-9369-1b128c2703e2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:52.408074 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-8af27adc-3806-4062-9369-1b128c2703e2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 28684 microversion: 2.1 time: 0.081345 Dec 15 13:17:52.408744 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1499/3019] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:52 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 28684 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:17:53.421474 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-00877b76-e385-4b9a-b1a8-519a743583b8 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:53.422524 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-00877b76-e385-4b9a-b1a8-519a743583b8 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:53.430073 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-00877b76-e385-4b9a-b1a8-519a743583b8 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:53.430524 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-00877b76-e385-4b9a-b1a8-519a743583b8 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:53.431302 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-00877b76-e385-4b9a-b1a8-519a743583b8 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:53.431741 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-00877b76-e385-4b9a-b1a8-519a743583b8 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:53.500287 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-00877b76-e385-4b9a-b1a8-519a743583b8 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 28684 microversion: 2.1 time: 0.082719 Dec 15 13:17:53.501222 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1521/3020] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:53 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 28684 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:17:54.513652 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-fc079412-0b47-4ce2-95d8-f9c624eb5ee6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:54.514678 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-fc079412-0b47-4ce2-95d8-f9c624eb5ee6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:54.521871 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fc079412-0b47-4ce2-95d8-f9c624eb5ee6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:54.522412 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fc079412-0b47-4ce2-95d8-f9c624eb5ee6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:54.523192 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fc079412-0b47-4ce2-95d8-f9c624eb5ee6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:54.523621 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-fc079412-0b47-4ce2-95d8-f9c624eb5ee6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:54.587647 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-fc079412-0b47-4ce2-95d8-f9c624eb5ee6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 28684 microversion: 2.1 time: 0.077880 Dec 15 13:17:54.588498 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1500/3021] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:54 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 28684 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:17:55.599966 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-075ec8f1-4dfc-4116-aeea-f836090aa256 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:55.601039 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-075ec8f1-4dfc-4116-aeea-f836090aa256 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:55.608451 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-075ec8f1-4dfc-4116-aeea-f836090aa256 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:55.608900 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-075ec8f1-4dfc-4116-aeea-f836090aa256 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:55.609734 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-075ec8f1-4dfc-4116-aeea-f836090aa256 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:55.610172 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-075ec8f1-4dfc-4116-aeea-f836090aa256 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:55.695743 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-075ec8f1-4dfc-4116-aeea-f836090aa256 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 28831 microversion: 2.1 time: 0.099743 Dec 15 13:17:55.696718 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1522/3022] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:55 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 28831 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:17:56.708036 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f5ee41c1-e115-43b2-8144-39896945986b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:56.709070 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f5ee41c1-e115-43b2-8144-39896945986b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:56.716555 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f5ee41c1-e115-43b2-8144-39896945986b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:56.716999 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f5ee41c1-e115-43b2-8144-39896945986b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:56.717798 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f5ee41c1-e115-43b2-8144-39896945986b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:56.718236 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f5ee41c1-e115-43b2-8144-39896945986b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:56.798118 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f5ee41c1-e115-43b2-8144-39896945986b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 31027 microversion: 2.1 time: 0.093854 Dec 15 13:17:56.798699 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1501/3023] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:56 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 31027 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:17:57.810485 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e3f2cd04-526f-4939-ba9b-2cae18033d2b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:57.811470 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e3f2cd04-526f-4939-ba9b-2cae18033d2b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:57.818208 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e3f2cd04-526f-4939-ba9b-2cae18033d2b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:57.818652 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e3f2cd04-526f-4939-ba9b-2cae18033d2b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:57.820000 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e3f2cd04-526f-4939-ba9b-2cae18033d2b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:57.820424 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e3f2cd04-526f-4939-ba9b-2cae18033d2b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:57.896017 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e3f2cd04-526f-4939-ba9b-2cae18033d2b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 32882 microversion: 2.1 time: 0.089325 Dec 15 13:17:57.896751 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1523/3024] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:57 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 32882 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:17:58.908678 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-be01bbc1-12ed-4848-b375-a7f3b4cac0de tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:17:58.909608 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-be01bbc1-12ed-4848-b375-a7f3b4cac0de tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:17:58.916955 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-be01bbc1-12ed-4848-b375-a7f3b4cac0de tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:58.917397 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-be01bbc1-12ed-4848-b375-a7f3b4cac0de tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:58.918184 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-be01bbc1-12ed-4848-b375-a7f3b4cac0de tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:17:58.918614 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-be01bbc1-12ed-4848-b375-a7f3b4cac0de tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:17:58.995707 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-be01bbc1-12ed-4848-b375-a7f3b4cac0de tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 33717 microversion: 2.1 time: 0.090995 Dec 15 13:17:58.996362 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1502/3025] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:17:58 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 33717 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:18:00.008838 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f9546f06-2883-4332-8b8d-945731fa2542 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:18:00.009870 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f9546f06-2883-4332-8b8d-945731fa2542 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:00.016970 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f9546f06-2883-4332-8b8d-945731fa2542 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:00.017430 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f9546f06-2883-4332-8b8d-945731fa2542 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:00.018238 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f9546f06-2883-4332-8b8d-945731fa2542 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:00.018681 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f9546f06-2883-4332-8b8d-945731fa2542 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:00.099430 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f9546f06-2883-4332-8b8d-945731fa2542 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 34865 microversion: 2.1 time: 0.095063 Dec 15 13:18:00.100119 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1524/3026] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:18:00 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 34865 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:18:01.112060 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-523cab52-0538-407b-b664-93dd567fc690 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:18:01.112991 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-523cab52-0538-407b-b664-93dd567fc690 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:01.120445 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-523cab52-0538-407b-b664-93dd567fc690 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:01.120887 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-523cab52-0538-407b-b664-93dd567fc690 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:01.121687 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-523cab52-0538-407b-b664-93dd567fc690 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:01.122123 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-523cab52-0538-407b-b664-93dd567fc690 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:01.203865 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-523cab52-0538-407b-b664-93dd567fc690 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 36019 microversion: 2.1 time: 0.095744 Dec 15 13:18:01.204791 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1503/3027] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:18:01 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 36019 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:18:02.216766 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-aa903be6-618f-49de-b0b0-4b4f63adfbe6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:18:02.217789 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-aa903be6-618f-49de-b0b0-4b4f63adfbe6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:02.224610 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa903be6-618f-49de-b0b0-4b4f63adfbe6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:02.225056 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa903be6-618f-49de-b0b0-4b4f63adfbe6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:02.226551 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa903be6-618f-49de-b0b0-4b4f63adfbe6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:02.226995 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-aa903be6-618f-49de-b0b0-4b4f63adfbe6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:02.308443 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-aa903be6-618f-49de-b0b0-4b4f63adfbe6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 37713 microversion: 2.1 time: 0.095510 Dec 15 13:18:02.309449 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1525/3028] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:18:02 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 37713 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:18:03.321335 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-17e59f69-c061-49cd-9d1a-2c1f56b583a2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:18:03.329614 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-17e59f69-c061-49cd-9d1a-2c1f56b583a2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:03.338315 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-17e59f69-c061-49cd-9d1a-2c1f56b583a2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:03.338769 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-17e59f69-c061-49cd-9d1a-2c1f56b583a2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:03.339556 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-17e59f69-c061-49cd-9d1a-2c1f56b583a2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:03.339998 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-17e59f69-c061-49cd-9d1a-2c1f56b583a2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:03.416024 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-17e59f69-c061-49cd-9d1a-2c1f56b583a2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 38218 microversion: 2.1 time: 0.099099 Dec 15 13:18:03.416698 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1504/3029] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:18:03 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 38218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:18:04.428532 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-46e317e3-bdd4-4d5d-b404-824d2cde75b1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:18:04.429528 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-46e317e3-bdd4-4d5d-b404-824d2cde75b1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:04.436715 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-46e317e3-bdd4-4d5d-b404-824d2cde75b1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:04.437160 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-46e317e3-bdd4-4d5d-b404-824d2cde75b1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:04.437966 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-46e317e3-bdd4-4d5d-b404-824d2cde75b1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:04.438399 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-46e317e3-bdd4-4d5d-b404-824d2cde75b1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:04.503970 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-46e317e3-bdd4-4d5d-b404-824d2cde75b1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 38218 microversion: 2.1 time: 0.079279 Dec 15 13:18:04.505047 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1526/3030] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:18:04 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 38218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:18:05.517628 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2aea99ae-33cc-4cdc-8bc4-28489050e358 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:18:05.518628 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2aea99ae-33cc-4cdc-8bc4-28489050e358 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:05.525587 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2aea99ae-33cc-4cdc-8bc4-28489050e358 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:05.526032 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2aea99ae-33cc-4cdc-8bc4-28489050e358 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:05.526803 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2aea99ae-33cc-4cdc-8bc4-28489050e358 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:05.527227 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2aea99ae-33cc-4cdc-8bc4-28489050e358 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:05.608750 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2aea99ae-33cc-4cdc-8bc4-28489050e358 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 38218 microversion: 2.1 time: 0.095253 Dec 15 13:18:05.609353 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1505/3031] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:18:05 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 38218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:18:06.621668 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f183ed8d-e112-4e3e-8d52-1110262f6351 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:18:06.622675 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f183ed8d-e112-4e3e-8d52-1110262f6351 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:06.629582 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f183ed8d-e112-4e3e-8d52-1110262f6351 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:06.630040 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f183ed8d-e112-4e3e-8d52-1110262f6351 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:06.630821 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f183ed8d-e112-4e3e-8d52-1110262f6351 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:06.631259 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f183ed8d-e112-4e3e-8d52-1110262f6351 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:06.716805 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f183ed8d-e112-4e3e-8d52-1110262f6351 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 200 len: 38349 microversion: 2.1 time: 0.098970 Dec 15 13:18:06.717451 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1527/3032] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:18:06 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 38349 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:18:06.728218 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-62142b9a-9dcf-476c-97f3-a84a1e4bb6fe tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:18:06.728799 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-62142b9a-9dcf-476c-97f3-a84a1e4bb6fe tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:06.735604 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-62142b9a-9dcf-476c-97f3-a84a1e4bb6fe tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:06.736051 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-62142b9a-9dcf-476c-97f3-a84a1e4bb6fe tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:06.736824 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-62142b9a-9dcf-476c-97f3-a84a1e4bb6fe tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:06.737264 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-62142b9a-9dcf-476c-97f3-a84a1e4bb6fe tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:06.761340 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-62142b9a-9dcf-476c-97f3-a84a1e4bb6fe tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/ips" status: 200 len: 145 microversion: 2.1 time: 0.037624 Dec 15 13:18:06.762251 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1506/3033] 10.222.0.76 () {58 vars in 1247 bytes} [Wed Dec 15 13:18:06 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:18:08.953026 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-45e336ac-240b-45a7-a171-d681650d10b0 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9dde9e23-0e47-4897-869d-6dade3e792c4"}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:18:08.954211 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-45e336ac-240b-45a7-a171-d681650d10b0 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:08.961249 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-45e336ac-240b-45a7-a171-d681650d10b0 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:08.961726 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-45e336ac-240b-45a7-a171-d681650d10b0 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:08.962504 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-45e336ac-240b-45a7-a171-d681650d10b0 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:08.962939 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-45e336ac-240b-45a7-a171-d681650d10b0 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:09.223744 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-45e336ac-240b-45a7-a171-d681650d10b0 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274684 Dec 15 13:18:09.224355 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1528/3034] 10.222.0.76 () {60 vars in 1322 bytes} [Wed Dec 15 13:18:08 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:18:16.704993 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0b592042-8876-4b68-b242-f2530846f30a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:18:16.712346 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0b592042-8876-4b68-b242-f2530846f30a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:16.712793 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0b592042-8876-4b68-b242-f2530846f30a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:16.773295 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0b592042-8876-4b68-b242-f2530846f30a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Going to try to stop instance {{(pid=122615) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 15 13:18:16.830606 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0b592042-8876-4b68-b242-f2530846f30a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 202 len: 0 microversion: 2.1 time: 0.129188 Dec 15 13:18:16.831204 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1507/3035] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:18:16 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:18:16.840704 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7e7b1f1f-2c6f-4b52-8769-c4b826a56e68 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:18:16.841411 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7e7b1f1f-2c6f-4b52-8769-c4b826a56e68 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:16.848986 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7e7b1f1f-2c6f-4b52-8769-c4b826a56e68 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:16.849449 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7e7b1f1f-2c6f-4b52-8769-c4b826a56e68 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:16.850290 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7e7b1f1f-2c6f-4b52-8769-c4b826a56e68 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:16.850734 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7e7b1f1f-2c6f-4b52-8769-c4b826a56e68 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:16.992691 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7e7b1f1f-2c6f-4b52-8769-c4b826a56e68 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:18:17.000533 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7e7b1f1f-2c6f-4b52-8769-c4b826a56e68 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1723 microversion: 2.1 time: 0.164369 Dec 15 13:18:17.001098 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1529/3036] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:18:16 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:18:18.022513 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-73089c1e-b81b-4940-9003-e57a5935138e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:18:18.023609 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-73089c1e-b81b-4940-9003-e57a5935138e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:18.032139 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-73089c1e-b81b-4940-9003-e57a5935138e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:18.032801 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-73089c1e-b81b-4940-9003-e57a5935138e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:18.033614 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-73089c1e-b81b-4940-9003-e57a5935138e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:18.034659 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-73089c1e-b81b-4940-9003-e57a5935138e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:18.186138 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-73089c1e-b81b-4940-9003-e57a5935138e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:18:18.194512 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-73089c1e-b81b-4940-9003-e57a5935138e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1723 microversion: 2.1 time: 0.179493 Dec 15 13:18:18.195048 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1508/3037] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:18:18 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:18:19.211061 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e0464108-d8f4-4d74-baa7-b67ed5cf6651 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:18:19.211666 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e0464108-d8f4-4d74-baa7-b67ed5cf6651 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:19.218478 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e0464108-d8f4-4d74-baa7-b67ed5cf6651 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:19.219055 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e0464108-d8f4-4d74-baa7-b67ed5cf6651 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:19.220026 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e0464108-d8f4-4d74-baa7-b67ed5cf6651 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:19.220594 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e0464108-d8f4-4d74-baa7-b67ed5cf6651 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:19.369942 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e0464108-d8f4-4d74-baa7-b67ed5cf6651 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:18:19.378098 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e0464108-d8f4-4d74-baa7-b67ed5cf6651 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1723 microversion: 2.1 time: 0.170830 Dec 15 13:18:19.378703 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1530/3038] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:18:19 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:18:20.396274 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-0459d04a-2fe5-400b-bd83-3afdbf9bbbb7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:18:20.399386 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-0459d04a-2fe5-400b-bd83-3afdbf9bbbb7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:20.406241 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0459d04a-2fe5-400b-bd83-3afdbf9bbbb7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:20.406679 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0459d04a-2fe5-400b-bd83-3afdbf9bbbb7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:20.407454 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0459d04a-2fe5-400b-bd83-3afdbf9bbbb7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:20.407881 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-0459d04a-2fe5-400b-bd83-3afdbf9bbbb7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:20.538778 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-0459d04a-2fe5-400b-bd83-3afdbf9bbbb7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:18:20.546535 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-0459d04a-2fe5-400b-bd83-3afdbf9bbbb7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1723 microversion: 2.1 time: 0.153942 Dec 15 13:18:20.547104 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1509/3039] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:18:20 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:18:21.563411 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6818e7cc-08ea-4084-bd41-9d244ec99114 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:18:21.564110 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6818e7cc-08ea-4084-bd41-9d244ec99114 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:21.570621 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6818e7cc-08ea-4084-bd41-9d244ec99114 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:21.571066 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6818e7cc-08ea-4084-bd41-9d244ec99114 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:21.571833 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6818e7cc-08ea-4084-bd41-9d244ec99114 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:21.572259 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6818e7cc-08ea-4084-bd41-9d244ec99114 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:21.713835 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6818e7cc-08ea-4084-bd41-9d244ec99114 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:18:21.721546 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6818e7cc-08ea-4084-bd41-9d244ec99114 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1723 microversion: 2.1 time: 0.161808 Dec 15 13:18:21.722096 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1531/3040] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:18:21 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:18:22.739045 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-344a0ec7-1bfe-4168-8825-5bca76e8ab9a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:18:22.739662 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-344a0ec7-1bfe-4168-8825-5bca76e8ab9a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:22.746401 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-344a0ec7-1bfe-4168-8825-5bca76e8ab9a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:22.746845 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-344a0ec7-1bfe-4168-8825-5bca76e8ab9a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:22.747662 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-344a0ec7-1bfe-4168-8825-5bca76e8ab9a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:22.748089 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-344a0ec7-1bfe-4168-8825-5bca76e8ab9a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:22.883087 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-344a0ec7-1bfe-4168-8825-5bca76e8ab9a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:18:22.892572 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-344a0ec7-1bfe-4168-8825-5bca76e8ab9a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1723 microversion: 2.1 time: 0.157030 Dec 15 13:18:22.893150 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1510/3041] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:18:22 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:18:23.909767 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-31ccda0b-52bb-4ee2-a65d-32cca3482c5c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:18:23.910385 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-31ccda0b-52bb-4ee2-a65d-32cca3482c5c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:23.917640 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-31ccda0b-52bb-4ee2-a65d-32cca3482c5c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:23.918083 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-31ccda0b-52bb-4ee2-a65d-32cca3482c5c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:23.918845 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-31ccda0b-52bb-4ee2-a65d-32cca3482c5c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:23.919272 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-31ccda0b-52bb-4ee2-a65d-32cca3482c5c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:24.055527 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-31ccda0b-52bb-4ee2-a65d-32cca3482c5c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:18:24.063379 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-31ccda0b-52bb-4ee2-a65d-32cca3482c5c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1723 microversion: 2.1 time: 0.157246 Dec 15 13:18:24.063929 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1532/3042] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:18:23 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:18:25.080116 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5bd06bfa-fafd-497d-bd7e-9bb6124587ef tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:18:25.080645 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5bd06bfa-fafd-497d-bd7e-9bb6124587ef tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:25.088478 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5bd06bfa-fafd-497d-bd7e-9bb6124587ef tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:25.088929 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5bd06bfa-fafd-497d-bd7e-9bb6124587ef tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:25.089754 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5bd06bfa-fafd-497d-bd7e-9bb6124587ef tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:25.090189 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5bd06bfa-fafd-497d-bd7e-9bb6124587ef tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:25.232486 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-5bd06bfa-fafd-497d-bd7e-9bb6124587ef tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:18:25.240859 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5bd06bfa-fafd-497d-bd7e-9bb6124587ef tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1723 microversion: 2.1 time: 0.163942 Dec 15 13:18:25.241549 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1511/3043] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:18:25 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:18:26.260579 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-1ee1d541-00b9-45a8-a448-8d1ac335b1d4 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:18:26.261216 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-1ee1d541-00b9-45a8-a448-8d1ac335b1d4 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:26.270336 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ee1d541-00b9-45a8-a448-8d1ac335b1d4 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:26.271022 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ee1d541-00b9-45a8-a448-8d1ac335b1d4 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:26.272297 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ee1d541-00b9-45a8-a448-8d1ac335b1d4 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:26.272979 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-1ee1d541-00b9-45a8-a448-8d1ac335b1d4 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:26.417739 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-1ee1d541-00b9-45a8-a448-8d1ac335b1d4 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:18:26.425821 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-1ee1d541-00b9-45a8-a448-8d1ac335b1d4 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1723 microversion: 2.1 time: 0.169466 Dec 15 13:18:26.426396 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1533/3044] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:18:26 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:18:27.443776 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c4e9eff1-1861-4361-a450-5d531ccc2d75 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:18:27.444384 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c4e9eff1-1861-4361-a450-5d531ccc2d75 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:27.450895 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c4e9eff1-1861-4361-a450-5d531ccc2d75 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:27.451345 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c4e9eff1-1861-4361-a450-5d531ccc2d75 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:27.452138 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c4e9eff1-1861-4361-a450-5d531ccc2d75 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:27.452572 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c4e9eff1-1861-4361-a450-5d531ccc2d75 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:27.583635 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c4e9eff1-1861-4361-a450-5d531ccc2d75 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:18:27.591796 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c4e9eff1-1861-4361-a450-5d531ccc2d75 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1723 microversion: 2.1 time: 0.151754 Dec 15 13:18:27.592357 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1512/3045] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:18:27 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:18:28.608853 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a48f2214-f1d5-4719-9081-fa4b28e866ab tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:18:28.609388 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a48f2214-f1d5-4719-9081-fa4b28e866ab tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:28.616388 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a48f2214-f1d5-4719-9081-fa4b28e866ab tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:28.616841 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a48f2214-f1d5-4719-9081-fa4b28e866ab tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:28.617679 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a48f2214-f1d5-4719-9081-fa4b28e866ab tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:28.618118 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a48f2214-f1d5-4719-9081-fa4b28e866ab tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:28.749078 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a48f2214-f1d5-4719-9081-fa4b28e866ab tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:18:28.757280 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a48f2214-f1d5-4719-9081-fa4b28e866ab tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1723 microversion: 2.1 time: 0.152089 Dec 15 13:18:28.757905 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1534/3046] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:18:28 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:18:29.774681 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9c28e9a4-1c63-4f6c-a175-45febcd12c49 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:18:29.775304 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9c28e9a4-1c63-4f6c-a175-45febcd12c49 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:29.781608 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9c28e9a4-1c63-4f6c-a175-45febcd12c49 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:29.782059 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9c28e9a4-1c63-4f6c-a175-45febcd12c49 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:29.782832 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9c28e9a4-1c63-4f6c-a175-45febcd12c49 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:29.783267 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9c28e9a4-1c63-4f6c-a175-45febcd12c49 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:29.920928 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-9c28e9a4-1c63-4f6c-a175-45febcd12c49 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:18:29.929346 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9c28e9a4-1c63-4f6c-a175-45febcd12c49 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1723 microversion: 2.1 time: 0.158510 Dec 15 13:18:29.929947 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1513/3047] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:18:29 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:18:30.947053 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0df6e937-281e-44ab-9c5d-8e2936cd916e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:18:30.947602 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0df6e937-281e-44ab-9c5d-8e2936cd916e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:30.954432 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0df6e937-281e-44ab-9c5d-8e2936cd916e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:30.954877 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0df6e937-281e-44ab-9c5d-8e2936cd916e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:30.955662 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0df6e937-281e-44ab-9c5d-8e2936cd916e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:30.956096 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0df6e937-281e-44ab-9c5d-8e2936cd916e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:31.087253 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-0df6e937-281e-44ab-9c5d-8e2936cd916e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:18:31.095140 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0df6e937-281e-44ab-9c5d-8e2936cd916e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1723 microversion: 2.1 time: 0.152506 Dec 15 13:18:31.095702 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1535/3048] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:18:30 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:18:32.114946 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e2113901-fc32-443f-9a36-55a1b99bf60f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:18:32.115989 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e2113901-fc32-443f-9a36-55a1b99bf60f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:32.123391 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e2113901-fc32-443f-9a36-55a1b99bf60f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:32.123841 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e2113901-fc32-443f-9a36-55a1b99bf60f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:32.124615 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e2113901-fc32-443f-9a36-55a1b99bf60f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:32.125053 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e2113901-fc32-443f-9a36-55a1b99bf60f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:32.265199 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e2113901-fc32-443f-9a36-55a1b99bf60f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:18:32.273876 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e2113901-fc32-443f-9a36-55a1b99bf60f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1723 microversion: 2.1 time: 0.162205 Dec 15 13:18:32.274239 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1514/3049] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:18:32 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:18:33.291303 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7f9cdd2a-fdee-4709-96d0-87767847d9c7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:18:33.291948 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7f9cdd2a-fdee-4709-96d0-87767847d9c7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:33.298460 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7f9cdd2a-fdee-4709-96d0-87767847d9c7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:33.298914 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7f9cdd2a-fdee-4709-96d0-87767847d9c7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:33.300040 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7f9cdd2a-fdee-4709-96d0-87767847d9c7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:33.300477 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7f9cdd2a-fdee-4709-96d0-87767847d9c7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:33.438027 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7f9cdd2a-fdee-4709-96d0-87767847d9c7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:18:33.447181 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7f9cdd2a-fdee-4709-96d0-87767847d9c7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1723 microversion: 2.1 time: 0.160163 Dec 15 13:18:33.447764 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1536/3050] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:18:33 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:18:34.464638 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e6938694-e647-4f7d-805d-e7cdc5b372be tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:18:34.465258 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e6938694-e647-4f7d-805d-e7cdc5b372be tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:34.471461 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e6938694-e647-4f7d-805d-e7cdc5b372be tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:34.471900 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e6938694-e647-4f7d-805d-e7cdc5b372be tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:34.472661 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e6938694-e647-4f7d-805d-e7cdc5b372be tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:34.473085 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e6938694-e647-4f7d-805d-e7cdc5b372be tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:34.609681 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-e6938694-e647-4f7d-805d-e7cdc5b372be tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:18:34.618402 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e6938694-e647-4f7d-805d-e7cdc5b372be tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1723 microversion: 2.1 time: 0.157184 Dec 15 13:18:34.619228 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1515/3051] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:18:34 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:18:35.637979 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-21fb21aa-808b-4a30-aefd-8ba758f592ac tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:18:35.638860 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-21fb21aa-808b-4a30-aefd-8ba758f592ac tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:35.648154 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-21fb21aa-808b-4a30-aefd-8ba758f592ac tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:35.648524 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-21fb21aa-808b-4a30-aefd-8ba758f592ac tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:35.649315 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-21fb21aa-808b-4a30-aefd-8ba758f592ac tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:35.649788 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-21fb21aa-808b-4a30-aefd-8ba758f592ac tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:35.787770 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-21fb21aa-808b-4a30-aefd-8ba758f592ac tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:18:35.796105 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-21fb21aa-808b-4a30-aefd-8ba758f592ac tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1723 microversion: 2.1 time: 0.163550 Dec 15 13:18:35.796766 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1537/3052] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:18:35 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:18:36.813820 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-36923fa2-45ff-4621-9b79-586aa6eb25a6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:18:36.814443 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-36923fa2-45ff-4621-9b79-586aa6eb25a6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:36.820679 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-36923fa2-45ff-4621-9b79-586aa6eb25a6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:36.821125 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-36923fa2-45ff-4621-9b79-586aa6eb25a6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:36.821942 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-36923fa2-45ff-4621-9b79-586aa6eb25a6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:36.822374 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-36923fa2-45ff-4621-9b79-586aa6eb25a6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:36.966229 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-36923fa2-45ff-4621-9b79-586aa6eb25a6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:18:36.973761 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-36923fa2-45ff-4621-9b79-586aa6eb25a6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1723 microversion: 2.1 time: 0.163856 Dec 15 13:18:36.974932 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1516/3053] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:18:36 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:18:37.992041 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-8ac8e37a-98f5-485b-a3b0-c3b9a9b72cd7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:18:37.992660 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-8ac8e37a-98f5-485b-a3b0-c3b9a9b72cd7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:37.999228 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8ac8e37a-98f5-485b-a3b0-c3b9a9b72cd7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:37.999683 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8ac8e37a-98f5-485b-a3b0-c3b9a9b72cd7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:38.000468 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8ac8e37a-98f5-485b-a3b0-c3b9a9b72cd7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:38.000907 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-8ac8e37a-98f5-485b-a3b0-c3b9a9b72cd7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:38.143122 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-8ac8e37a-98f5-485b-a3b0-c3b9a9b72cd7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:18:38.151456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-8ac8e37a-98f5-485b-a3b0-c3b9a9b72cd7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1700 microversion: 2.1 time: 0.163832 Dec 15 13:18:38.152027 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1538/3054] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:18:37 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1700 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:18:38.167592 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-5d8e2de1-c2e6-4c5a-8e54-0f36c9a68275 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:18:38.174006 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5d8e2de1-c2e6-4c5a-8e54-0f36c9a68275 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:38.174451 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-5d8e2de1-c2e6-4c5a-8e54-0f36c9a68275 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:38.198719 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-5d8e2de1-c2e6-4c5a-8e54-0f36c9a68275 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Going to try to start instance {{(pid=122615) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 15 13:18:38.247715 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-5d8e2de1-c2e6-4c5a-8e54-0f36c9a68275 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 202 len: 0 microversion: 2.1 time: 0.083483 Dec 15 13:18:38.248287 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1517/3055] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:18:38 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:18:38.256757 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-02507f37-9fb8-4c94-b26f-a5f9e651f9aa tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:18:38.257375 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-02507f37-9fb8-4c94-b26f-a5f9e651f9aa tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:38.263890 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-02507f37-9fb8-4c94-b26f-a5f9e651f9aa tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:38.264631 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-02507f37-9fb8-4c94-b26f-a5f9e651f9aa tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:38.265587 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-02507f37-9fb8-4c94-b26f-a5f9e651f9aa tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:38.266023 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-02507f37-9fb8-4c94-b26f-a5f9e651f9aa tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:38.422463 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-02507f37-9fb8-4c94-b26f-a5f9e651f9aa tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:18:38.430546 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-02507f37-9fb8-4c94-b26f-a5f9e651f9aa tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1709 microversion: 2.1 time: 0.178093 Dec 15 13:18:38.431125 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1539/3056] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:18:38 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1709 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:18:39.449082 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d228381e-0c09-4b07-86a2-a70e4102348d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:18:39.449818 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d228381e-0c09-4b07-86a2-a70e4102348d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:39.455844 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d228381e-0c09-4b07-86a2-a70e4102348d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:39.456291 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d228381e-0c09-4b07-86a2-a70e4102348d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:39.457062 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d228381e-0c09-4b07-86a2-a70e4102348d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:39.457496 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d228381e-0c09-4b07-86a2-a70e4102348d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:39.603676 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d228381e-0c09-4b07-86a2-a70e4102348d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:18:39.611587 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d228381e-0c09-4b07-86a2-a70e4102348d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1709 microversion: 2.1 time: 0.167193 Dec 15 13:18:39.612387 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1518/3057] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:18:39 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1709 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:18:40.628109 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6e18cdbb-2f80-4f8a-8458-3015cb941b61 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:18:40.628691 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6e18cdbb-2f80-4f8a-8458-3015cb941b61 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:18:40.635080 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e18cdbb-2f80-4f8a-8458-3015cb941b61 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:40.635537 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e18cdbb-2f80-4f8a-8458-3015cb941b61 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:40.636319 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e18cdbb-2f80-4f8a-8458-3015cb941b61 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:18:40.636785 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6e18cdbb-2f80-4f8a-8458-3015cb941b61 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:18:40.772250 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6e18cdbb-2f80-4f8a-8458-3015cb941b61 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:18:40.780014 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6e18cdbb-2f80-4f8a-8458-3015cb941b61 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1713 microversion: 2.1 time: 0.155677 Dec 15 13:18:40.780579 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1540/3058] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:18:40 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1713 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:19:13.626054 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f0b94352-0959-4d13-8508-6937fa22268c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:19:13.626645 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f0b94352-0959-4d13-8508-6937fa22268c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:19:13.633043 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f0b94352-0959-4d13-8508-6937fa22268c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:13.633490 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f0b94352-0959-4d13-8508-6937fa22268c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:13.634293 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f0b94352-0959-4d13-8508-6937fa22268c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:13.634731 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f0b94352-0959-4d13-8508-6937fa22268c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:13.715819 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.objects.instance [None req-f0b94352-0959-4d13-8508-6937fa22268c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lazy-loading 'services' on Instance uuid 156953db-d05a-4a97-9bfe-f5c5ee19edc9 {{(pid=122615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:19:13.790409 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f0b94352-0959-4d13-8508-6937fa22268c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "DELETE /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/os-volume_attachments/9dde9e23-0e47-4897-869d-6dade3e792c4" status: 202 len: 0 microversion: 2.1 time: 0.168159 Dec 15 13:19:13.791056 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1519/3059] 10.222.0.76 () {58 vars in 1415 bytes} [Wed Dec 15 13:19:13 2021] DELETE /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/os-volume_attachments/9dde9e23-0e47-4897-869d-6dade3e792c4 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:19:14.901574 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e955e6f7-114b-47a4-9a5e-bff891b3e538 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:19:14.907636 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e955e6f7-114b-47a4-9a5e-bff891b3e538 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:14.908086 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e955e6f7-114b-47a4-9a5e-bff891b3e538 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:14.971124 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e955e6f7-114b-47a4-9a5e-bff891b3e538 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Going to try to stop instance {{(pid=122614) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 15 13:19:15.017791 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e955e6f7-114b-47a4-9a5e-bff891b3e538 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 202 len: 0 microversion: 2.1 time: 0.119386 Dec 15 13:19:15.018569 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1541/3060] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:19:14 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:19:15.028464 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ad319901-6c25-409c-aadb-fa751102b6bc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:19:15.029352 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ad319901-6c25-409c-aadb-fa751102b6bc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:19:15.037636 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad319901-6c25-409c-aadb-fa751102b6bc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:15.038089 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad319901-6c25-409c-aadb-fa751102b6bc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:15.039116 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad319901-6c25-409c-aadb-fa751102b6bc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:15.039815 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ad319901-6c25-409c-aadb-fa751102b6bc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:15.176963 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-ad319901-6c25-409c-aadb-fa751102b6bc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:19:15.184751 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ad319901-6c25-409c-aadb-fa751102b6bc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1677 microversion: 2.1 time: 0.160881 Dec 15 13:19:15.185363 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1520/3061] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:19:15 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:19:16.203867 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a8e46b94-6c70-401b-9494-4198a62bd121 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:19:16.204569 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a8e46b94-6c70-401b-9494-4198a62bd121 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:19:16.211558 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a8e46b94-6c70-401b-9494-4198a62bd121 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:16.212011 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a8e46b94-6c70-401b-9494-4198a62bd121 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:16.212791 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a8e46b94-6c70-401b-9494-4198a62bd121 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:16.213228 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a8e46b94-6c70-401b-9494-4198a62bd121 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:16.359295 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a8e46b94-6c70-401b-9494-4198a62bd121 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:19:16.367361 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a8e46b94-6c70-401b-9494-4198a62bd121 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1677 microversion: 2.1 time: 0.167573 Dec 15 13:19:16.367933 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1542/3062] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:19:16 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:19:17.385073 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-bc5d21db-14e1-4870-95ec-f085a4c6f119 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:19:17.385720 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-bc5d21db-14e1-4870-95ec-f085a4c6f119 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:19:17.391952 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc5d21db-14e1-4870-95ec-f085a4c6f119 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:17.392661 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc5d21db-14e1-4870-95ec-f085a4c6f119 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:17.393421 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc5d21db-14e1-4870-95ec-f085a4c6f119 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:17.393876 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-bc5d21db-14e1-4870-95ec-f085a4c6f119 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:17.524774 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-bc5d21db-14e1-4870-95ec-f085a4c6f119 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:19:17.532566 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-bc5d21db-14e1-4870-95ec-f085a4c6f119 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1677 microversion: 2.1 time: 0.151303 Dec 15 13:19:17.533155 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1521/3063] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:19:17 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:19:18.549742 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-eb79f0c7-7f8d-40a4-a725-925a98bd8cd5 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:19:18.550325 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-eb79f0c7-7f8d-40a4-a725-925a98bd8cd5 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:19:18.556770 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eb79f0c7-7f8d-40a4-a725-925a98bd8cd5 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:18.557221 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eb79f0c7-7f8d-40a4-a725-925a98bd8cd5 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:18.558038 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eb79f0c7-7f8d-40a4-a725-925a98bd8cd5 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:18.558472 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eb79f0c7-7f8d-40a4-a725-925a98bd8cd5 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:18.695505 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-eb79f0c7-7f8d-40a4-a725-925a98bd8cd5 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:19:18.702858 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-eb79f0c7-7f8d-40a4-a725-925a98bd8cd5 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1677 microversion: 2.1 time: 0.156869 Dec 15 13:19:18.703441 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1543/3064] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:19:18 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:19:19.720337 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-22a074a2-b376-4a17-8312-1ea68a232f8b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:19:19.720951 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-22a074a2-b376-4a17-8312-1ea68a232f8b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:19:19.727887 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-22a074a2-b376-4a17-8312-1ea68a232f8b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:19.728336 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-22a074a2-b376-4a17-8312-1ea68a232f8b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:19.729111 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-22a074a2-b376-4a17-8312-1ea68a232f8b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:19.729562 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-22a074a2-b376-4a17-8312-1ea68a232f8b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:19.918513 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-22a074a2-b376-4a17-8312-1ea68a232f8b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:19:19.926130 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-22a074a2-b376-4a17-8312-1ea68a232f8b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1677 microversion: 2.1 time: 0.209373 Dec 15 13:19:19.926710 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1522/3065] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:19:19 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1677 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:19:20.943212 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a493178f-26d7-4afb-9add-9aea537352dd tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:19:20.943782 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a493178f-26d7-4afb-9add-9aea537352dd tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:19:20.950117 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a493178f-26d7-4afb-9add-9aea537352dd tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:20.950519 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a493178f-26d7-4afb-9add-9aea537352dd tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:20.951290 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a493178f-26d7-4afb-9add-9aea537352dd tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:20.951725 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a493178f-26d7-4afb-9add-9aea537352dd tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:21.089003 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-a493178f-26d7-4afb-9add-9aea537352dd tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:19:21.096443 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a493178f-26d7-4afb-9add-9aea537352dd tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1677 microversion: 2.1 time: 0.157061 Dec 15 13:19:21.097007 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1544/3066] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:19:20 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:19:22.114717 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-08136a4a-4059-47c2-86fb-b994b8b46e02 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:19:22.115346 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-08136a4a-4059-47c2-86fb-b994b8b46e02 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:19:22.121416 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-08136a4a-4059-47c2-86fb-b994b8b46e02 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:22.121889 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-08136a4a-4059-47c2-86fb-b994b8b46e02 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:22.122675 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-08136a4a-4059-47c2-86fb-b994b8b46e02 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:22.123107 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-08136a4a-4059-47c2-86fb-b994b8b46e02 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:22.257179 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-08136a4a-4059-47c2-86fb-b994b8b46e02 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:19:22.265152 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-08136a4a-4059-47c2-86fb-b994b8b46e02 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1677 microversion: 2.1 time: 0.155218 Dec 15 13:19:22.265919 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1523/3067] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:19:22 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:19:23.283060 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b965c025-695b-4fb1-88ad-d92c8188ae2b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:19:23.283683 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b965c025-695b-4fb1-88ad-d92c8188ae2b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:19:23.290900 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b965c025-695b-4fb1-88ad-d92c8188ae2b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:23.291198 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b965c025-695b-4fb1-88ad-d92c8188ae2b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:23.291930 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b965c025-695b-4fb1-88ad-d92c8188ae2b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:23.292364 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b965c025-695b-4fb1-88ad-d92c8188ae2b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:23.429631 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b965c025-695b-4fb1-88ad-d92c8188ae2b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:19:23.436894 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b965c025-695b-4fb1-88ad-d92c8188ae2b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1677 microversion: 2.1 time: 0.157447 Dec 15 13:19:23.437477 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1545/3068] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:19:23 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:19:24.453792 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-d3a2c426-3fd4-4704-a072-733c360835d0 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:19:24.454459 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-d3a2c426-3fd4-4704-a072-733c360835d0 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:19:24.461159 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d3a2c426-3fd4-4704-a072-733c360835d0 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:24.461628 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d3a2c426-3fd4-4704-a072-733c360835d0 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:24.462420 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d3a2c426-3fd4-4704-a072-733c360835d0 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:24.462857 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-d3a2c426-3fd4-4704-a072-733c360835d0 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:24.598699 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-d3a2c426-3fd4-4704-a072-733c360835d0 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:19:24.605931 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-d3a2c426-3fd4-4704-a072-733c360835d0 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1677 microversion: 2.1 time: 0.155838 Dec 15 13:19:24.606497 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1524/3069] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:19:24 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:19:25.623512 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e7251456-8652-4fd0-b73c-923517648602 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:19:25.624044 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e7251456-8652-4fd0-b73c-923517648602 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:19:25.631485 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e7251456-8652-4fd0-b73c-923517648602 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:25.631931 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e7251456-8652-4fd0-b73c-923517648602 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:25.632744 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e7251456-8652-4fd0-b73c-923517648602 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:25.633148 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e7251456-8652-4fd0-b73c-923517648602 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:25.766745 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-e7251456-8652-4fd0-b73c-923517648602 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:19:25.775705 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e7251456-8652-4fd0-b73c-923517648602 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1654 microversion: 2.1 time: 0.155881 Dec 15 13:19:25.776282 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1546/3070] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:19:25 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1654 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:19:25.792464 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3b263916-2184-4425-af0f-0469a340625c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:19:25.798743 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3b263916-2184-4425-af0f-0469a340625c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:25.799186 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3b263916-2184-4425-af0f-0469a340625c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:25.822360 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3b263916-2184-4425-af0f-0469a340625c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Going to try to start instance {{(pid=122615) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 15 13:19:25.866182 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3b263916-2184-4425-af0f-0469a340625c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action" status: 202 len: 0 microversion: 2.1 time: 0.077094 Dec 15 13:19:25.867152 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1525/3071] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:19:25 2021] POST /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:19:25.879099 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-7f82b107-19c3-4147-bcea-682b952874b9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:19:25.880380 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-7f82b107-19c3-4147-bcea-682b952874b9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:19:25.886206 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7f82b107-19c3-4147-bcea-682b952874b9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:25.886648 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7f82b107-19c3-4147-bcea-682b952874b9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:25.887456 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7f82b107-19c3-4147-bcea-682b952874b9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:25.887928 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-7f82b107-19c3-4147-bcea-682b952874b9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:26.025388 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-7f82b107-19c3-4147-bcea-682b952874b9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:19:26.033327 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-7f82b107-19c3-4147-bcea-682b952874b9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1663 microversion: 2.1 time: 0.157866 Dec 15 13:19:26.034201 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1547/3072] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:19:25 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:19:27.053780 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7dc3f6fc-b4de-4206-83c6-4a364df4d92a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:19:27.055048 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7dc3f6fc-b4de-4206-83c6-4a364df4d92a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:19:27.061651 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7dc3f6fc-b4de-4206-83c6-4a364df4d92a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:27.062105 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7dc3f6fc-b4de-4206-83c6-4a364df4d92a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:27.062896 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7dc3f6fc-b4de-4206-83c6-4a364df4d92a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:27.063333 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7dc3f6fc-b4de-4206-83c6-4a364df4d92a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:27.206392 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7dc3f6fc-b4de-4206-83c6-4a364df4d92a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:19:27.214663 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7dc3f6fc-b4de-4206-83c6-4a364df4d92a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1667 microversion: 2.1 time: 0.166899 Dec 15 13:19:27.215263 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1526/3073] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:19:27 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1667 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:19:28.881991 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:19:28.882702 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 13:19:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:19:38.565217 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:19:38.565836 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 13:19:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:19:44.313424 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:19:44.314159 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 13:19:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:19:59.975404 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f32f5ca2-06ce-46d8-9595-ccf946913d8f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:19:59.976329 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f32f5ca2-06ce-46d8-9595-ccf946913d8f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:19:59.982735 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f32f5ca2-06ce-46d8-9595-ccf946913d8f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:59.983178 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f32f5ca2-06ce-46d8-9595-ccf946913d8f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:19:59.983955 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f32f5ca2-06ce-46d8-9595-ccf946913d8f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:19:59.984382 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f32f5ca2-06ce-46d8-9595-ccf946913d8f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:00.015074 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f32f5ca2-06ce-46d8-9595-ccf946913d8f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043778 Dec 15 13:20:00.015652 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1548/3074] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 13:19:59 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:20:00.075371 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b23714c1-a2d3-4247-9d86-709ab7c25082 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:20:00.075889 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b23714c1-a2d3-4247-9d86-709ab7c25082 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:00.082104 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b23714c1-a2d3-4247-9d86-709ab7c25082 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:00.082739 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b23714c1-a2d3-4247-9d86-709ab7c25082 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:00.083536 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b23714c1-a2d3-4247-9d86-709ab7c25082 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:00.083973 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b23714c1-a2d3-4247-9d86-709ab7c25082 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:00.110508 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b23714c1-a2d3-4247-9d86-709ab7c25082 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Going to try to terminate instance {{(pid=122615) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:20:00.193870 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b23714c1-a2d3-4247-9d86-709ab7c25082 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "DELETE /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 204 len: 0 microversion: 2.1 time: 0.121887 Dec 15 13:20:00.194404 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1527/3075] 10.222.0.76 () {58 vars in 1238 bytes} [Wed Dec 15 13:20:00 2021] DELETE /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:20:00.202350 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b6af7d4a-b25c-441f-8631-ae9c4e3e0e4f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:20:00.202954 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b6af7d4a-b25c-441f-8631-ae9c4e3e0e4f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:00.209801 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b6af7d4a-b25c-441f-8631-ae9c4e3e0e4f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:00.210246 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b6af7d4a-b25c-441f-8631-ae9c4e3e0e4f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:00.211009 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b6af7d4a-b25c-441f-8631-ae9c4e3e0e4f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:00.211437 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b6af7d4a-b25c-441f-8631-ae9c4e3e0e4f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:00.401591 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-b6af7d4a-b25c-441f-8631-ae9c4e3e0e4f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:20:00.410214 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b6af7d4a-b25c-441f-8631-ae9c4e3e0e4f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1673 microversion: 2.1 time: 0.211139 Dec 15 13:20:00.410797 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1549/3076] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:20:00 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1673 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:20:01.428060 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-6a664e81-31dd-4047-9135-6c5d4d3ee164 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:20:01.428770 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-6a664e81-31dd-4047-9135-6c5d4d3ee164 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:01.435188 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6a664e81-31dd-4047-9135-6c5d4d3ee164 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:01.435636 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6a664e81-31dd-4047-9135-6c5d4d3ee164 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:01.436435 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6a664e81-31dd-4047-9135-6c5d4d3ee164 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:01.436872 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-6a664e81-31dd-4047-9135-6c5d4d3ee164 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:01.580462 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-6a664e81-31dd-4047-9135-6c5d4d3ee164 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:20:01.588475 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-6a664e81-31dd-4047-9135-6c5d4d3ee164 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1673 microversion: 2.1 time: 0.164542 Dec 15 13:20:01.589030 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1528/3077] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:20:01 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:20:02.605317 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-257566f6-cfa3-432f-8430-56877707ebec tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:20:02.606201 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-257566f6-cfa3-432f-8430-56877707ebec tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:02.612967 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-257566f6-cfa3-432f-8430-56877707ebec tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:02.614125 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-257566f6-cfa3-432f-8430-56877707ebec tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:02.615023 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-257566f6-cfa3-432f-8430-56877707ebec tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:02.615457 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-257566f6-cfa3-432f-8430-56877707ebec tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:02.762655 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-257566f6-cfa3-432f-8430-56877707ebec tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:20:02.771052 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-257566f6-cfa3-432f-8430-56877707ebec tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1673 microversion: 2.1 time: 0.169333 Dec 15 13:20:02.771627 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1550/3078] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:20:02 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:20:03.532300 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [req-732b8de6-654a-45e8-be0e-0e42e272613d req-5b4004fe-31f5-4341-ae6f-e307856f87b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "156953db-d05a-4a97-9bfe-f5c5ee19edc9", "name": "network-vif-deleted", "tag": "d6c08910-596b-47af-854e-0c26715de1c8"}]} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:03.536091 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:20:03.536091 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: warnings.warn(msg) Dec 15 13:20:03.545720 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-732b8de6-654a-45e8-be0e-0e42e272613d req-5b4004fe-31f5-4341-ae6f-e307856f87b3 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:03.546329 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-732b8de6-654a-45e8-be0e-0e42e272613d req-5b4004fe-31f5-4341-ae6f-e307856f87b3 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:03.558386 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.compute.server_external_events [req-732b8de6-654a-45e8-be0e-0e42e272613d req-5b4004fe-31f5-4341-ae6f-e307856f87b3 service nova] Creating event network-vif-deleted:d6c08910-596b-47af-854e-0c26715de1c8 for instance 156953db-d05a-4a97-9bfe-f5c5ee19edc9 on hv-cinder-81322 Dec 15 13:20:03.564028 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [req-732b8de6-654a-45e8-be0e-0e42e272613d req-5b4004fe-31f5-4341-ae6f-e307856f87b3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116264 Dec 15 13:20:03.564634 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1529/3079] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:20:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:20:03.791967 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f94da187-e649-4d16-8cf9-82128abdcdee tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:20:03.792524 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f94da187-e649-4d16-8cf9-82128abdcdee tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:03.799129 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f94da187-e649-4d16-8cf9-82128abdcdee tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:03.799582 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f94da187-e649-4d16-8cf9-82128abdcdee tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:03.800463 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f94da187-e649-4d16-8cf9-82128abdcdee tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:03.800980 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f94da187-e649-4d16-8cf9-82128abdcdee tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:03.831367 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f94da187-e649-4d16-8cf9-82128abdcdee tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:03.832461 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f94da187-e649-4d16-8cf9-82128abdcdee tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:03.832916 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.objects.instance [None req-f94da187-e649-4d16-8cf9-82128abdcdee tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lazy-loading 'fault' on Instance uuid 156953db-d05a-4a97-9bfe-f5c5ee19edc9 {{(pid=122614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:20:03.871918 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-f94da187-e649-4d16-8cf9-82128abdcdee tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:20:03.879918 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f94da187-e649-4d16-8cf9-82128abdcdee tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 200 len: 1327 microversion: 2.1 time: 0.095385 Dec 15 13:20:03.880488 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1551/3080] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:20:03 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 1327 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:20:04.906803 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4a071bd0-9f29-423e-9f22-c3dd61bb6842 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:20:04.908231 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4a071bd0-9f29-423e-9f22-c3dd61bb6842 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:04.918804 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a071bd0-9f29-423e-9f22-c3dd61bb6842 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:04.919244 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a071bd0-9f29-423e-9f22-c3dd61bb6842 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:04.920030 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a071bd0-9f29-423e-9f22-c3dd61bb6842 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:04.920460 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a071bd0-9f29-423e-9f22-c3dd61bb6842 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:04.940219 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.wsgi [None req-4a071bd0-9f29-423e-9f22-c3dd61bb6842 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] HTTP exception thrown: Instance 156953db-d05a-4a97-9bfe-f5c5ee19edc9 could not be found. Dec 15 13:20:04.941826 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4a071bd0-9f29-423e-9f22-c3dd61bb6842 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Returning 404 to user: Instance 156953db-d05a-4a97-9bfe-f5c5ee19edc9 could not be found. {{(pid=122615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:20:04.943671 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4a071bd0-9f29-423e-9f22-c3dd61bb6842 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 404 len: 111 microversion: 2.1 time: 0.040638 Dec 15 13:20:04.944548 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1530/3081] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:20:04 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:20:04.953307 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ffd058dd-d388-49f6-9e7f-2c711640ad8a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '.version_select at 0x7f3c68c5f280>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:20:04.975778 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ffd058dd-d388-49f6-9e7f-2c711640ad8a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-547748653" status: 202 len: 0 microversion: 2.1 time: 0.026491 Dec 15 13:20:04.976286 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1552/3082] 10.222.0.76 () {58 vars in 1217 bytes} [Wed Dec 15 13:20:04 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-547748653 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:20:05.686243 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-161b0622-e07b-443c-9f71-3c1c68ec1fcc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'create', calling method: .version_select at 0x7f3c6925b160>, body: {"keypair": {"name": "tempest-keypair-2135826760"}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:05.699794 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-161b0622-e07b-443c-9f71-3c1c68ec1fcc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Getting quotas for project e14d0b1e292642178957ec76e117319f. Resources: {'key_pairs'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:20:05.703553 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-161b0622-e07b-443c-9f71-3c1c68ec1fcc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Getting quotas for user c2e8e15913354e24ac86a7d6ad02960f and project e14d0b1e292642178957ec76e117319f. Resources: {'key_pairs'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:20:05.995268 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-161b0622-e07b-443c-9f71-3c1c68ec1fcc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Getting quotas for project e14d0b1e292642178957ec76e117319f. Resources: {'key_pairs'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:20:05.999008 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.quota [None req-161b0622-e07b-443c-9f71-3c1c68ec1fcc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Getting quotas for user c2e8e15913354e24ac86a7d6ad02960f and project e14d0b1e292642178957ec76e117319f. Resources: {'key_pairs'} {{(pid=122615) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:20:06.013102 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-161b0622-e07b-443c-9f71-3c1c68ec1fcc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.330526 Dec 15 13:20:06.013760 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1531/3083] 10.222.0.76 () {60 vars in 1157 bytes} [Wed Dec 15 13:20:05 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:20:07.289330 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0070977f-91db-4bc0-a929-0a7e204522c1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-251763830", "imageRef": "d302555e-2bff-4492-b57d-d59c0097a278", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4748d35a-8673-45a0-b07b-cb658dfc749d"}], "security_groups": [{"name": "tempest-securitygroup--660605807"}], "key_name": "tempest-keypair-2135826760", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:07.398134 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.network.neutron [None req-0070977f-91db-4bc0-a929-0a7e204522c1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] validate_networks() for [('4748d35a-8673-45a0-b07b-cb658dfc749d', None, None, None, None, None)] {{(pid=122614) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:20:07.821987 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-0070977f-91db-4bc0-a929-0a7e204522c1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Flavor limits 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:20:07.822408 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-0070977f-91db-4bc0-a929-0a7e204522c1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Image limits 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:20:07.822888 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-0070977f-91db-4bc0-a929-0a7e204522c1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Flavor pref 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:20:07.823298 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-0070977f-91db-4bc0-a929-0a7e204522c1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Image pref 0:0:0 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:20:07.823761 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.virt.hardware [None req-0070977f-91db-4bc0-a929-0a7e204522c1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:20:07.832792 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0070977f-91db-4bc0-a929-0a7e204522c1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:07.833325 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0070977f-91db-4bc0-a929-0a7e204522c1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:07.834167 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0070977f-91db-4bc0-a929-0a7e204522c1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:07.834603 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0070977f-91db-4bc0-a929-0a7e204522c1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:07.850541 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-0070977f-91db-4bc0-a929-0a7e204522c1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Getting quotas for project e14d0b1e292642178957ec76e117319f. Resources: {'instances', 'cores', 'ram'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:20:07.854479 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.quota [None req-0070977f-91db-4bc0-a929-0a7e204522c1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Getting quotas for user c2e8e15913354e24ac86a7d6ad02960f and project e14d0b1e292642178957ec76e117319f. Resources: {'instances', 'cores', 'ram'} {{(pid=122614) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:20:07.867219 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0070977f-91db-4bc0-a929-0a7e204522c1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Going to run 1 instances... {{(pid=122614) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:20:07.869563 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0070977f-91db-4bc0-a929-0a7e204522c1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d302555e-2bff-4492-b57d-d59c0097a278',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:20:07.923747 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0070977f-91db-4bc0-a929-0a7e204522c1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.639614 Dec 15 13:20:07.924391 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1553/3084] 10.222.0.76 () {60 vars in 1146 bytes} [Wed Dec 15 13:20:07 2021] POST /compute/v2.1/servers => generated 401 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:20:07.935113 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c746f39b-80af-4822-92f8-db3f09adb96b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:20:07.935703 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c746f39b-80af-4822-92f8-db3f09adb96b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:08.005763 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c746f39b-80af-4822-92f8-db3f09adb96b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:20:08.013009 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c746f39b-80af-4822-92f8-db3f09adb96b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37" status: 200 len: 1237 microversion: 2.1 time: 0.081864 Dec 15 13:20:08.014618 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1532/3085] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:20:07 2021] GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37 => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:20:09.031692 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-6c487cac-50ff-42bd-b497-b899f344069a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:20:09.033148 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-6c487cac-50ff-42bd-b497-b899f344069a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:09.040304 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c487cac-50ff-42bd-b497-b899f344069a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:09.040746 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c487cac-50ff-42bd-b497-b899f344069a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:09.041558 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c487cac-50ff-42bd-b497-b899f344069a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:09.042676 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-6c487cac-50ff-42bd-b497-b899f344069a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:09.107111 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-6c487cac-50ff-42bd-b497-b899f344069a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:20:09.117392 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-6c487cac-50ff-42bd-b497-b899f344069a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37" status: 200 len: 1289 microversion: 2.1 time: 0.089720 Dec 15 13:20:09.119211 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1554/3086] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:20:09 2021] GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37 => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:20:10.136365 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-7040939a-722e-489c-b90f-979c44c42079 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:20:10.137244 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-7040939a-722e-489c-b90f-979c44c42079 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:10.148302 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7040939a-722e-489c-b90f-979c44c42079 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:10.149347 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7040939a-722e-489c-b90f-979c44c42079 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:10.150988 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7040939a-722e-489c-b90f-979c44c42079 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:10.151636 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-7040939a-722e-489c-b90f-979c44c42079 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:10.294390 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-7040939a-722e-489c-b90f-979c44c42079 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:20:10.307436 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-7040939a-722e-489c-b90f-979c44c42079 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37" status: 200 len: 1362 microversion: 2.1 time: 0.175085 Dec 15 13:20:10.308040 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1533/3087] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:20:10 2021] GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:20:10.606409 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [req-addbc363-2ec2-4cd2-9f2b-d3c79818d4fd req-19c7d21d-aa21-4bd2-b9d6-c0072f0ed311 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c86be3b-964a-48c0-b8f9-698cee399b37", "tag": "10145ee6-eec3-4466-bb6a-d11d20586f37"}]} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:10.608015 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:20:10.608015 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: warnings.warn(msg) Dec 15 13:20:10.616347 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-addbc363-2ec2-4cd2-9f2b-d3c79818d4fd req-19c7d21d-aa21-4bd2-b9d6-c0072f0ed311 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:10.617207 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [req-addbc363-2ec2-4cd2-9f2b-d3c79818d4fd req-19c7d21d-aa21-4bd2-b9d6-c0072f0ed311 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:10.632354 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.compute.server_external_events [req-addbc363-2ec2-4cd2-9f2b-d3c79818d4fd req-19c7d21d-aa21-4bd2-b9d6-c0072f0ed311 service nova] Creating event network-changed:10145ee6-eec3-4466-bb6a-d11d20586f37 for instance 7c86be3b-964a-48c0-b8f9-698cee399b37 on hv-cinder-81322 Dec 15 13:20:10.639227 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [req-addbc363-2ec2-4cd2-9f2b-d3c79818d4fd req-19c7d21d-aa21-4bd2-b9d6-c0072f0ed311 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036225 Dec 15 13:20:10.639868 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1555/3088] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:20:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:20:11.326874 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1c773004-6d1c-4e47-b1bf-667db3dad64f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:20:11.327487 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1c773004-6d1c-4e47-b1bf-667db3dad64f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:11.334376 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1c773004-6d1c-4e47-b1bf-667db3dad64f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:11.334819 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1c773004-6d1c-4e47-b1bf-667db3dad64f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:11.335597 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1c773004-6d1c-4e47-b1bf-667db3dad64f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:11.336028 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1c773004-6d1c-4e47-b1bf-667db3dad64f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:11.478324 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-1c773004-6d1c-4e47-b1bf-667db3dad64f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:20:11.485389 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1c773004-6d1c-4e47-b1bf-667db3dad64f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37" status: 200 len: 1362 microversion: 2.1 time: 0.162153 Dec 15 13:20:11.486012 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1534/3089] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:20:11 2021] GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:20:12.502992 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-32ac15fc-c4ae-461d-bfa9-b54be9c7da0e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:20:12.503857 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-32ac15fc-c4ae-461d-bfa9-b54be9c7da0e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:12.510538 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-32ac15fc-c4ae-461d-bfa9-b54be9c7da0e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:12.510990 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-32ac15fc-c4ae-461d-bfa9-b54be9c7da0e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:12.511781 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-32ac15fc-c4ae-461d-bfa9-b54be9c7da0e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:12.512218 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-32ac15fc-c4ae-461d-bfa9-b54be9c7da0e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:12.653101 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-32ac15fc-c4ae-461d-bfa9-b54be9c7da0e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:20:12.661620 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-32ac15fc-c4ae-461d-bfa9-b54be9c7da0e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37" status: 200 len: 1362 microversion: 2.1 time: 0.162719 Dec 15 13:20:12.662211 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1556/3090] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:20:12 2021] GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:20:13.679191 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c44e50c4-1392-4c33-94c5-088d16d34942 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:20:13.679898 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c44e50c4-1392-4c33-94c5-088d16d34942 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:13.686268 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c44e50c4-1392-4c33-94c5-088d16d34942 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:13.686571 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c44e50c4-1392-4c33-94c5-088d16d34942 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:13.687351 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c44e50c4-1392-4c33-94c5-088d16d34942 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:13.687776 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c44e50c4-1392-4c33-94c5-088d16d34942 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:13.829393 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c44e50c4-1392-4c33-94c5-088d16d34942 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:20:13.837314 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c44e50c4-1392-4c33-94c5-088d16d34942 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37" status: 200 len: 1362 microversion: 2.1 time: 0.162552 Dec 15 13:20:13.837917 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1535/3091] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:20:13 2021] GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:20:14.854375 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-09c0f9c1-3d0d-47ed-8357-e41c28932f2f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:20:14.854974 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-09c0f9c1-3d0d-47ed-8357-e41c28932f2f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:14.861359 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-09c0f9c1-3d0d-47ed-8357-e41c28932f2f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:14.861840 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-09c0f9c1-3d0d-47ed-8357-e41c28932f2f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:14.862658 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-09c0f9c1-3d0d-47ed-8357-e41c28932f2f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:14.863096 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-09c0f9c1-3d0d-47ed-8357-e41c28932f2f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:15.002223 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-09c0f9c1-3d0d-47ed-8357-e41c28932f2f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:20:15.010219 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-09c0f9c1-3d0d-47ed-8357-e41c28932f2f tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37" status: 200 len: 1362 microversion: 2.1 time: 0.159456 Dec 15 13:20:15.010785 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1557/3092] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:20:14 2021] GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:20:15.914797 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [req-cb5f4bc9-30f2-4ccc-bdfe-f2d8c6080e0b req-0e3688c4-1aed-4967-a297-d76b19f33ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c86be3b-964a-48c0-b8f9-698cee399b37", "name": "network-vif-plugged", "status": "completed", "tag": "10145ee6-eec3-4466-bb6a-d11d20586f37"}]} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:15.916327 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:20:15.916327 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: warnings.warn(msg) Dec 15 13:20:15.923165 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-cb5f4bc9-30f2-4ccc-bdfe-f2d8c6080e0b req-0e3688c4-1aed-4967-a297-d76b19f33ea2 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:15.923536 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-cb5f4bc9-30f2-4ccc-bdfe-f2d8c6080e0b req-0e3688c4-1aed-4967-a297-d76b19f33ea2 service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:15.936099 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.compute.server_external_events [req-cb5f4bc9-30f2-4ccc-bdfe-f2d8c6080e0b req-0e3688c4-1aed-4967-a297-d76b19f33ea2 service nova] Creating event network-vif-plugged:10145ee6-eec3-4466-bb6a-d11d20586f37 for instance 7c86be3b-964a-48c0-b8f9-698cee399b37 on hv-cinder-81322 Dec 15 13:20:15.941101 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [req-cb5f4bc9-30f2-4ccc-bdfe-f2d8c6080e0b req-0e3688c4-1aed-4967-a297-d76b19f33ea2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098302 Dec 15 13:20:15.942084 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1536/3093] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:20:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:20:16.027723 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-02d14f2a-f515-40e2-ac99-f57e28a9d42b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:20:16.028366 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-02d14f2a-f515-40e2-ac99-f57e28a9d42b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:16.035290 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-02d14f2a-f515-40e2-ac99-f57e28a9d42b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:16.035758 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-02d14f2a-f515-40e2-ac99-f57e28a9d42b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:16.036565 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-02d14f2a-f515-40e2-ac99-f57e28a9d42b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:16.037007 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-02d14f2a-f515-40e2-ac99-f57e28a9d42b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:16.175974 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-02d14f2a-f515-40e2-ac99-f57e28a9d42b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:20:16.183107 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-02d14f2a-f515-40e2-ac99-f57e28a9d42b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37" status: 200 len: 1362 microversion: 2.1 time: 0.158993 Dec 15 13:20:16.183851 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1558/3094] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:20:16 2021] GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:20:17.200944 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-26269687-36ea-4fc4-967a-e8ade307e62b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:20:17.201668 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-26269687-36ea-4fc4-967a-e8ade307e62b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:17.207722 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-26269687-36ea-4fc4-967a-e8ade307e62b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:17.208171 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-26269687-36ea-4fc4-967a-e8ade307e62b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:17.208944 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-26269687-36ea-4fc4-967a-e8ade307e62b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:17.209378 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-26269687-36ea-4fc4-967a-e8ade307e62b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:17.349110 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-26269687-36ea-4fc4-967a-e8ade307e62b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:20:17.357299 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-26269687-36ea-4fc4-967a-e8ade307e62b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37" status: 200 len: 1362 microversion: 2.1 time: 0.160666 Dec 15 13:20:17.358150 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1537/3095] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:20:17 2021] GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:20:18.374462 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-eff496c5-9913-4414-af04-abe7091aa222 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:20:18.375065 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-eff496c5-9913-4414-af04-abe7091aa222 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:18.381569 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eff496c5-9913-4414-af04-abe7091aa222 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:18.382015 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eff496c5-9913-4414-af04-abe7091aa222 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:18.382802 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eff496c5-9913-4414-af04-abe7091aa222 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:18.383230 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-eff496c5-9913-4414-af04-abe7091aa222 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:18.518687 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-eff496c5-9913-4414-af04-abe7091aa222 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:20:18.526861 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-eff496c5-9913-4414-af04-abe7091aa222 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37" status: 200 len: 1547 microversion: 2.1 time: 0.156038 Dec 15 13:20:18.527435 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1559/3096] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:20:18 2021] GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:20:18.543321 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-f41fee25-c738-4fef-8420-8970014f9dda tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:20:18.543862 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-f41fee25-c738-4fef-8420-8970014f9dda tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:18.551169 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f41fee25-c738-4fef-8420-8970014f9dda tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:18.551611 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f41fee25-c738-4fef-8420-8970014f9dda tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:18.552459 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f41fee25-c738-4fef-8420-8970014f9dda tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:18.552835 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-f41fee25-c738-4fef-8420-8970014f9dda tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:18.631692 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-f41fee25-c738-4fef-8420-8970014f9dda tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092025 Dec 15 13:20:18.632282 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1538/3097] 10.222.0.76 () {58 vars in 1274 bytes} [Wed Dec 15 13:20:18 2021] GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:20:19.837340 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-e8c17bfc-8db9-4532-a0f0-b8b673a037ba tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:19.838280 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-e8c17bfc-8db9-4532-a0f0-b8b673a037ba tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:19.846590 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e8c17bfc-8db9-4532-a0f0-b8b673a037ba tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:19.847708 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e8c17bfc-8db9-4532-a0f0-b8b673a037ba tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:19.848964 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e8c17bfc-8db9-4532-a0f0-b8b673a037ba tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:19.849404 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-e8c17bfc-8db9-4532-a0f0-b8b673a037ba tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:19.904750 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [req-e085fba0-416d-4661-ab41-567e89ffa33f req-1639d9df-8631-43f4-8b74-4e3a2571598d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c86be3b-964a-48c0-b8f9-698cee399b37", "tag": "10145ee6-eec3-4466-bb6a-d11d20586f37"}]} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:19.906414 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:20:19.906414 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: warnings.warn(msg) Dec 15 13:20:19.913959 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-e085fba0-416d-4661-ab41-567e89ffa33f req-1639d9df-8631-43f4-8b74-4e3a2571598d service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:19.914199 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-e8c17bfc-8db9-4532-a0f0-b8b673a037ba tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 14 microversion: 2.1 time: 0.080319 Dec 15 13:20:19.914564 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-e085fba0-416d-4661-ab41-567e89ffa33f req-1639d9df-8631-43f4-8b74-4e3a2571598d service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:19.917784 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1560/3098] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:19 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:20:19.925611 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.compute.server_external_events [req-e085fba0-416d-4661-ab41-567e89ffa33f req-1639d9df-8631-43f4-8b74-4e3a2571598d service nova] Creating event network-changed:10145ee6-eec3-4466-bb6a-d11d20586f37 for instance 7c86be3b-964a-48c0-b8f9-698cee399b37 on hv-cinder-81322 Dec 15 13:20:19.930575 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [req-e085fba0-416d-4661-ab41-567e89ffa33f req-1639d9df-8631-43f4-8b74-4e3a2571598d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094081 Dec 15 13:20:19.931242 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1539/3099] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:20:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:20:20.925948 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-dbe8e263-1b3d-4c15-a047-d68eca5855f3 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:20.926944 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-dbe8e263-1b3d-4c15-a047-d68eca5855f3 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:20.933979 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dbe8e263-1b3d-4c15-a047-d68eca5855f3 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:20.934470 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dbe8e263-1b3d-4c15-a047-d68eca5855f3 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:20.935337 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dbe8e263-1b3d-4c15-a047-d68eca5855f3 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:20.935847 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-dbe8e263-1b3d-4c15-a047-d68eca5855f3 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:20.998027 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-dbe8e263-1b3d-4c15-a047-d68eca5855f3 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 14 microversion: 2.1 time: 0.076506 Dec 15 13:20:20.998674 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1561/3100] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:20 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:20:22.009324 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e3ed1c7f-4ae0-468c-8ab8-e83ccfc1d8bc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:22.010332 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e3ed1c7f-4ae0-468c-8ab8-e83ccfc1d8bc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:22.016432 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e3ed1c7f-4ae0-468c-8ab8-e83ccfc1d8bc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:22.016882 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e3ed1c7f-4ae0-468c-8ab8-e83ccfc1d8bc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:22.017946 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e3ed1c7f-4ae0-468c-8ab8-e83ccfc1d8bc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:22.018386 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e3ed1c7f-4ae0-468c-8ab8-e83ccfc1d8bc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:22.082596 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e3ed1c7f-4ae0-468c-8ab8-e83ccfc1d8bc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 14 microversion: 2.1 time: 0.077460 Dec 15 13:20:22.083272 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1540/3101] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:22 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:20:23.094399 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f3cff269-37e0-4787-bd65-6e4503baa31e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:23.095332 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f3cff269-37e0-4787-bd65-6e4503baa31e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:23.102414 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f3cff269-37e0-4787-bd65-6e4503baa31e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:23.102861 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f3cff269-37e0-4787-bd65-6e4503baa31e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:23.103636 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f3cff269-37e0-4787-bd65-6e4503baa31e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:23.104074 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f3cff269-37e0-4787-bd65-6e4503baa31e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:23.171396 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f3cff269-37e0-4787-bd65-6e4503baa31e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 14 microversion: 2.1 time: 0.081170 Dec 15 13:20:23.172039 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1562/3102] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:23 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:20:24.182429 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-52de7ad3-96d2-4496-9da4-70e5bfb355b9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:24.183433 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-52de7ad3-96d2-4496-9da4-70e5bfb355b9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:24.190250 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-52de7ad3-96d2-4496-9da4-70e5bfb355b9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:24.191369 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-52de7ad3-96d2-4496-9da4-70e5bfb355b9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:24.192260 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-52de7ad3-96d2-4496-9da4-70e5bfb355b9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:24.192687 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-52de7ad3-96d2-4496-9da4-70e5bfb355b9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:24.252413 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-52de7ad3-96d2-4496-9da4-70e5bfb355b9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 14 microversion: 2.1 time: 0.073744 Dec 15 13:20:24.253666 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1541/3103] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:24 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:20:25.263980 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c69ae3f6-4bf6-40bc-bf7a-59b106ba82a8 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:25.265035 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c69ae3f6-4bf6-40bc-bf7a-59b106ba82a8 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:25.273341 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c69ae3f6-4bf6-40bc-bf7a-59b106ba82a8 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:25.273795 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c69ae3f6-4bf6-40bc-bf7a-59b106ba82a8 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:25.274587 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c69ae3f6-4bf6-40bc-bf7a-59b106ba82a8 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:25.275024 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c69ae3f6-4bf6-40bc-bf7a-59b106ba82a8 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:25.338903 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c69ae3f6-4bf6-40bc-bf7a-59b106ba82a8 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 14 microversion: 2.1 time: 0.078988 Dec 15 13:20:25.342055 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1563/3104] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:25 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 13:20:26.350341 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-019c03e0-9f6e-4a8f-850b-a104a5a1c77e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:26.351345 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-019c03e0-9f6e-4a8f-850b-a104a5a1c77e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:26.358799 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-019c03e0-9f6e-4a8f-850b-a104a5a1c77e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:26.359246 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-019c03e0-9f6e-4a8f-850b-a104a5a1c77e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:26.360064 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-019c03e0-9f6e-4a8f-850b-a104a5a1c77e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:26.360502 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-019c03e0-9f6e-4a8f-850b-a104a5a1c77e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:26.424604 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-019c03e0-9f6e-4a8f-850b-a104a5a1c77e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 14 microversion: 2.1 time: 0.078525 Dec 15 13:20:26.425905 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1542/3105] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:26 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:20:27.437610 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-670e09ff-ddfc-41b1-b946-920b1c621922 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:27.438644 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-670e09ff-ddfc-41b1-b946-920b1c621922 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:27.446223 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-670e09ff-ddfc-41b1-b946-920b1c621922 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:27.446678 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-670e09ff-ddfc-41b1-b946-920b1c621922 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:27.447457 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-670e09ff-ddfc-41b1-b946-920b1c621922 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:27.447896 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-670e09ff-ddfc-41b1-b946-920b1c621922 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:27.517393 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-670e09ff-ddfc-41b1-b946-920b1c621922 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 14 microversion: 2.1 time: 0.083633 Dec 15 13:20:27.518368 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1564/3106] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:27 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 13:20:28.529074 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-effab9cd-29ba-4cec-9c80-28523cc160a2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:28.530094 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-effab9cd-29ba-4cec-9c80-28523cc160a2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:28.537097 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-effab9cd-29ba-4cec-9c80-28523cc160a2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:28.537560 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-effab9cd-29ba-4cec-9c80-28523cc160a2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:28.538335 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-effab9cd-29ba-4cec-9c80-28523cc160a2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:28.538769 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-effab9cd-29ba-4cec-9c80-28523cc160a2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:28.603912 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-effab9cd-29ba-4cec-9c80-28523cc160a2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 14 microversion: 2.1 time: 0.078536 Dec 15 13:20:28.604486 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1543/3107] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:28 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:20:29.615558 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-29fa3eff-d6bd-424e-b97d-1275b99549d7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:29.616463 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-29fa3eff-d6bd-424e-b97d-1275b99549d7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:29.623469 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-29fa3eff-d6bd-424e-b97d-1275b99549d7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:29.623948 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-29fa3eff-d6bd-424e-b97d-1275b99549d7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:29.624720 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-29fa3eff-d6bd-424e-b97d-1275b99549d7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:29.625149 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-29fa3eff-d6bd-424e-b97d-1275b99549d7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:29.703772 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-29fa3eff-d6bd-424e-b97d-1275b99549d7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 7429 microversion: 2.1 time: 0.092713 Dec 15 13:20:29.704445 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1565/3108] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:29 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 7429 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:20:30.715681 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-61371432-1c38-408f-8612-a8267eaf4f9c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:30.716665 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-61371432-1c38-408f-8612-a8267eaf4f9c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:30.724227 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-61371432-1c38-408f-8612-a8267eaf4f9c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:30.724664 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-61371432-1c38-408f-8612-a8267eaf4f9c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:30.725426 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-61371432-1c38-408f-8612-a8267eaf4f9c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:30.725876 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-61371432-1c38-408f-8612-a8267eaf4f9c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:30.807844 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-61371432-1c38-408f-8612-a8267eaf4f9c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 15493 microversion: 2.1 time: 0.095922 Dec 15 13:20:30.808587 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1544/3109] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:30 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 15493 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:20:31.820170 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c43c4d00-f832-43e5-9743-e6e3940b7f71 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:31.821176 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c43c4d00-f832-43e5-9743-e6e3940b7f71 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:31.828334 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c43c4d00-f832-43e5-9743-e6e3940b7f71 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:31.828789 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c43c4d00-f832-43e5-9743-e6e3940b7f71 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:31.829614 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c43c4d00-f832-43e5-9743-e6e3940b7f71 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:31.830051 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c43c4d00-f832-43e5-9743-e6e3940b7f71 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:31.907983 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c43c4d00-f832-43e5-9743-e6e3940b7f71 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 17960 microversion: 2.1 time: 0.091867 Dec 15 13:20:31.908658 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1566/3110] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:31 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 17960 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:20:32.920584 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e7004f49-9a59-48c3-a96b-0243cd97c2d4 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:32.921647 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e7004f49-9a59-48c3-a96b-0243cd97c2d4 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:32.931963 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e7004f49-9a59-48c3-a96b-0243cd97c2d4 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:32.932396 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e7004f49-9a59-48c3-a96b-0243cd97c2d4 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:32.933290 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e7004f49-9a59-48c3-a96b-0243cd97c2d4 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:32.933759 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e7004f49-9a59-48c3-a96b-0243cd97c2d4 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:33.021359 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e7004f49-9a59-48c3-a96b-0243cd97c2d4 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 19342 microversion: 2.1 time: 0.104420 Dec 15 13:20:33.021981 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1545/3111] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:32 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 19342 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:20:34.033351 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0e05ad68-b0ba-4063-b4df-2fdc5307e69a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:34.034447 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0e05ad68-b0ba-4063-b4df-2fdc5307e69a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:34.041398 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0e05ad68-b0ba-4063-b4df-2fdc5307e69a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:34.041877 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0e05ad68-b0ba-4063-b4df-2fdc5307e69a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:34.042669 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0e05ad68-b0ba-4063-b4df-2fdc5307e69a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:34.043110 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0e05ad68-b0ba-4063-b4df-2fdc5307e69a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:34.114776 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0e05ad68-b0ba-4063-b4df-2fdc5307e69a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 22113 microversion: 2.1 time: 0.085262 Dec 15 13:20:34.115648 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1567/3112] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:34 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 22113 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:20:35.127945 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-14f0ec49-0f75-4005-9fa0-df001e900a00 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:35.128941 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-14f0ec49-0f75-4005-9fa0-df001e900a00 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:35.135835 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-14f0ec49-0f75-4005-9fa0-df001e900a00 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:35.136280 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-14f0ec49-0f75-4005-9fa0-df001e900a00 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:35.137056 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-14f0ec49-0f75-4005-9fa0-df001e900a00 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:35.137488 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-14f0ec49-0f75-4005-9fa0-df001e900a00 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:35.225938 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-14f0ec49-0f75-4005-9fa0-df001e900a00 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 23229 microversion: 2.1 time: 0.101923 Dec 15 13:20:35.226590 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1546/3113] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:35 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 23229 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:20:36.238469 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-86441382-b92c-4468-9ab7-37e0d4532983 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:36.239472 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-86441382-b92c-4468-9ab7-37e0d4532983 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:36.246404 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-86441382-b92c-4468-9ab7-37e0d4532983 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:36.246858 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-86441382-b92c-4468-9ab7-37e0d4532983 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:36.247669 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-86441382-b92c-4468-9ab7-37e0d4532983 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:36.248112 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-86441382-b92c-4468-9ab7-37e0d4532983 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:36.323218 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-86441382-b92c-4468-9ab7-37e0d4532983 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 24822 microversion: 2.1 time: 0.089217 Dec 15 13:20:36.323914 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1568/3114] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:36 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 24822 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:20:37.336063 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-388bfabb-57ab-40b1-a1f3-5dee350ce1e3 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:37.337732 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-388bfabb-57ab-40b1-a1f3-5dee350ce1e3 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:37.344311 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-388bfabb-57ab-40b1-a1f3-5dee350ce1e3 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:37.344762 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-388bfabb-57ab-40b1-a1f3-5dee350ce1e3 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:37.345562 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-388bfabb-57ab-40b1-a1f3-5dee350ce1e3 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:37.345998 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-388bfabb-57ab-40b1-a1f3-5dee350ce1e3 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:37.430577 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-388bfabb-57ab-40b1-a1f3-5dee350ce1e3 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 26436 microversion: 2.1 time: 0.098208 Dec 15 13:20:37.431215 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1547/3115] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:37 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 26436 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:20:38.442755 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-29663277-5531-47fe-88c9-d3dae14d9ddd tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:38.443793 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-29663277-5531-47fe-88c9-d3dae14d9ddd tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:38.450766 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-29663277-5531-47fe-88c9-d3dae14d9ddd tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:38.451224 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-29663277-5531-47fe-88c9-d3dae14d9ddd tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:38.452017 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-29663277-5531-47fe-88c9-d3dae14d9ddd tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:38.452461 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-29663277-5531-47fe-88c9-d3dae14d9ddd tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:38.531495 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-29663277-5531-47fe-88c9-d3dae14d9ddd tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 27497 microversion: 2.1 time: 0.092612 Dec 15 13:20:38.532485 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1569/3116] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:38 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 27497 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:20:39.543869 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-56e3d44f-f1c1-4ef6-a16d-36798c8cf6b9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:39.544794 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-56e3d44f-f1c1-4ef6-a16d-36798c8cf6b9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:39.552581 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-56e3d44f-f1c1-4ef6-a16d-36798c8cf6b9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:39.553031 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-56e3d44f-f1c1-4ef6-a16d-36798c8cf6b9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:39.553921 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-56e3d44f-f1c1-4ef6-a16d-36798c8cf6b9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:39.554355 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-56e3d44f-f1c1-4ef6-a16d-36798c8cf6b9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:39.646131 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-56e3d44f-f1c1-4ef6-a16d-36798c8cf6b9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 27906 microversion: 2.1 time: 0.106124 Dec 15 13:20:39.646788 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1548/3117] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:39 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 27906 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:20:40.658725 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-14650810-be56-496d-ac22-53bb26376b50 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:40.659923 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-14650810-be56-496d-ac22-53bb26376b50 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:40.666879 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-14650810-be56-496d-ac22-53bb26376b50 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:40.667331 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-14650810-be56-496d-ac22-53bb26376b50 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:40.668125 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-14650810-be56-496d-ac22-53bb26376b50 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:40.668559 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-14650810-be56-496d-ac22-53bb26376b50 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:40.759133 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-14650810-be56-496d-ac22-53bb26376b50 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 28160 microversion: 2.1 time: 0.104332 Dec 15 13:20:40.759980 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1570/3118] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:40 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 28160 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:20:41.772773 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-2f8564f5-d72c-447f-8e62-f22017c6f63e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:41.773807 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-2f8564f5-d72c-447f-8e62-f22017c6f63e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:41.780650 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2f8564f5-d72c-447f-8e62-f22017c6f63e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:41.781102 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2f8564f5-d72c-447f-8e62-f22017c6f63e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:41.781914 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2f8564f5-d72c-447f-8e62-f22017c6f63e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:41.782348 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-2f8564f5-d72c-447f-8e62-f22017c6f63e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:41.862323 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-2f8564f5-d72c-447f-8e62-f22017c6f63e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 28160 microversion: 2.1 time: 0.094493 Dec 15 13:20:41.862994 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1549/3119] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:41 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 28160 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:20:42.874795 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-cf827025-0f1a-4db2-bf4b-a5d803e75889 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:42.875789 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-cf827025-0f1a-4db2-bf4b-a5d803e75889 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:42.882732 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cf827025-0f1a-4db2-bf4b-a5d803e75889 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:42.883183 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cf827025-0f1a-4db2-bf4b-a5d803e75889 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:42.883966 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cf827025-0f1a-4db2-bf4b-a5d803e75889 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:42.884389 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-cf827025-0f1a-4db2-bf4b-a5d803e75889 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:42.961735 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-cf827025-0f1a-4db2-bf4b-a5d803e75889 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 28451 microversion: 2.1 time: 0.090741 Dec 15 13:20:42.962410 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1571/3120] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:42 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 28451 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:20:43.974040 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1f2277be-45b2-412c-9e2c-0f8abdf9024b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:43.975045 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1f2277be-45b2-412c-9e2c-0f8abdf9024b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:43.981950 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1f2277be-45b2-412c-9e2c-0f8abdf9024b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:43.982431 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1f2277be-45b2-412c-9e2c-0f8abdf9024b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:43.983243 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1f2277be-45b2-412c-9e2c-0f8abdf9024b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:43.983675 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1f2277be-45b2-412c-9e2c-0f8abdf9024b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:44.063249 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1f2277be-45b2-412c-9e2c-0f8abdf9024b tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 28619 microversion: 2.1 time: 0.093183 Dec 15 13:20:44.063898 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1550/3121] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:43 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 28619 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:20:45.076267 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-366cbdef-2365-4a89-ab7f-c151af55642a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:45.077234 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-366cbdef-2365-4a89-ab7f-c151af55642a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:45.084804 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-366cbdef-2365-4a89-ab7f-c151af55642a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:45.085248 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-366cbdef-2365-4a89-ab7f-c151af55642a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:45.086160 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-366cbdef-2365-4a89-ab7f-c151af55642a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:45.086605 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-366cbdef-2365-4a89-ab7f-c151af55642a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:45.151934 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-366cbdef-2365-4a89-ab7f-c151af55642a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 28619 microversion: 2.1 time: 0.079695 Dec 15 13:20:45.152611 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1572/3122] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:45 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 28619 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:20:46.165199 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-17c0e6a3-66e7-4d9b-b1ac-cd8ce8d08357 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:46.166232 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-17c0e6a3-66e7-4d9b-b1ac-cd8ce8d08357 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:46.173332 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-17c0e6a3-66e7-4d9b-b1ac-cd8ce8d08357 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:46.173802 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-17c0e6a3-66e7-4d9b-b1ac-cd8ce8d08357 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:46.174646 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-17c0e6a3-66e7-4d9b-b1ac-cd8ce8d08357 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:46.175079 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-17c0e6a3-66e7-4d9b-b1ac-cd8ce8d08357 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:46.254940 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-17c0e6a3-66e7-4d9b-b1ac-cd8ce8d08357 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 28619 microversion: 2.1 time: 0.093640 Dec 15 13:20:46.255591 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1551/3123] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:46 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 28619 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:20:47.267397 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-feb980c3-778c-4e76-8614-8b7364e2f6c1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:47.269272 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-feb980c3-778c-4e76-8614-8b7364e2f6c1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:47.276256 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-feb980c3-778c-4e76-8614-8b7364e2f6c1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:47.276702 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-feb980c3-778c-4e76-8614-8b7364e2f6c1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:47.277497 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-feb980c3-778c-4e76-8614-8b7364e2f6c1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:47.277971 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-feb980c3-778c-4e76-8614-8b7364e2f6c1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:47.345567 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-feb980c3-778c-4e76-8614-8b7364e2f6c1 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 28619 microversion: 2.1 time: 0.081916 Dec 15 13:20:47.346231 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1573/3124] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:47 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 28619 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:20:48.356922 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-30dafbbe-bcae-43b9-b8c6-314c312cde47 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:48.357962 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-30dafbbe-bcae-43b9-b8c6-314c312cde47 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:48.366030 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-30dafbbe-bcae-43b9-b8c6-314c312cde47 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:48.366483 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-30dafbbe-bcae-43b9-b8c6-314c312cde47 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:48.367266 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-30dafbbe-bcae-43b9-b8c6-314c312cde47 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:48.367701 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-30dafbbe-bcae-43b9-b8c6-314c312cde47 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:48.455470 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-30dafbbe-bcae-43b9-b8c6-314c312cde47 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 29005 microversion: 2.1 time: 0.102384 Dec 15 13:20:48.456346 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1552/3125] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:48 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 29005 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:20:49.468118 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-54e571f8-eeea-4524-92cc-36e5b66e2271 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:49.469142 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-54e571f8-eeea-4524-92cc-36e5b66e2271 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:49.476980 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-54e571f8-eeea-4524-92cc-36e5b66e2271 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:49.477438 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-54e571f8-eeea-4524-92cc-36e5b66e2271 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:49.478270 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-54e571f8-eeea-4524-92cc-36e5b66e2271 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:49.478708 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-54e571f8-eeea-4524-92cc-36e5b66e2271 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:49.562720 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-54e571f8-eeea-4524-92cc-36e5b66e2271 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 31119 microversion: 2.1 time: 0.098426 Dec 15 13:20:49.563290 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1574/3126] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:49 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 31119 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:20:50.575613 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-23d88b74-2634-4ffb-9a22-556388911b83 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:50.576544 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-23d88b74-2634-4ffb-9a22-556388911b83 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:50.583438 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-23d88b74-2634-4ffb-9a22-556388911b83 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:50.583883 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-23d88b74-2634-4ffb-9a22-556388911b83 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:50.584648 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-23d88b74-2634-4ffb-9a22-556388911b83 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:50.585078 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-23d88b74-2634-4ffb-9a22-556388911b83 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:50.670655 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-23d88b74-2634-4ffb-9a22-556388911b83 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 32443 microversion: 2.1 time: 0.098854 Dec 15 13:20:50.671338 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1553/3127] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:50 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 32443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:20:51.682778 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-669d0f79-9d3c-4cc3-93c2-9b7a1ef3d20a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:51.683814 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-669d0f79-9d3c-4cc3-93c2-9b7a1ef3d20a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:51.691582 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-669d0f79-9d3c-4cc3-93c2-9b7a1ef3d20a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:51.692041 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-669d0f79-9d3c-4cc3-93c2-9b7a1ef3d20a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:51.692831 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-669d0f79-9d3c-4cc3-93c2-9b7a1ef3d20a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:51.693276 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-669d0f79-9d3c-4cc3-93c2-9b7a1ef3d20a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:51.770222 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-669d0f79-9d3c-4cc3-93c2-9b7a1ef3d20a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 33323 microversion: 2.1 time: 0.091239 Dec 15 13:20:51.771177 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1575/3128] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:51 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 33323 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:20:52.782692 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-b4da8bc3-70a0-47b5-9dcb-928bc5398b2a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:52.783682 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-b4da8bc3-70a0-47b5-9dcb-928bc5398b2a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:52.790687 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b4da8bc3-70a0-47b5-9dcb-928bc5398b2a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:52.791133 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b4da8bc3-70a0-47b5-9dcb-928bc5398b2a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:52.791940 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b4da8bc3-70a0-47b5-9dcb-928bc5398b2a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:52.792406 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-b4da8bc3-70a0-47b5-9dcb-928bc5398b2a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:52.870916 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-b4da8bc3-70a0-47b5-9dcb-928bc5398b2a tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 34637 microversion: 2.1 time: 0.092104 Dec 15 13:20:52.871567 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1554/3129] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:52 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 34637 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:20:53.883430 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-791547a3-7919-44a0-8347-5eac3f749b1d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:53.884435 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-791547a3-7919-44a0-8347-5eac3f749b1d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:53.891754 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-791547a3-7919-44a0-8347-5eac3f749b1d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:53.892210 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-791547a3-7919-44a0-8347-5eac3f749b1d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:53.893802 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-791547a3-7919-44a0-8347-5eac3f749b1d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:53.894242 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-791547a3-7919-44a0-8347-5eac3f749b1d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:53.975695 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-791547a3-7919-44a0-8347-5eac3f749b1d tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 35820 microversion: 2.1 time: 0.096118 Dec 15 13:20:53.976678 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1576/3130] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:53 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 35820 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:20:54.989230 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-4a60ca5c-eb67-4fa1-8bf2-cb0c2c40aa06 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:54.990268 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-4a60ca5c-eb67-4fa1-8bf2-cb0c2c40aa06 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:54.997584 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a60ca5c-eb67-4fa1-8bf2-cb0c2c40aa06 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:54.998034 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a60ca5c-eb67-4fa1-8bf2-cb0c2c40aa06 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:54.998817 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a60ca5c-eb67-4fa1-8bf2-cb0c2c40aa06 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:54.999246 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-4a60ca5c-eb67-4fa1-8bf2-cb0c2c40aa06 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:55.082458 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-4a60ca5c-eb67-4fa1-8bf2-cb0c2c40aa06 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 37344 microversion: 2.1 time: 0.097935 Dec 15 13:20:55.083063 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1555/3131] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:54 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 37344 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:20:56.095277 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-0e1d99d2-23f9-46f9-914e-a55d85583e8e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:56.096261 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-0e1d99d2-23f9-46f9-914e-a55d85583e8e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:56.103331 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0e1d99d2-23f9-46f9-914e-a55d85583e8e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:56.103787 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0e1d99d2-23f9-46f9-914e-a55d85583e8e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:56.104574 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0e1d99d2-23f9-46f9-914e-a55d85583e8e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:56.105016 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-0e1d99d2-23f9-46f9-914e-a55d85583e8e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:56.189379 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-0e1d99d2-23f9-46f9-914e-a55d85583e8e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 38150 microversion: 2.1 time: 0.097929 Dec 15 13:20:56.190654 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1577/3132] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:56 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 38150 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:20:57.201558 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-e90ee735-b68c-4ca2-9c12-c1f124ec4447 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:57.202559 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-e90ee735-b68c-4ca2-9c12-c1f124ec4447 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:57.210049 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e90ee735-b68c-4ca2-9c12-c1f124ec4447 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:57.210497 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e90ee735-b68c-4ca2-9c12-c1f124ec4447 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:57.211270 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e90ee735-b68c-4ca2-9c12-c1f124ec4447 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:57.211705 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-e90ee735-b68c-4ca2-9c12-c1f124ec4447 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:57.282389 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-e90ee735-b68c-4ca2-9c12-c1f124ec4447 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 38150 microversion: 2.1 time: 0.084631 Dec 15 13:20:57.283052 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1556/3133] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:57 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 38150 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:20:58.295097 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9d51ca2b-2faf-4340-a51a-81cd4f3e5d69 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:58.296091 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9d51ca2b-2faf-4340-a51a-81cd4f3e5d69 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:58.303817 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9d51ca2b-2faf-4340-a51a-81cd4f3e5d69 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:58.304270 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9d51ca2b-2faf-4340-a51a-81cd4f3e5d69 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:58.305058 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9d51ca2b-2faf-4340-a51a-81cd4f3e5d69 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:58.305494 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9d51ca2b-2faf-4340-a51a-81cd4f3e5d69 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:58.380338 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9d51ca2b-2faf-4340-a51a-81cd4f3e5d69 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 38150 microversion: 2.1 time: 0.089110 Dec 15 13:20:58.380997 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1578/3134] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:58 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 38150 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:20:59.392503 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-ba1f8dfa-2a48-4ff1-bac8-dcbcea944a05 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:20:59.393936 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-ba1f8dfa-2a48-4ff1-bac8-dcbcea944a05 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:20:59.400735 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ba1f8dfa-2a48-4ff1-bac8-dcbcea944a05 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:59.401178 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ba1f8dfa-2a48-4ff1-bac8-dcbcea944a05 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:59.401993 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ba1f8dfa-2a48-4ff1-bac8-dcbcea944a05 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:20:59.402425 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-ba1f8dfa-2a48-4ff1-bac8-dcbcea944a05 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:20:59.490408 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-ba1f8dfa-2a48-4ff1-bac8-dcbcea944a05 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 38153 microversion: 2.1 time: 0.101706 Dec 15 13:20:59.491061 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1557/3135] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:20:59 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 38153 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:21:00.503585 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-c5c0ac90-9d65-40df-8f81-b7bdc84e7654 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:21:00.504685 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-c5c0ac90-9d65-40df-8f81-b7bdc84e7654 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:21:00.512849 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c5c0ac90-9d65-40df-8f81-b7bdc84e7654 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:00.513294 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c5c0ac90-9d65-40df-8f81-b7bdc84e7654 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:00.514117 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c5c0ac90-9d65-40df-8f81-b7bdc84e7654 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:00.514553 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-c5c0ac90-9d65-40df-8f81-b7bdc84e7654 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:00.606880 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-c5c0ac90-9d65-40df-8f81-b7bdc84e7654 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action" status: 200 len: 38279 microversion: 2.1 time: 0.107753 Dec 15 13:21:00.607458 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1579/3136] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Dec 15 13:21:00 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/action => generated 38279 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:21:00.620784 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-543ceb21-47c7-4b20-aa4e-856acfa4c38c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:21:00.621378 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-543ceb21-47c7-4b20-aa4e-856acfa4c38c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:21:00.629425 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-543ceb21-47c7-4b20-aa4e-856acfa4c38c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:00.629969 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-543ceb21-47c7-4b20-aa4e-856acfa4c38c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:00.630776 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-543ceb21-47c7-4b20-aa4e-856acfa4c38c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:00.631217 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-543ceb21-47c7-4b20-aa4e-856acfa4c38c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:00.655834 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-543ceb21-47c7-4b20-aa4e-856acfa4c38c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/ips" status: 200 len: 144 microversion: 2.1 time: 0.041026 Dec 15 13:21:00.656412 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1558/3137] 10.222.0.76 () {58 vars in 1247 bytes} [Wed Dec 15 13:21:00 2021] GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/ips => generated 144 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:21:01.982068 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-b5647bc0-d350-40a0-afe7-d0ce48c91c97 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3169898-cccb-4832-abb9-914e154c8fb3"}} {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:21:01.983197 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-b5647bc0-d350-40a0-afe7-d0ce48c91c97 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:21:01.992111 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5647bc0-d350-40a0-afe7-d0ce48c91c97 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:01.992560 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5647bc0-d350-40a0-afe7-d0ce48c91c97 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:01.993336 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5647bc0-d350-40a0-afe7-d0ce48c91c97 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:01.993852 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-b5647bc0-d350-40a0-afe7-d0ce48c91c97 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:02.238642 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-b5647bc0-d350-40a0-afe7-d0ce48c91c97 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260652 Dec 15 13:21:02.239251 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1580/3138] 10.222.0.76 () {60 vars in 1322 bytes} [Wed Dec 15 13:21:01 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:21:09.717187 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-233bd5ea-50ff-4a43-b129-149a54eacecc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:21:09.725613 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-233bd5ea-50ff-4a43-b129-149a54eacecc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:21:09.732625 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-233bd5ea-50ff-4a43-b129-149a54eacecc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:09.733064 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-233bd5ea-50ff-4a43-b129-149a54eacecc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:09.733880 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-233bd5ea-50ff-4a43-b129-149a54eacecc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:09.734306 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-233bd5ea-50ff-4a43-b129-149a54eacecc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:09.763708 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-233bd5ea-50ff-4a43-b129-149a54eacecc tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050139 Dec 15 13:21:09.764259 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1559/3139] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 13:21:09 2021] GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:21:09.776570 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-3816c0b4-7e62-4eaf-8147-74896cdbcd70 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:21:09.777190 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-3816c0b4-7e62-4eaf-8147-74896cdbcd70 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:21:09.783455 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3816c0b4-7e62-4eaf-8147-74896cdbcd70 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:09.783905 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3816c0b4-7e62-4eaf-8147-74896cdbcd70 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:09.784687 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3816c0b4-7e62-4eaf-8147-74896cdbcd70 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:09.785122 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-3816c0b4-7e62-4eaf-8147-74896cdbcd70 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:09.812573 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-3816c0b4-7e62-4eaf-8147-74896cdbcd70 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/os-volume_attachments/a3169898-cccb-4832-abb9-914e154c8fb3" status: 200 len: 194 microversion: 2.1 time: 0.040693 Dec 15 13:21:09.813160 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1581/3140] 10.222.0.76 () {58 vars in 1412 bytes} [Wed Dec 15 13:21:09 2021] GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/os-volume_attachments/a3169898-cccb-4832-abb9-914e154c8fb3 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:21:11.126369 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9ea2da52-2811-4f98-9f80-d0233923823c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bd2fcce-5fe3-469c-b219-95a179a97a50"}} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:21:11.128326 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9ea2da52-2811-4f98-9f80-d0233923823c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:21:11.135225 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9ea2da52-2811-4f98-9f80-d0233923823c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:11.135672 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9ea2da52-2811-4f98-9f80-d0233923823c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:11.136465 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9ea2da52-2811-4f98-9f80-d0233923823c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:11.136900 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9ea2da52-2811-4f98-9f80-d0233923823c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:11.376739 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9ea2da52-2811-4f98-9f80-d0233923823c tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254102 Dec 15 13:21:11.377431 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1560/3141] 10.222.0.76 () {60 vars in 1322 bytes} [Wed Dec 15 13:21:11 2021] POST /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:21:18.871154 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-52424690-5bb0-4aec-b118-b7a14e07fca9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:21:18.872115 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-52424690-5bb0-4aec-b118-b7a14e07fca9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:21:18.878877 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-52424690-5bb0-4aec-b118-b7a14e07fca9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:18.879319 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-52424690-5bb0-4aec-b118-b7a14e07fca9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:18.880089 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-52424690-5bb0-4aec-b118-b7a14e07fca9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:18.880521 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-52424690-5bb0-4aec-b118-b7a14e07fca9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:18.911138 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-52424690-5bb0-4aec-b118-b7a14e07fca9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043587 Dec 15 13:21:18.911717 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1582/3142] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 13:21:18 2021] GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:21:19.124608 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1d53613b-645a-4472-a0a9-b20a175e9d47 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:21:19.125146 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1d53613b-645a-4472-a0a9-b20a175e9d47 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:21:19.132399 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1d53613b-645a-4472-a0a9-b20a175e9d47 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:19.132850 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1d53613b-645a-4472-a0a9-b20a175e9d47 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:19.133658 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1d53613b-645a-4472-a0a9-b20a175e9d47 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:19.134096 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1d53613b-645a-4472-a0a9-b20a175e9d47 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:19.162498 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1d53613b-645a-4472-a0a9-b20a175e9d47 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/os-volume_attachments/a3169898-cccb-4832-abb9-914e154c8fb3" status: 200 len: 194 microversion: 2.1 time: 0.042457 Dec 15 13:21:19.163117 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1561/3143] 10.222.0.76 () {58 vars in 1412 bytes} [Wed Dec 15 13:21:19 2021] GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/os-volume_attachments/a3169898-cccb-4832-abb9-914e154c8fb3 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:21:19.172667 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-09376771-f897-4c07-b460-a97760aa8fe6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:21:19.173162 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-09376771-f897-4c07-b460-a97760aa8fe6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:21:19.180026 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-09376771-f897-4c07-b460-a97760aa8fe6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:19.180476 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-09376771-f897-4c07-b460-a97760aa8fe6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:19.181251 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-09376771-f897-4c07-b460-a97760aa8fe6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:19.181719 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-09376771-f897-4c07-b460-a97760aa8fe6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:19.264633 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.objects.instance [None req-09376771-f897-4c07-b460-a97760aa8fe6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lazy-loading 'services' on Instance uuid 7c86be3b-964a-48c0-b8f9-698cee399b37 {{(pid=122614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:21:19.336940 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-09376771-f897-4c07-b460-a97760aa8fe6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "DELETE /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/os-volume_attachments/a3169898-cccb-4832-abb9-914e154c8fb3" status: 202 len: 0 microversion: 2.1 time: 0.167789 Dec 15 13:21:19.337570 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1583/3144] 10.222.0.76 () {58 vars in 1415 bytes} [Wed Dec 15 13:21:19 2021] DELETE /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/os-volume_attachments/a3169898-cccb-4832-abb9-914e154c8fb3 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:21:20.456003 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-1b79186d-0ad3-4392-b6c9-b6f86f605696 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:21:20.456642 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-1b79186d-0ad3-4392-b6c9-b6f86f605696 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:21:20.462672 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b79186d-0ad3-4392-b6c9-b6f86f605696 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:20.463114 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b79186d-0ad3-4392-b6c9-b6f86f605696 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:20.463887 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b79186d-0ad3-4392-b6c9-b6f86f605696 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:20.464313 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-1b79186d-0ad3-4392-b6c9-b6f86f605696 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:20.493229 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-1b79186d-0ad3-4392-b6c9-b6f86f605696 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/os-volume_attachments/4bd2fcce-5fe3-469c-b219-95a179a97a50" status: 200 len: 194 microversion: 2.1 time: 0.041556 Dec 15 13:21:20.493840 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1562/3145] 10.222.0.76 () {58 vars in 1412 bytes} [Wed Dec 15 13:21:20 2021] GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/os-volume_attachments/4bd2fcce-5fe3-469c-b219-95a179a97a50 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:21:20.504948 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-ca926aa0-af4b-48f9-8ea3-ee9bfa9990e6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:21:20.505579 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-ca926aa0-af4b-48f9-8ea3-ee9bfa9990e6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:21:20.511688 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ca926aa0-af4b-48f9-8ea3-ee9bfa9990e6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:20.512138 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ca926aa0-af4b-48f9-8ea3-ee9bfa9990e6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:20.512911 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ca926aa0-af4b-48f9-8ea3-ee9bfa9990e6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:20.513351 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-ca926aa0-af4b-48f9-8ea3-ee9bfa9990e6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:20.605654 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.objects.instance [None req-ca926aa0-af4b-48f9-8ea3-ee9bfa9990e6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lazy-loading 'services' on Instance uuid 7c86be3b-964a-48c0-b8f9-698cee399b37 {{(pid=122614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:21:20.681184 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-ca926aa0-af4b-48f9-8ea3-ee9bfa9990e6 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "DELETE /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/os-volume_attachments/4bd2fcce-5fe3-469c-b219-95a179a97a50" status: 202 len: 0 microversion: 2.1 time: 0.181091 Dec 15 13:21:20.681817 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1584/3146] 10.222.0.76 () {58 vars in 1415 bytes} [Wed Dec 15 13:21:20 2021] DELETE /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/os-volume_attachments/4bd2fcce-5fe3-469c-b219-95a179a97a50 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:21:21.834319 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-9a0c18c9-3735-4eb7-8681-315abd6b817e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:21:21.835276 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-9a0c18c9-3735-4eb7-8681-315abd6b817e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:21:21.841434 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9a0c18c9-3735-4eb7-8681-315abd6b817e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:21.841908 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9a0c18c9-3735-4eb7-8681-315abd6b817e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:21.842671 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9a0c18c9-3735-4eb7-8681-315abd6b817e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:21.843105 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-9a0c18c9-3735-4eb7-8681-315abd6b817e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:21.873646 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-9a0c18c9-3735-4eb7-8681-315abd6b817e tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042957 Dec 15 13:21:21.874246 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1563/3147] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 13:21:21 2021] GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:21:21.984123 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-a8b461e3-7758-486f-b4a2-95cafeda8863 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:21:21.985144 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-a8b461e3-7758-486f-b4a2-95cafeda8863 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:21:21.992040 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a8b461e3-7758-486f-b4a2-95cafeda8863 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:21.992492 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a8b461e3-7758-486f-b4a2-95cafeda8863 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:21.993338 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a8b461e3-7758-486f-b4a2-95cafeda8863 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:21.993749 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-a8b461e3-7758-486f-b4a2-95cafeda8863 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:22.022096 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-a8b461e3-7758-486f-b4a2-95cafeda8863 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042622 Dec 15 13:21:22.022665 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1585/3148] 10.222.0.76 () {58 vars in 1301 bytes} [Wed Dec 15 13:21:21 2021] GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 13:21:22.078084 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-89d6f80a-21a5-447a-88a5-0a5d2b895cb9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:21:22.078584 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-89d6f80a-21a5-447a-88a5-0a5d2b895cb9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:21:22.091454 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-89d6f80a-21a5-447a-88a5-0a5d2b895cb9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:22.091906 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-89d6f80a-21a5-447a-88a5-0a5d2b895cb9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:22.092807 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-89d6f80a-21a5-447a-88a5-0a5d2b895cb9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:22.093292 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-89d6f80a-21a5-447a-88a5-0a5d2b895cb9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:22.119210 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-89d6f80a-21a5-447a-88a5-0a5d2b895cb9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Going to try to terminate instance {{(pid=122615) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:21:22.199216 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-89d6f80a-21a5-447a-88a5-0a5d2b895cb9 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "DELETE /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37" status: 204 len: 0 microversion: 2.1 time: 0.124363 Dec 15 13:21:22.199981 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1564/3149] 10.222.0.76 () {58 vars in 1238 bytes} [Wed Dec 15 13:21:22 2021] DELETE /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:21:22.208991 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-91ea40e7-186a-4c87-bc31-179f2c19ef13 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:21:22.209633 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-91ea40e7-186a-4c87-bc31-179f2c19ef13 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:21:22.215384 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-91ea40e7-186a-4c87-bc31-179f2c19ef13 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:22.215832 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-91ea40e7-186a-4c87-bc31-179f2c19ef13 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:22.216601 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-91ea40e7-186a-4c87-bc31-179f2c19ef13 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:22.217040 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-91ea40e7-186a-4c87-bc31-179f2c19ef13 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:22.361082 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-91ea40e7-186a-4c87-bc31-179f2c19ef13 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:21:22.368407 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-91ea40e7-186a-4c87-bc31-179f2c19ef13 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37" status: 200 len: 1671 microversion: 2.1 time: 0.163774 Dec 15 13:21:22.368970 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1586/3150] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:21:22 2021] GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37 => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:21:23.386308 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-c2bb2b9e-14bd-4926-9ea9-5f8cb314bcbb tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:21:23.387026 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-c2bb2b9e-14bd-4926-9ea9-5f8cb314bcbb tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:21:23.394141 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2bb2b9e-14bd-4926-9ea9-5f8cb314bcbb tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:23.394594 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2bb2b9e-14bd-4926-9ea9-5f8cb314bcbb tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:23.395391 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2bb2b9e-14bd-4926-9ea9-5f8cb314bcbb tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:23.395825 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-c2bb2b9e-14bd-4926-9ea9-5f8cb314bcbb tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:23.530839 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.policy [None req-c2bb2b9e-14bd-4926-9ea9-5f8cb314bcbb tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122615) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:21:23.539413 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-c2bb2b9e-14bd-4926-9ea9-5f8cb314bcbb tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37" status: 200 len: 1671 microversion: 2.1 time: 0.157200 Dec 15 13:21:23.539944 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1565/3151] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:21:23 2021] GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:21:24.557250 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-9490a1ce-f7ca-4af8-9e4e-019751a461f7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:21:24.558018 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-9490a1ce-f7ca-4af8-9e4e-019751a461f7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:21:24.564100 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9490a1ce-f7ca-4af8-9e4e-019751a461f7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:24.565129 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9490a1ce-f7ca-4af8-9e4e-019751a461f7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:24.566057 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9490a1ce-f7ca-4af8-9e4e-019751a461f7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:24.566496 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-9490a1ce-f7ca-4af8-9e4e-019751a461f7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:24.710716 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.policy [None req-9490a1ce-f7ca-4af8-9e4e-019751a461f7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e8e15913354e24ac86a7d6ad02960f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14d0b1e292642178957ec76e117319f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122614) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:21:24.718234 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-9490a1ce-f7ca-4af8-9e4e-019751a461f7 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37" status: 200 len: 1671 microversion: 2.1 time: 0.164832 Dec 15 13:21:24.718804 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1587/3152] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:21:24 2021] GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37 => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:21:25.076489 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [req-ecf0c58f-d6f6-4654-8c1b-f68740ddad3a req-403826c6-dbf3-4fdd-baa7-e3282e62283d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c86be3b-964a-48c0-b8f9-698cee399b37", "name": "network-vif-deleted", "tag": "10145ee6-eec3-4466-bb6a-d11d20586f37"}]} {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:21:25.078034 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:21:25.078034 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: warnings.warn(msg) Dec 15 13:21:25.085650 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-ecf0c58f-d6f6-4654-8c1b-f68740ddad3a req-403826c6-dbf3-4fdd-baa7-e3282e62283d service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:25.086094 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [req-ecf0c58f-d6f6-4654-8c1b-f68740ddad3a req-403826c6-dbf3-4fdd-baa7-e3282e62283d service nova] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:25.098412 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.compute.server_external_events [req-ecf0c58f-d6f6-4654-8c1b-f68740ddad3a req-403826c6-dbf3-4fdd-baa7-e3282e62283d service nova] Creating event network-vif-deleted:10145ee6-eec3-4466-bb6a-d11d20586f37 for instance 7c86be3b-964a-48c0-b8f9-698cee399b37 on hv-cinder-81322 Dec 15 13:21:25.104506 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [req-ecf0c58f-d6f6-4654-8c1b-f68740ddad3a req-403826c6-dbf3-4fdd-baa7-e3282e62283d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031365 Dec 15 13:21:25.105421 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1566/3153] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Dec 15 13:21:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:21:25.735259 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fb84610b-fa73-4301-b312-2cfed37832cb tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:21:25.736189 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-fb84610b-fa73-4301-b312-2cfed37832cb tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:21:25.744511 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fb84610b-fa73-4301-b312-2cfed37832cb tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:25.744835 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fb84610b-fa73-4301-b312-2cfed37832cb tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:25.745658 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fb84610b-fa73-4301-b312-2cfed37832cb tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:25.746169 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-fb84610b-fa73-4301-b312-2cfed37832cb tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:25.764739 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.wsgi [None req-fb84610b-fa73-4301-b312-2cfed37832cb tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] HTTP exception thrown: Instance 7c86be3b-964a-48c0-b8f9-698cee399b37 could not be found. Dec 15 13:21:25.765584 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-fb84610b-fa73-4301-b312-2cfed37832cb tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Returning 404 to user: Instance 7c86be3b-964a-48c0-b8f9-698cee399b37 could not be found. {{(pid=122614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:21:25.767122 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-fb84610b-fa73-4301-b312-2cfed37832cb tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37" status: 404 len: 111 microversion: 2.1 time: 0.035365 Dec 15 13:21:25.768923 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1588/3154] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:21:25 2021] GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:21:25.782593 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-cb619e6a-f950-46f1-b5b5-b2d6606aa578 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '.version_select at 0x7f3c69147ca0>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:21:25.801187 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-cb619e6a-f950-46f1-b5b5-b2d6606aa578 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2135826760" status: 202 len: 0 microversion: 2.1 time: 0.024376 Dec 15 13:21:25.801798 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1567/3155] 10.222.0.76 () {58 vars in 1220 bytes} [Wed Dec 15 13:21:25 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2135826760 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:21:28.747301 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f4d72d36-7216-40f7-af58-9beb5a9d8e77 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:21:28.747788 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-f4d72d36-7216-40f7-af58-9beb5a9d8e77 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:21:28.754234 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4d72d36-7216-40f7-af58-9beb5a9d8e77 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:28.754682 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4d72d36-7216-40f7-af58-9beb5a9d8e77 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:28.755449 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4d72d36-7216-40f7-af58-9beb5a9d8e77 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:28.755886 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-f4d72d36-7216-40f7-af58-9beb5a9d8e77 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:28.770530 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.wsgi [None req-f4d72d36-7216-40f7-af58-9beb5a9d8e77 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] HTTP exception thrown: Instance 7c86be3b-964a-48c0-b8f9-698cee399b37 could not be found. Dec 15 13:21:28.771127 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-f4d72d36-7216-40f7-af58-9beb5a9d8e77 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Returning 404 to user: Instance 7c86be3b-964a-48c0-b8f9-698cee399b37 could not be found. {{(pid=122614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:21:28.771963 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-f4d72d36-7216-40f7-af58-9beb5a9d8e77 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "DELETE /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37" status: 404 len: 111 microversion: 2.1 time: 0.028346 Dec 15 13:21:28.772512 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1589/3156] 10.222.0.76 () {58 vars in 1238 bytes} [Wed Dec 15 13:21:28 2021] DELETE /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:21:28.780547 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-724d5b47-4e3c-4f1d-aba0-484e8efb39f2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:21:28.781268 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-724d5b47-4e3c-4f1d-aba0-484e8efb39f2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 7c86be3b-964a-48c0-b8f9-698cee399b37] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:21:28.788040 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-724d5b47-4e3c-4f1d-aba0-484e8efb39f2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:28.788481 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-724d5b47-4e3c-4f1d-aba0-484e8efb39f2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:28.789239 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-724d5b47-4e3c-4f1d-aba0-484e8efb39f2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:28.789699 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-724d5b47-4e3c-4f1d-aba0-484e8efb39f2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:28.803260 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.wsgi [None req-724d5b47-4e3c-4f1d-aba0-484e8efb39f2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] HTTP exception thrown: Instance 7c86be3b-964a-48c0-b8f9-698cee399b37 could not be found. Dec 15 13:21:28.803834 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-724d5b47-4e3c-4f1d-aba0-484e8efb39f2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Returning 404 to user: Instance 7c86be3b-964a-48c0-b8f9-698cee399b37 could not be found. {{(pid=122615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:21:28.804667 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-724d5b47-4e3c-4f1d-aba0-484e8efb39f2 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37" status: 404 len: 111 microversion: 2.1 time: 0.028227 Dec 15 13:21:28.805224 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1568/3157] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:21:28 2021] GET /compute/v2.1/servers/7c86be3b-964a-48c0-b8f9-698cee399b37 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:21:29.934522 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-58587dbf-3a8f-4285-b078-bad7bfe52e11 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:21:29.935023 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.compute.api [None req-58587dbf-3a8f-4285-b078-bad7bfe52e11 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122614) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:21:29.941310 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-58587dbf-3a8f-4285-b078-bad7bfe52e11 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:29.941797 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-58587dbf-3a8f-4285-b078-bad7bfe52e11 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:29.942612 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-58587dbf-3a8f-4285-b078-bad7bfe52e11 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:29.943052 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG oslo_concurrency.lockutils [None req-58587dbf-3a8f-4285-b078-bad7bfe52e11 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:29.957066 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.wsgi [None req-58587dbf-3a8f-4285-b078-bad7bfe52e11 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] HTTP exception thrown: Instance 156953db-d05a-4a97-9bfe-f5c5ee19edc9 could not be found. Dec 15 13:21:29.957713 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: DEBUG nova.api.openstack.wsgi [None req-58587dbf-3a8f-4285-b078-bad7bfe52e11 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Returning 404 to user: Instance 156953db-d05a-4a97-9bfe-f5c5ee19edc9 could not be found. {{(pid=122614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:21:29.958604 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO nova.api.openstack.requestlog [None req-58587dbf-3a8f-4285-b078-bad7bfe52e11 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "DELETE /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 404 len: 111 microversion: 2.1 time: 0.027703 Dec 15 13:21:29.959169 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: [pid: 122614|app: 0|req: 1590/3158] 10.222.0.76 () {58 vars in 1238 bytes} [Wed Dec 15 13:21:29 2021] DELETE /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:21:29.967105 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3c888a85-3e42-4566-b9c5-7da2d5a25971 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Calling method '>' {{(pid=122615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:21:29.967718 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.compute.api [None req-3c888a85-3e42-4566-b9c5-7da2d5a25971 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] [instance: 156953db-d05a-4a97-9bfe-f5c5ee19edc9] Fetching instance by UUID {{(pid=122615) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:21:29.974908 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c888a85-3e42-4566-b9c5-7da2d5a25971 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:29.975360 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c888a85-3e42-4566-b9c5-7da2d5a25971 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:29.976138 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c888a85-3e42-4566-b9c5-7da2d5a25971 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:21:29.976569 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG oslo_concurrency.lockutils [None req-3c888a85-3e42-4566-b9c5-7da2d5a25971 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Lock "8bd32f78-c52f-42b9-874a-80fccc21ade4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:21:29.989762 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.wsgi [None req-3c888a85-3e42-4566-b9c5-7da2d5a25971 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] HTTP exception thrown: Instance 156953db-d05a-4a97-9bfe-f5c5ee19edc9 could not be found. Dec 15 13:21:29.990347 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: DEBUG nova.api.openstack.wsgi [None req-3c888a85-3e42-4566-b9c5-7da2d5a25971 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] Returning 404 to user: Instance 156953db-d05a-4a97-9bfe-f5c5ee19edc9 could not be found. {{(pid=122615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:21:29.991160 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO nova.api.openstack.requestlog [None req-3c888a85-3e42-4566-b9c5-7da2d5a25971 tempest-AttachVolumeTestJSON-1843180509 tempest-AttachVolumeTestJSON-1843180509-project] 10.222.0.76 "GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9" status: 404 len: 111 microversion: 2.1 time: 0.027856 Dec 15 13:21:29.991697 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: [pid: 122615|app: 0|req: 1569/3159] 10.222.0.76 () {58 vars in 1235 bytes} [Wed Dec 15 13:21:29 2021] GET /compute/v2.1/servers/156953db-d05a-4a97-9bfe-f5c5ee19edc9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:22:58.469376 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:22:58.470107 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 13:22:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:22:58.584026 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:22:58.584576 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 13:22:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:23:04.333897 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:23:04.334553 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 13:23:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:24:28.902694 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:24:28.903317 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 13:24:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:26:18.487013 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:26:18.487730 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 13:26:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:26:18.606272 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:26:18.606820 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 13:26:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:26:24.352656 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:26:24.353302 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 13:26:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:26:37.213964 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:26:37.214654 dv-cinder-813224-4-iscsi devstack@n-api.service[122614]: Wed Dec 15 13:26:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:26:40.094106 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:26:40.094705 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 13:26:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:27:48.920783 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:27:48.921489 dv-cinder-813224-4-iscsi devstack@n-api.service[122615]: Wed Dec 15 13:27:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!